Skip to content

mobility tables & evaluation#25

Open
andtsa wants to merge 1 commit intomainfrom
mobility
Open

mobility tables & evaluation#25
andtsa wants to merge 1 commit intomainfrom
mobility

Conversation

@andtsa
Copy link
Owner

@andtsa andtsa commented Feb 22, 2025

No description provided.

@github-actions
Copy link

d6 benchmark results:

d6 on TARGET branch:
--------------------
�[1m�[32m    Finished�[0m `test` profile [unoptimized + debuginfo] target(s) in 0.07s
�[1m�[32m     Running�[0m tests/d6.rs (target/debug/deps/d6-2f8d08def65025bc)

running 1 test
[*] creating engine at version 0.4.0
[*] tt: created VL table with 8 entries.
[*] Entering UCI mode
engine_info (1ms): info string table resized to 8 entries.
[*] uci: option use_tt set to on.
engine_info (1ms): info string table resized to 1024 entries.
engine_info (11ms): info depth 1 seldepth 1 multipv 1 nodes 40 nps 133103 hashfull 0 tbhits 0 time 0 score cp 11 pv g1f3
engine_info (11ms): info depth 2 seldepth 2 multipv 1 nodes 222 nps 140064 hashfull 19 tbhits 0 time 1 score cp 25 pv g1f3 g8f6
engine_info (31ms): info depth 3 seldepth 3 multipv 1 nodes 3554 nps 156534 hashfull 125 tbhits 0 time 22 score cp 13 pv b1c3 g8f6 c3d5
engine_info (152ms): info depth 4 seldepth 4 multipv 1 nodes 22046 nps 146682 hashfull 753 tbhits 157 time 150 score cp 23 pv b1c3 d7d5 g1f3 g8f6
engine_info (1937ms): info depth 5 seldepth 5 multipv 1 nodes 291359 nps 150552 hashfull 1000 tbhits 1429 time 1935 score cp 83 pv e2e4 b8c6 d1g4 c6d4 g4g7
engine_info (28014ms): info depth 6 seldepth 6 multipv 1 nodes 4031774 nps 143971 hashfull 1000 tbhits 24019 time 28003 score cp -38 pv b1c3 e7e6 c3b5 f8c5 e2e3 c5e3
Best move: b1c3
 duration: 28034ms 
 total nodes searched: 4348995 
killing child
test main ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 28.03s

********************
d6 on SOURCE branch:
--------------------
�[1m�[32m   Compiling�[0m chesseng v0.4.0 (/home/runner/work/chesseng/chesseng)
�[1m�[32m    Finished�[0m `test` profile [unoptimized + debuginfo] target(s) in 1.57s
�[1m�[32m     Running�[0m tests/d6.rs (target/debug/deps/d6-2f8d08def65025bc)

running 1 test
[*] creating engine at version 0.4.0
[*] tt: created VL table with 8 entries.
[*] Entering UCI mode
engine_info (0ms): info string table resized to 8 entries.
[*] uci: option use_tt set to on.
engine_info (1ms): info string table resized to 1024 entries.
engine_info (11ms): info depth 1 seldepth 1 multipv 1 nodes 40 nps 47876 hashfull 0 tbhits 0 time 0 score cp 27 pv d2d4
engine_info (11ms): info depth 2 seldepth 2 multipv 1 nodes 214 nps 51397 hashfull 19 tbhits 0 time 4 score cp 25 pv d2d4 d7d5
engine_info (61ms): info depth 3 seldepth 3 multipv 1 nodes 2802 nps 49728 hashfull 109 tbhits 0 time 56 score cp 27 pv e2e4 e7e5 d2d4
engine_info (585ms): info depth 4 seldepth 4 multipv 1 nodes 28389 nps 49197 hashfull 798 tbhits 241 time 577 score cp 19 pv g1f3 d7d5 d2d4 e7e5
engine_info (4682ms): info depth 5 seldepth 5 multipv 1 nodes 223266 nps 47792 hashfull 1000 tbhits 1157 time 4671 score cp 88 pv e2e4 b8c6 d1g4 e7e5 g4g7
test main has been running for over 60 seconds
engine_info (79147ms): info depth 6 seldepth 6 multipv 1 nodes 3681364 nps 46513 hashfull 1000 tbhits 23531 time 79146 score cp -47 pv b1c3 e7e5 c3d5 c7c6 d5e3 d7d5
Best move: b1c3
 duration: 79167ms 
 total nodes searched: 3936075 
killing child
test main ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 79.17s


@github-actions
Copy link

Search benchmark results:

search_bench/id_pos_0   time:   [68.027 µs 70.496 µs 72.975 µs]
                        change: [-5.7620% +7.6957% +24.545%] (p = 0.34 > 0.05)
                        No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
  1 (1.00%) low mild
  3 (3.00%) high mild
  3 (3.00%) high severe
search_bench/id_pos_1   time:   [66.668 µs 68.873 µs 71.076 µs]
                        change: [-7.2043% +2.3385% +12.647%] (p = 0.65 > 0.05)
                        No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe
search_bench/id_pos_2   time:   [68.294 µs 70.229 µs 72.118 µs]
                        change: [-10.448% -1.1351% +9.0398%] (p = 0.82 > 0.05)
                        No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
  6 (6.00%) high mild
  3 (3.00%) high severe
search_bench/id_pos_3   time:   [67.775 µs 70.032 µs 72.366 µs]
                        change: [-12.087% -2.8711% +7.3365%] (p = 0.58 > 0.05)
                        No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild


@github-actions
Copy link

Negamax benchmark results:

negamax_bench/ngm_full_depth_3
                        time:   [568.71 µs 572.54 µs 578.29 µs]
                        change: [+167.49% +169.16% +171.02%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high severe
negamax_bench/ngm_full_depth_4
                        time:   [741.42 µs 742.29 µs 743.04 µs]
                        change: [+174.71% +175.49% +176.48%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) low severe
  2 (2.00%) low mild
  2 (2.00%) high severe
negamax_bench/ngm_full_depth_5
                        time:   [890.96 µs 891.48 µs 892.05 µs]
                        change: [+169.22% +170.23% +171.12%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
  2 (2.00%) low mild
  4 (4.00%) high mild
  2 (2.00%) high severe
negamax_bench/ngm_full_depth_6
                        time:   [1.0370 ms 1.0379 ms 1.0389 ms]
                        change: [+165.23% +166.78% +167.81%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
  3 (3.00%) high mild
  2 (2.00%) high severe


@github-actions
Copy link

Evaluation benchmark results:

eval_bench/eval_full    time:   [846.82 µs 848.44 µs 851.39 µs]
                        change: [+72.767% +73.470% +74.182%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 13 outliers among 100 measurements (13.00%)
  2 (2.00%) low mild
  1 (1.00%) high mild
  10 (10.00%) high severe


@github-actions
Copy link

MoveGen benchmark results:

move_gen_bench/unordered
                        time:   [712.20 µs 714.03 µs 716.09 µs]
                        change: [-2.5237% -1.8328% -1.3979%] (p = 0.00 < 0.05)
                        Change within noise threshold.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe
move_gen_bench/ordered  time:   [862.09 µs 862.81 µs 863.51 µs]
                        change: [-0.3245% -0.1539% +0.0584%] (p = 0.10 > 0.05)
                        No change in performance detected.
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) high mild
  1 (1.00%) high severe


Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant