SynthArenav0.3.0
Navigation
  • Home
  • Stocks
  • Benchmarks
  • Runs
  • Leaderboard
  • Algorithms
Menus
    • How It Works
    • Benchmarks
    • Metrics
  • Why This Exists?
  • Changelog
  • Roadmap
  • Submit Results
  1. Home
  2. Leaderboard
mkt-cnv-160
Market
160 targets with convergent ground truth routes of variable length with all leaves in buyables. Part of the Procrustes suite.
Total Targets
160
Stock
ASKCOS Buyables Stock
Acceptable Routes
Available
Show Top-K Metrics:
Overall Metrics
Model performance comparison for ASKCOS Buyables Stock
ASKCOS
v2.0.0
93.1%
6.3%
15.0%
19.4%
80.0 min
$0.95
AiZynthFinder MCTS
v4.4.0
98.1%
21.3%
38.1%
41.3%
17.8 min
$0.05
AiZynthFinder MCTS (High)
v4.4.0
99.4%
20.6%
35.6%
38.8%
68.8 min
$0.20
AiZynthFinder Retro*
v4.4.0
98.8%
8.1%
20.0%
27.5%
87.2 min
$0.26
AiZynthFinder Retro* (High)
v4.4.0
99.4%
6.9%
20.0%
23.8%
327.6 min
$0.97
DMS Explorer XL
v1.1.3
96.3%
33.8%
55.6%
57.5%
47.6 min
$1.02
Retro*
v1.0.0
98.8%
33.1%
33.1%
33.1%
2.2 min
$0.01
Retro* (High)
v1.0.0
100.0%
33.8%
33.8%
33.8%
3.1 min
$0.01
SynPlanner MCTS Rollout
v1.3.2
62.5%
11.3%
17.5%
18.8%
38.8 min
$0.12
SynPlanner MCTS Val
v1.3.2
58.8%
10.6%
15.6%
20.0%
59.7 min
$0.18
SynPlanner NMCS
v1.3.2
60.0%
11.9%
15.6%
18.1%
161.1 min
$0.48
Syntheseus LocalRetro
v0.7.0
95.6%
8.8%
16.9%
20.6%
42.1 min
$0.13
Solvability
ASKCOS
97.5%
92.5%
87.5%
95.0%
AiZynthFinder MCTS
100.0%
100.0%
92.5%
100.0%
AiZynthFinder MCTS (High)
100.0%
100.0%
97.5%
100.0%
AiZynthFinder Retro*
100.0%
100.0%
95.0%
100.0%
AiZynthFinder Retro* (High)
100.0%
100.0%
97.5%
100.0%
DMS Explorer XL
100.0%
100.0%
92.5%
92.5%
Retro*
97.5%
100.0%
97.5%
100.0%
Retro* (High)
100.0%
100.0%
100.0%
100.0%
SynPlanner MCTS Rollout
65.0%
62.5%
60.0%
62.5%
SynPlanner MCTS Val
75.0%
70.0%
45.0%
45.0%
SynPlanner NMCS
70.0%
65.0%
55.0%
50.0%
Syntheseus LocalRetro
100.0%
97.5%
87.5%
97.5%
Top-1
ASKCOS
12.5%
5.0%
5.0%
2.5%
AiZynthFinder MCTS
45.0%
20.0%
10.0%
10.0%
AiZynthFinder MCTS (High)
45.0%
20.0%
10.0%
7.5%
AiZynthFinder Retro*
20.0%
5.0%
2.5%
5.0%
AiZynthFinder Retro* (High)
12.5%
10.0%
2.5%
2.5%
DMS Explorer XL
50.0%
30.0%
15.0%
40.0%
Retro*
50.0%
37.5%
25.0%
20.0%
Retro* (High)
50.0%
37.5%
27.5%
20.0%
SynPlanner MCTS Rollout
27.5%
7.5%
7.5%
2.5%
SynPlanner MCTS Val
27.5%
10.0%
5.0%
0.0%
SynPlanner NMCS
30.0%
7.5%
7.5%
2.5%
Syntheseus LocalRetro
17.5%
7.5%
7.5%
2.5%
Top-5
ASKCOS
27.5%
15.0%
5.0%
12.5%
AiZynthFinder MCTS
72.5%
40.0%
25.0%
15.0%
AiZynthFinder MCTS (High)
80.0%
27.5%
22.5%
12.5%
AiZynthFinder Retro*
55.0%
7.5%
7.5%
10.0%
AiZynthFinder Retro* (High)
45.0%
17.5%
10.0%
7.5%
DMS Explorer XL
72.5%
52.5%
45.0%
52.5%
Retro*
50.0%
37.5%
25.0%
20.0%
Retro* (High)
50.0%
37.5%
27.5%
20.0%
SynPlanner MCTS Rollout
35.0%
20.0%
10.0%
5.0%
SynPlanner MCTS Val
37.5%
15.0%
7.5%
2.5%
SynPlanner NMCS
32.5%
17.5%
7.5%
5.0%
Syntheseus LocalRetro
40.0%
10.0%
10.0%
7.5%
Top-10
ASKCOS
37.5%
20.0%
5.0%
15.0%
AiZynthFinder MCTS
75.0%
50.0%
25.0%
15.0%
AiZynthFinder MCTS (High)
80.0%
37.5%
25.0%
12.5%
AiZynthFinder Retro*
65.0%
17.5%
12.5%
15.0%
AiZynthFinder Retro* (High)
50.0%
20.0%
12.5%
12.5%
DMS Explorer XL
75.0%
57.5%
45.0%
52.5%
Retro*
50.0%
37.5%
25.0%
20.0%
Retro* (High)
50.0%
37.5%
27.5%
20.0%
SynPlanner MCTS Rollout
35.0%
20.0%
10.0%
10.0%
SynPlanner MCTS Val
42.5%
25.0%
10.0%
2.5%
SynPlanner NMCS
35.0%
22.5%
10.0%
5.0%
Syntheseus LocalRetro
40.0%
22.5%
10.0%
10.0%