Leaderboard | SynthArena by isChemist Group

mkt-cnv-160-single-gt

General

160 targets with convergent ground truth routes of variable length with all leaves in buyables. Part of the Procrustes suite.

Benchmark:

CuratedDeveloper

Total Targets

160

Stock

ASKCOS Buyables Stock

Acceptable Routes

Available

Show Top-K Metrics:

Overall Metrics

Model performance comparison for ASKCOS Buyables Stock

									Actions
ASKCOS	`v2.0.0`	93.1%	0.6%	1.3%	1.3%	-	-
AiZynthFinder MCTS	`v4.4.0`	98.1%	3.1%	8.1%	8.8%	-	-
AiZynthFinder MCTS (High)	`v4.4.0`	99.4%	3.1%	6.9%	7.5%	-	-
AiZynthFinder Retro*	`v4.4.0`	98.8%	1.3%	3.8%	4.4%	-	-
AiZynthFinder Retro* (High)	`v4.4.0`	99.4%	0.0%	3.8%	4.4%	-	-
DMS Explorer XL	`v1.1.3`	96.3%	21.9%	40.6%	44.4%	-	-
Retro*	`v1.0.0`	98.8%	4.4%	4.4%	4.4%	-	-
Retro* (High)	`v1.0.0`	100.0%	4.4%	4.4%	4.4%	-	-
SynPlanner MCTS Rollout	`v1.2.0`	0.0%	0.0%	0.0%	0.0%	-	-
SynPlanner MCTS Val	`v1.2.0`	0.0%	0.0%	0.0%	0.0%	-	-
Syntheseus LocalRetro	`v0.7.0`	95.6%	0.0%	1.3%	1.3%	-	-

Solvability


ASKCOS	97.5%	92.5%	87.5%	95.0%
AiZynthFinder MCTS	100.0%	100.0%	92.5%	100.0%
AiZynthFinder MCTS (High)	100.0%	100.0%	97.5%	100.0%
AiZynthFinder Retro*	100.0%	100.0%	95.0%	100.0%
AiZynthFinder Retro* (High)	100.0%	100.0%	97.5%	100.0%
DMS Explorer XL	100.0%	100.0%	92.5%	92.5%
Retro*	97.5%	100.0%	97.5%	100.0%
Retro* (High)	100.0%	100.0%	100.0%	100.0%
SynPlanner MCTS Rollout	0.0%	0.0%	0.0%	0.0%
SynPlanner MCTS Val	0.0%	0.0%	0.0%	0.0%
Syntheseus LocalRetro	100.0%	97.5%	87.5%	97.5%

Top-1


ASKCOS	2.5%	0.0%	0.0%	0.0%
AiZynthFinder MCTS	7.5%	5.0%	0.0%	0.0%
AiZynthFinder MCTS (High)	7.5%	5.0%	0.0%	0.0%
AiZynthFinder Retro*	5.0%	0.0%	0.0%	0.0%
AiZynthFinder Retro* (High)	0.0%	0.0%	0.0%	0.0%
DMS Explorer XL	22.5%	25.0%	12.5%	27.5%
Retro*	5.0%	10.0%	2.5%	0.0%
Retro* (High)	5.0%	10.0%	2.5%	0.0%
SynPlanner MCTS Rollout	0.0%	0.0%	0.0%	0.0%
SynPlanner MCTS Val	0.0%	0.0%	0.0%	0.0%
Syntheseus LocalRetro	0.0%	0.0%	0.0%	0.0%

Top-5


ASKCOS	5.0%	0.0%	0.0%	0.0%
AiZynthFinder MCTS	15.0%	15.0%	2.5%	0.0%
AiZynthFinder MCTS (High)	17.5%	7.5%	2.5%	0.0%
AiZynthFinder Retro*	10.0%	2.5%	2.5%	0.0%
AiZynthFinder Retro* (High)	10.0%	2.5%	2.5%	0.0%
DMS Explorer XL	47.5%	42.5%	27.5%	45.0%
Retro*	5.0%	10.0%	2.5%	0.0%
Retro* (High)	5.0%	10.0%	2.5%	0.0%
SynPlanner MCTS Rollout	0.0%	0.0%	0.0%	0.0%
SynPlanner MCTS Val	0.0%	0.0%	0.0%	0.0%
Syntheseus LocalRetro	2.5%	2.5%	0.0%	0.0%

Top-10


ASKCOS	5.0%	0.0%	0.0%	0.0%
AiZynthFinder MCTS	15.0%	17.5%	2.5%	0.0%
AiZynthFinder MCTS (High)	17.5%	10.0%	2.5%	0.0%
AiZynthFinder Retro*	12.5%	2.5%	2.5%	0.0%
AiZynthFinder Retro* (High)	12.5%	2.5%	2.5%	0.0%
DMS Explorer XL	55.0%	47.5%	27.5%	47.5%
Retro*	5.0%	10.0%	2.5%	0.0%
Retro* (High)	5.0%	10.0%	2.5%	0.0%
SynPlanner MCTS Rollout	0.0%	0.0%	0.0%	0.0%
SynPlanner MCTS Val	0.0%	0.0%	0.0%	0.0%
Syntheseus LocalRetro	2.5%	2.5%	0.0%	0.0%