Code Migration Scores

Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset. Contributes to Software Engineering using a provisional calibrated scale.

Code Migration Scores
Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset. Contributes to Software Engineering using a provisional calibrated scale.

How to read this chart

Bars rank models by the source-backed benchmark value used for this chart. Longer bars indicate higher published scores.

Data sources
Data updated Sep 22, 2026
Code Migration vs Effective Cost
X = effective cost (log). Y = Code Migration. Full standalone benchmark: 120 CLI migrations across 30 repositories plus 10 COBOL-to-Java repositories, weighted 75/25. Hidden behavioral test pass rate; not the Vals Index subset.
Controls:
Code Migration1:1Cost

How to read this chart

Each point is a public model. The chart compares Code Migration (%) against Effective Cost (per 1M I/O Tokens), with color showing the model provider.