OpenAI enhances GPT-6 support for COBOL
The story so far
OpenAI has improved GPT-6's support for legacy programming languages such as COBOL, significantly enhancing their performance. GPT-6 Astra achieved an average pass rate of 87.4% in MultiLangBench tests, a 49.4% improvement over GPT-5.6 Terra. GPT-6.1 Sol achieved an accuracy rate of 86.6% under low reasoning power and 97.9% under high reasoning power in the COBOL to C++ translation test. These languages face challenges due to far fewer training codes than Python, but OpenAI claims they support global critical infrastructure. IBM estimates that COBOL supports 40% of online banking systems and 95% of ATM transactions. OpenAI has established MultiLangBench tests to measure progress, which require models to build SQLite-compatible database engines from scratch. OpenAI GPT-6.1 Sol achieved an accuracy rate of 87% under low reasoning effort and 98% under high reasoning effort when migrating COBOL code to modern languages (C++, Java, Kotlin, Python, Rust). Experts believe AI tools have made progress in handling legacy code, but they are still far from safely replacing critical legacy systems.
AI-written from the reports · Updated 23 days ago
Developments
2 developments
- 26 Oct, 21:15 · 1 reportsAI models' ability to migrate aging softwareThe Verge · AI:Can AI help solve the COBOL code crisis?
- 21 Oct, 00:40 · 1 reportsOpenAI improves GPT-6 support for legacy programming languages like COBOLThe Decoder:OpenAI says GPT-6 is much better with legacy programming languages such as COBOL and Fortran
Coverage timeline
Follow the coverage to see every side of the story.
- The Verge · AICan AI help solve the COBOL code crisis?
OpenAI GPT-6.1 Sol achieves 87% accuracy retention under low inference effort and 98% under high inference effort when migrating COBOL code to modern languages (C++, Java, Kotlin, Python, Rust). Anthropic's Claude Code is also used for COBOL code migration, but performance benchmarks are not provided. Experts believe AI tools have made progress in handling legacy code, but they are still far from safely replacing critical legacy systems. OpenAI GPT-6.1 Sol has made significant progress in migrating COBOL code to modern languages.
- The DecoderOpenAI says GPT-6 is much better with legacy programming languages such as COBOL and Fortran
GPT-6 Astra achieved an average pass rate of 87.4% in MultiLangBench tests, an increase of 49.4% over GPT-5.6 Terra; GPT-6.1 Sol achieved an accuracy rate of 86.6% under low reasoning power and 97.9% under high reasoning power in the COBOL to C++ translation test.