CrossSWE: Benchmark for testing large language models in cross-repository collaborative development
CrossSWE benchmark tests the cross-repository consistency of large language models in cross-repository collaborative software development, including 171 instances, covering 165 repositories, 20 technical fields, and 13 programming languages. The evaluation shows that the strongest GPT-6.1 Sol only achieves 58.48% Pass@1, with cross-repository inconsistency being the main failure mode.

















