DeepSWE: A contamination-free benchmark for long-horizon coding agents

DeepSWE is a new benchmark for evaluating long-horizon coding agents on original engineering tasks designed to prevent data contamination. The benchmark was introduced in May 2026 with a v1.1 update in June 2026 that improved reproducibility and made it harder to game the evaluation system.