Timeline of Multiple

Multiple scores 21.67% on SWE-bench Lite

Multiple scores 23.67% on SWE-bench Lite

Multiple scores 36% on SWE-bench Lite

Multiple scores 41% on SWE-bench Lite

Multiple scores 41.67% on SWE-bench Lite

Multiple scores 47% on SWE-bench Lite

Multiple scores 48.33% on SWE-bench Lite

Multiple scores 49% on SWE-bench Lite

Multiple scores 51.67% on SWE-bench Lite

Multiple scores 60% on SWE-bench Lite

Multiple scores 40.6% on SWE-bench Verified

Multiple scores 41.6% on SWE-bench Verified

Multiple scores 46.6% on SWE-bench Verified

Multiple scores 47.2% on SWE-bench Verified

Multiple scores 48.6% on SWE-bench Verified

Multiple scores 49.2% on SWE-bench Verified

Multiple scores 57.2% on SWE-bench Verified

Multiple scores 58.2% on SWE-bench Verified

Multiple scores 68.2% on SWE-bench Verified

Multiple scores 70% on SWE-bench Verified

Multiple scores 70.2% on SWE-bench Verified

Multiple scores 70.4% on SWE-bench Verified

Multiple scores 71% on SWE-bench Verified

Multiple scores 71.2% on SWE-bench Verified

Multiple scores 73% on SWE-bench Verified

Multiple scores 73.8% on SWE-bench Verified

Multiple scores 74.4% on SWE-bench Verified

Multiple scores 74.6% on SWE-bench Verified

Multiple scores 75.2% on SWE-bench Verified

Multiple scores 75.6% on SWE-bench Verified

Multiple scores 76.4% on SWE-bench Verified

Multiple scores 76.8% on SWE-bench Verified

Multiple scores 44.25% on SWE-bench (full test split)