Timeline of Upstage

Solar Pro 4 scores 0.51% on Terminal-Bench

Solar Pro 4 scores 44.56% on SciCode

Solar Pro 4 scores 29.24% on Humanity's Last Exam

Solar Pro 4 scores 89.09% on GPQA

Solar Pro 4 scores 28.15 on Artificial Analysis Intelligence Index

solar-pro-2-preview scores 3.66% on Humanity's Last Exam

solar-pro-2-preview scores 54.44% on GPQA

solar-pro-2-preview scores 7.91 on Artificial Analysis Intelligence Index

solar-pro-2 scores 4.55% on Terminal-Bench

solar-pro-2 scores 31.87% on τ²-bench

solar-pro-2 scores 33.74% on IFBench

solar-pro-2 scores 3.71% on Humanity's Last Exam

solar-pro-2 scores 56.06% on GPQA

solar-pro-2 scores 7 on Artificial Analysis Intelligence Index

solar-open-100b-reasoning scores 2.27% on Terminal-Bench

solar-open-100b-reasoning scores 48.25% on τ²-bench

solar-open-100b-reasoning scores 57.69% on IFBench

solar-open-100b-reasoning scores 10.43% on Humanity's Last Exam

solar-open-100b-reasoning scores 65.66% on GPQA

solar-open-100b-reasoning scores 10.36 on Artificial Analysis Intelligence Index

solar-open2-250b scores 44.19% on Terminal-Bench

solar-open2-250b scores 48.03% on SciCode

solar-open2-250b scores 28.54% on Humanity's Last Exam

solar-open2-250b scores 85.66% on GPQA

solar-open2-250b scores 24.74 on Artificial Analysis Intelligence Index

solar-pro-2-preview-reasoning scores 6.07% on Humanity's Last Exam

solar-pro-2-preview-reasoning scores 57.78% on GPQA

solar-pro-2-preview-reasoning scores 9.07 on Artificial Analysis Intelligence Index

Solar Pro 3 scores 7.58% on Terminal-Bench

Solar Pro 3 scores 11.99% on Terminal-Bench

Solar Pro 3 scores 0% on Terminal-Bench

Solar Pro 3 scores 86.26% on τ²-bench

Solar Pro 3 scores 71.2% on IFBench

Solar Pro 3 scores 25.46% on SciCode

Solar Pro 3 scores 10.29% on Humanity's Last Exam

Solar Pro 3 scores 72.42% on GPQA

Solar Pro 3 scores 7.82 on Artificial Analysis Intelligence Index

solar-mini scores 20.18% on τ²-bench

solar-mini scores 6.41 on Artificial Analysis Intelligence Index

solar-pro-2-reasoning scores 3.03% on Terminal-Bench

solar-pro-2-reasoning scores 28.07% on τ²-bench

solar-pro-2-reasoning scores 37.07% on IFBench

solar-pro-2-reasoning scores 7.37% on Humanity's Last Exam

solar-pro-2-reasoning scores 68.69% on GPQA

solar-pro-2-reasoning scores 7.49 on Artificial Analysis Intelligence Index