SWE-bench (Lite, Verified, Multimodal, Multilingual) all in one place!
SWE-bench
community
AI & ML interests
None defined yet.
Papers
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
Organization Card
SWE-bench
We are a team of researchers across Stanford University and Princeton University working on LMs and AI systems for software engineering.
In this organization, you will find the assets for several projects in the SWE-* research ecosystem, notably:
datasets 17
SWE-bench/SWE-prime
Viewer • Updated • 1.36k • 77
SWE-bench/SWE-smith-cpp
Viewer • Updated • 5.12k • 285
SWE-bench/SWE-smith-ts
Viewer • Updated • 5.03k • 249
SWE-bench/SWE-bench_Verified
Benchmark • Updated • 500 • 73.2k • 109
SWE-bench/SWE-smith-java
Viewer • Updated • 7.47k • 397
SWE-bench/SWE-smith-rs
Viewer • Updated • 5.31k • 251 • 2
SWE-bench/SWE-smith-js
Viewer • Updated • 6.07k • 364
SWE-bench/SWE-smith-py
Viewer • Updated • 50.9k • 1.67k • 5
SWE-bench/SWE-smith-go
Viewer • Updated • 8.21k • 639
SWE-bench/SWE-smith-php
Viewer • Updated • 1 • 88