II.
Benchmark overview
Reference · livebenchmark:swe-bench
SWE-bench overview
Real-world software engineering issues from open-source Python repos.
Attributes
displayName
SWE-bench
homepageUrl
kind
full-stack
targetsKind
AgentVersion
description
Real-world software engineering issues from open-source Python repos.
Outgoing edges
applies_to1
- domain:software-engineering·DomainSoftware Engineering
covers1
- skill-area:bug-fixing-from-issues·SkillAreaBug Fixing from Issue Descriptions
Incoming edges
belongs_to_benchmark1
- test-set:swe-bench-original·TestSetSWE-bench original test set
bounds_subject1
- scope-boundary:swe-bench.scope·ScopeBoundary
refines1
- benchmark:swe-bench-verified·BenchmarkSWE-bench Verified