II.
Benchmark overview
Reference · livebenchmark:repobench
RepoBench overview
RepoBench evaluates repository-level code auto-completion across Python and Java. Sub-tasks measure retrieval, prediction, and end-to-end completion in real-world multi-file repositories.
Attributes
displayName
RepoBench
homepageUrl
kind
code-completion
targetsKind
ModelVersion
description
RepoBench evaluates repository-level code auto-completion across
Python and Java. Sub-tasks measure retrieval, prediction, and
end-to-end completion in real-world multi-file repositories.
Outgoing edges
applies_to1
- domain:software-engineering·DomainSoftware Engineering
Incoming edges
bounds_subject1
- scope-boundary:repobench.scope·ScopeBoundary