II.
Benchmark overview
Reference · livebenchmark:bigcodebench
BigCodeBench overview
Practical and challenging code-generation benchmark from the BigCode project — function-completion across diverse libraries.
Attributes
displayName
BigCodeBench
homepageUrl
kind
code-generation
targetsKind
ModelVersion
description
Practical and challenging code-generation benchmark from the BigCode project — function-completion across diverse libraries.
Outgoing edges
applies_to1
- domain:software-engineering·DomainSoftware Engineering
Incoming edges
belongs_to_benchmark1
- test-set:bigcodebench-full·TestSetBigCodeBench full set
bounds_subject1
- scope-boundary:bigcodebench.scope·ScopeBoundary