II.
ScopeBoundary overview
Reference · livescope-boundary:bigcode-evalplus.scope
scope-boundary:bigcode-evalplus.scope overview
Inspect the raw attributes, linked wiki pages, and inbound or outbound graph edges for scope-boundary:bigcode-evalplus.scope.
Attributes
subjectId
inScope
EvalPlus harness — augments HumanEval and MBPP test suites with thousands of additional generated tests to catch overfitting on the original test sets.
outOfScope
Repository-scale tasks, multi-file refactoring, agentic tool-use, and benchmarks beyond HumanEval/MBPP coverage.
outOfScopeReasonIds
Outgoing edges
bounds_subject1
- benchmark:bigcode-evalplus·BenchmarkEvalPlus
has_out_of_scope_reason2
- out-of-scope-reason:future-phase·OutOfScopeReasonFuture Phase
- out-of-scope-reason:implementation-detail·OutOfScopeReasonImplementation Detail
Incoming edges
None.