II.
ScopeBoundary overview
Reference · livescope-boundary:human-eval.scope
scope-boundary:human-eval.scope overview
Inspect the raw attributes, linked wiki pages, and inbound or outbound graph edges for scope-boundary:human-eval.scope.
Attributes
subjectId
inScope
Self-contained Python function-completion tasks scored by
pass-at-k against unit tests. 164 hand-crafted problems with
docstring + signature input.
outOfScope
Multi-file projects, languages other than Python (use MultiPL-E /
HumanEvalX for cross-language), repository-scale tasks (use SWE-bench),
multi-turn / agentic tasks, and natural-language reasoning benchmarks.
outOfScopeReasonIds
Outgoing edges
bounds_subject1
- benchmark:human-eval·BenchmarkHumanEval
has_out_of_scope_reason2
- out-of-scope-reason:future-phase·OutOfScopeReasonFuture Phase
- out-of-scope-reason:implementation-detail·OutOfScopeReasonImplementation Detail
Incoming edges
None.