II.
ScopeBoundary overview
Reference · livescope-boundary:mmlu.scope
scope-boundary:mmlu.scope overview
Inspect the raw attributes, linked wiki pages, and inbound or outbound graph edges for scope-boundary:mmlu.scope.
Attributes
subjectId
inScope
Multiple-choice (4-option) academic-knowledge questions across 57
subjects (STEM, humanities, social sciences, professional) — scored
by accuracy on a held-out test set of ~14k questions. English only.
outOfScope
Code-generation tasks, agentic / tool-use evaluations, multilingual
reasoning (use MMMLU/Global-MMLU), free-form generation quality,
and tasks requiring image/video input.
outOfScopeReasonIds
Outgoing edges
bounds_subject1
- benchmark:mmlu·BenchmarkMMLU
has_out_of_scope_reason2
- out-of-scope-reason:future-phase·OutOfScopeReasonFuture Phase
- out-of-scope-reason:implementation-detail·OutOfScopeReasonImplementation Detail
Incoming edges
None.