II.
TestSet overview
Reference · livetest-set:mbpp-full
MBPP full problem set overview
Canonical MBPP artifact for basic Python program-synthesis evaluation.
Attributes
displayName
MBPP full problem set
benchmarkId
caseCount
974
releasedAt
2021-08-17
composition
Mostly Basic Python Problems crowd-sourced programming set, with
natural-language task descriptions, reference solutions, and automated
tests for entry-level Python synthesis.
homepageUrl
description
Canonical MBPP artifact for basic Python program-synthesis evaluation.
Outgoing edges
belongs_to_benchmark1
- benchmark:mbpp·BenchmarkMBPP
Incoming edges
None.