II.
TestSet overview
Reference · livetest-set:truthful-qa-mc
TruthfulQA — multiple-choice overview
The MC split is the standard reported number for vendor leaderboards on TruthfulQA.
Attributes
displayName
TruthfulQA — multiple-choice
benchmarkId
caseCount
817
releasedAt
2021-09-08
composition
The 817-question multiple-choice split of TruthfulQA, covering
38 categories of common human misconceptions. Used in MC1 (single
correct answer) and MC2 (normalized probability mass over all
correct answers) scoring modes.
homepageUrl
description
The MC split is the standard reported number for vendor
leaderboards on TruthfulQA.
Outgoing edges
None.
Incoming edges
uses_test_set1