Skills tracked
0
across 25 benchmarks
Single coverage
0
one benchmark only
Double coverage
0
two benchmarks
Well covered
0
three or more
With headroom
0
a best score is known
1 source 2 sources 3 or more 88.6%best known score

Each block is one benchmark that names the skill. This counts sources, not tasks: a skill named by three benchmarks may still be thinly tested if each contributes a handful of examples.

What I haven't been able to find

This is a survey of the identified benchmarks. I haven't been able to find any that test the following. Where something is partly covered, I've named what covers it.

A skill covered by one benchmark is a single point of failure in an evaluation plan: you cannot tell a real capability gap from an artefact of that benchmark's construction. Counts are of benchmarks that list the skill, not of tasks, so a skill covered three times may still be thinly tested. Data as at September 2026.