BigBird-base, fine-tuned · Results from 2023-01
MAUD
152 merger agreements with 92 questions and 47,000+ labels across material deal points.
Reported results
What the benchmark measures
152 merger agreements with 92 questions and 47,000+ labels across material deal points.
The evaluated unit is a model response or component output. Read the source for the exact prompt, tool and harness conditions.
How it is scored
Minority-class AUPR per question.
Scores remain in the original unit. They are not normalised or combined with results from other benchmarks.
Sources
Tests extraction of deal points from merger agreements, making it relevant to M&A diligence.