Prove the lift · AI model performance evaluation

gpt-4-turbo vs llama-3.1-70b

+18-point lift for gpt-4-turbo on insurance-extraction-eval

Test summary

This benchmark evaluates gpt-4-turbo against llama-3.1-70b on the insurance-extraction-eval v2 dataset (6 rows), scored by an LLM-as-judge (claude-haiku-4-5). gpt-4-turbo reached a 67% pass rate versus 49% for llama-3.1-70b — a +18-point lift.

Base model
llama-3.1-70b
via ollama · 49% pass rate
Refined model
gpt-4-turbo
via openai · 67% pass rate · 2.5s p95
Base pass rate
49%
Refined pass rate
67%
Refined p95
2.5s
Est. tokens saved
4.3K
+0pts
refined beats base on 6 rows
0%
Base model
0%
Invoked-refined
▲3 improved▼0 regressed●3 unchanged

Per-row results

1Suit-limitation clause: is a late-filed claim contractually barred?0% → 100%+100
2Coinsurance 80% clause recovery on an under-insured building0% → 0%0
3Subrogation waiver interaction with additional-insured status0% → 100%+100
4Pro-rata distribution across layered carriers on a covered loss100% → 100%0
5Business-interruption period-of-restoration calculation0% → 100%+100
6Aggregate deductible across a loss sequence under a per-occurrence + annual cap100% → 100%0
Prove the lift on your own data.

Run any two models over your tasks, judged automatically, and see the improvement — in seconds.

Try Invoked
Generated with Invoked · Browse all benchmarks