INTERMEDIATE PROJECT

Contract clause extractor with evals

Quick answer

Client brief: Legal wants key clauses pulled from supplier contracts into a table.

Deliverables

  1. 1. An extractor with structured output
  2. 2. A labelled eval set of 50 contracts
  3. 3. An error analysis by clause type

Rubric: it passes when

  • ☐ Precision and recall are reported per clause
  • ☐ Failures are categorised
  • ☐ A pass bar is agreed up front