ADVANCED PROJECT
Serve a small model on client infra
Quick answer
Client brief: A regulated client cannot send data to a hosted model and wants an in-house option.
Deliverables
- 1. A containerised model service
- 2. A quality and cost comparison with a hosted model
- 3. A deployment runbook
Rubric: it passes when
- ☐ Quality gap is quantified
- ☐ Cost per request is reported
- ☐ The runbook works on a clean machine