AI email automation for an insurance underwriting agency
Between 40 and 60% of support effort went to repetitive underwriting email. Manual processing delayed responses, regulation required auditable workflows, and volume kept growing.
An AI powered email automation platform: classification, prioritisation and routing, a risk based decision engine with human review on critical cases, and compliance logging throughout.
- 1Microsoft GraphEmail ingestion
- 2AI processing layerLLMs + RAG on Azure AI Search
- 3Decision engineRisk based, human review on critical cases
- 4Policy validation
- 5Automated response
Intent classification benchmark: 121 identical golden set emails
Mistral Large 3 selected| Mistral Large 3 | GPT-4.1 mini | Grok 4.1 Fast | |
|---|---|---|---|
| Cost per 1,000 emails | $0.73 | $0.54 | $0.26 |
| Classified, not Unknown | 95.0% | 86.8% | 68.3% |
| Average confidence | 0.85 | 0.79 | 0.65 |
| Latency P50 | 0.97 s | 1.33 s | 10.85 s |
| Latency P95 | 1.86 s | 1.96 s | 26.23 s |
| API success · schema valid | 100% · 100% | 100% · 100% | 99.2% · 100% |
Grok 4.1 Fast is cheapest on paper but leaves 32% unclassified and runs roughly ten times slower at P50. This is what cost per successful task means in practice.
Azure, Azure SQL, GitHub Actions, Microsoft Graph API. Mistral Large for understanding and generation, Ministral 3B for intent and risk classification, Azure AI Search for policy retrieval.
4 to 5 people: AI/ML engineer, backend engineer, cloud engineer, QA engineer, project manager. Engagement ongoing.









