RAG concierge
- Problem
- Customer operations was the bottleneck. Every incoming question required manual search across scattered docs, past tickets, and dashboards. Latency high, throughput flat, no path to scale with hiring.
- Build
- RAG concierge end-to-end: document ingestion pipeline, vector retrieval over internal KB, retrieval-grounded LLM responses with inline citations, cost and safety guardrails, and an eval harness tracking answer faithfulness, citation coverage, and drift as content changed.
- Outcome
- 2x operational throughput without headcount. Query latency dropped from minutes of manual search to sub-second retrieval. Still running in production, on-budget, within SLO.