
AdvancedPart 6
Regression-test your RAG service with DeepEval — and settle a model debate with data
Wrap the RAG assistant from part 5 in a containerized DeepEval suite judged by gemma4 on the WEC Inference API — no OpenAI key anywhere. Then use it to answer a real question: should we swap our generation model? Same quality, 5.5× the tokens: the eval says no. Every command, number, and error is real.
AIinferenceevalsdocker
July 20, 202619 min read
Read more
AdvancedPart 5
The capstone: build, evaluate, and observe a RAG docs assistant on the WEC API
Build a production-shaped RAG service in Docker: scrape a real docs site, embed locally, generate on the WEC Inference API — then catch a real hallucination, root-cause it to your own scraper, fix it, and pin it with a regression test. Every command, number, and error is real.
AIinferenceevalsdocker
July 13, 202626 min read
Read more