
Models
Jev: a decision model you put in front of your LLMs to route traffic
Jev is TypeSafe's first model — it doesn't chat, it decides. Give it a request and it returns one structured label in about 127 ms. LiteLLM wired it into its Auto Router as the classifier and clocked it 5.43x faster and 96% cheaper than a Haiku doing the same job. Here is what Jev is, how routing works, where the LLM classifier actually falls down, and where this fits in front of your models on WEC.
September 23, 20266 min read
Read more
Infrastructure
A router that can't see the conversation can't classify "yes"
LiteLLM ran 5,600 live classifier calls to answer one question: how much of the conversation does a model router need to see? On the follow-ups that only make sense against history, agreement went from 14% to 78% — and the completion bill more than doubled, because two thirds of them had been going to the cheapest model.
August 25, 20267 min read
Read more