Tagged “models”

4 posts · View all tags
Jev: a decision model you put in front of your LLMs to route traffic
Models

Jev: a decision model you put in front of your LLMs to route traffic

Jev is TypeSafe's first model — it doesn't chat, it decides. Give it a request and it returns one structured label in about 127 ms. LiteLLM wired it into its Auto Router as the classifier and clocked it 5.43x faster and 96% cheaper than a Haiku doing the same job. Here is what Jev is, how routing works, where the LLM classifier actually falls down, and where this fits in front of your models on WEC.

September 23, 20266 min read
Read more
Muse Glimmer: a 30B agentic model that runs on one GPU, no data center required
Models

Muse Glimmer: a 30B agentic model that runs on one GPU, no data center required

Meta released a 30B multimodal model built for local agent workloads — beats Gemma4 and holds its own against Qwen3.6 on agentic benchmarks, and fits on a single consumer GPU. Here's what's actually new, and what it'd take for it to land on WEC.

August 10, 20264 min read
Read more
GPT-5.6: OpenAI's new pitch is cheaper per task, not just smarter — verify it on your workload before you switch
Models

GPT-5.6: OpenAI's new pitch is cheaper per task, not just smarter — verify it on your workload before you switch

GPT-5.6 (Luna, Terra, Sol) ships with a claim aimed straight at your bill: frontier coding scores on half the output tokens. What that means for agent economics, why you should verify it on your own workload — and how to build so model choice stays a config change.

July 13, 202610 min read
Read more
GLM-5.2: the only open-weight model in the top 10 — and you can run it on WEC
Models

GLM-5.2: the only open-weight model in the top 10 — and you can run it on WEC

GLM-5.2 is the lone open-weight, MIT-licensed model holding its own against the proprietary frontier — a 1M-token context and top open-source coding scores. And it's available on WiLine Edge Cloud.

June 24, 20263 min read
Read more