
Infrastructure
The bug that halved a gateway's throughput without a single error
An engineer wrote a setting that said do not encrypt this connection. The system encrypted it anyway, then sat waiting for a reply that never came. Throughput fell by half, every request still returned success, and no dashboard showed a problem. Pfizer and LiteLLM published the story — and the cause is four lines of code that anyone can read.
September 16, 20266 min read
Read more
Infrastructure
Mask Your Logs, Not Your Prompts
The most common LLM privacy advice — scrub personal data out of the prompt before the model sees it — aims at the wrong risk and quietly makes the model dumber. Here's what the research actually shows, and where the masking really belongs.
August 14, 20267 min read
Read more