Tagged “langfuse”

7 posts · View all tags
One login for everything: putting authentik in front of a self-hosted app
IntermediatePart 3

One login for everything: putting authentik in front of a self-hosted app

Part 2 fixed how containers run. This fixes who gets to log in. Deploy authentik as your own identity provider, connect Langfuse to it over OIDC, and understand the pieces — provider, application, redirect URI, scopes — instead of copying a config. Includes the two failures a real run produced: a compose file that silently swallows your settings, and OAuthAccountNotLinked.

self-hostingsecuritylangfusehardening
September 2, 202618 min read
Read more
Checkpoint a LangGraph agent on a WEC Instance so crashes cost you nothing
IntermediatePart 1

Checkpoint a LangGraph agent on a WEC Instance so crashes cost you nothing

Persist agent state to Postgres on a WEC Instance, call a model on the WEC Inference API, then kill the process mid-run twice and resume both times from exactly where it stopped — plus the human-approval pause, and the interrupt that silently fires your side effects twice.

AIAgentsself-hostinglanggraph
August 26, 202621 min read
Read more
Hand work between LangGraph agents without corrupting shared state
IntermediatePart 2

Hand work between LangGraph agents without corrupting shared state

A supervisor routes work to specialists, an agent hands off mid-task, and two agents write the same state key in the same step. One of those raises an error rather than picking a winner — and the routing decision costs 412 output tokens to say one word.

AIAgentsself-hostinglanggraph
August 26, 202618 min read
Read more
Clean traces, untouched answers: masking PII in LiteLLM's logs without corrupting the response
AdvancedPart 4

Clean traces, untouched answers: masking PII in LiteLLM's logs without corrupting the response

Send a gateway's traffic to Langfuse and the model's own reply carries the PII straight back into your traces. Widen Presidio's scope and it masks the answer your users receive instead. Neither setting gives you both, so here is a forty-line callback that does — measured, and with the mistake that quietly makes it slower.

privacypiiguardrailsgateway
August 21, 202615 min read
Read more
Component-level tracing: debugging agent tool calls
IntermediatePart 7

Component-level tracing: debugging agent tool calls

Your agent's thinking and its actions are two different layers. Build a tool-calling agent on WEC Inference, trace it with Langfuse, then debug two real failures from the trace — including the confident, wrong answer that never throws a stack trace.

AIAgentsinferenceevals
July 22, 202613 min read
Read more
The capstone: build, evaluate, and observe a RAG docs assistant on the WEC API
AdvancedPart 5

The capstone: build, evaluate, and observe a RAG docs assistant on the WEC API

Build a production-shaped RAG service in Docker: scrape a real docs site, embed locally, generate on the WEC Inference API — then catch a real hallucination, root-cause it to your own scraper, fix it, and pin it with a regression test. Every command, number, and error is real.

AIinferenceevalsdocker
July 13, 202626 min read
Read more
Catch what your tests miss: observe and score your WEC app in production with Langfuse
AdvancedPart 4

Catch what your tests miss: observe and score your WEC app in production with Langfuse

CI evals pass on a fixed test set — but production sends inputs you never tested. Self-host Langfuse on a WEC Instance, trace every real call, auto-score live traffic with an LLM judge, drill into the exact step that broke, and feed failures back to make your evals stronger. Every command — and every dead end — is real.

AIself-hostinginferenceevals
July 7, 202618 min read
Read more