⚡ Quick verdict

We may earn a commission if you buy through our links, at no extra cost to you.

Langfuse and LangSmith are the two names that come up in every "which LLM observability tool?" thread — and they're genuinely different products, not two flavors of the same thing. Langfuse is the open-source (MIT), framework-agnostic platform: trace, evaluate, and manage prompts for any runtime, self-hosted or on their cloud. LangSmith is LangChain's managed platform: deepest-in-class tracing and evaluation for LangChain/LangGraph apps, closed source, per-seat pricing. We signed up for both, instrumented the same test app (a small RAG agent) with each, ran evaluations on both, and timed the onboarding. Here's the honest, head-to-head result — no vendor talking points.

Side-by-side spec comparison

CapabilityLangfuseLangSmith
Pricing modelUsage-based tiersPer-seat + per-trace usage
Free tierHobby: 50k units/mo, 2 users, 30-day retentionDeveloper: 5k base traces/mo, 1 seat, 14-day retention
Paid starts at$29/mo (Core)$39/seat/mo (Plus)
Self-hostingYes — MIT license, freeEnterprise only (BYOC), custom quote
Open sourceYes (MIT)No (closed source)
SDKsPython, TypeScript (+ OpenTelemetry)Python, TypeScript
OpenTelemetry supportFirst-class (GenAI semantic conventions)OTel endpoint supported
Framework fitFramework-agnosticNative to LangChain / LangGraph
Tracing depthTrace trees, sessions, user analyticsNested runs, agent trajectory views
Prompt managementVersioned prompts, fetched at runtimePrompt hub with versioning
Evaluation frameworkDatasets, experiments, LLM-as-judge, online evalsDatasets, LLM-as-judge, pairwise experiments
Human review / annotationAnnotation queues (unlimited on Pro)Annotation queues, mature workflow
CI/CD integrationEval gating via APIAutomations, webhooks
AlertingSlack, webhooks, GitHub ActionsRules-based alerts
Data retention30 days → 3 years by tier14 days default; upgrades available
SOC2Yes (Pro and up)Yes
HIPAA / BAABAA available (Pro)Enterprise
SSOTeams add-on / EnterprisePlus / Enterprise

Pricing changes often — check both official pricing pages before budgeting.

Pricing compared

Let's use real starting prices. Langfuse Cloud: Hobby is free (50k units/month, 2 users, 30-day retention); Core is $29/month (100k units included, 90-day retention, unlimited users, overage ~$8/100k units on a graduated scale that drops with volume); Pro is $199/month (3-year retention, SOC2/ISO reports, HIPAA BAA); Enterprise is $2,499/month. Self-hosting the MIT-licensed stack is free. LangSmith: Developer is free (5k base traces/month, 1 seat, 14-day retention); Plus is $39/seat/month (10k base traces included, then per-trace overages at roughly $0.50/1k base traces and ~$4.50/1k extended traces); Enterprise is custom and is the only tier with self-hosting. Note the billing wrinkle: LangSmith distinguishes "base" traces (short, simple) from "extended" traces (multi-turn, tool-heavy — i.e., agents), and extended traces bill roughly 9x the base rate.

Now a usage scenario: a 5-person team logging 100k traces/month, with agents averaging ~10 spans per trace.

The takeaway: Langfuse is cheaper in nearly every scenario, and the gap widens with team size (seats) and agent complexity (extended traces). LangSmith's premium is only justifiable if you're deep enough in LangChain that the native DX pays for itself. And one more time, because both vendors move prices: pricing changes often — check the official sites before you budget.

One more scenario — self-hosted: Langfuse self-hosted costs $0 in license fees, just infrastructure (roughly $200–800/month at serious volume for ClickHouse, Redis, and blob storage, plus the engineering time to operate them). LangSmith has no equivalent — self-hosting requires Enterprise on a custom quote, typically a five-figure annual commitment. The break-even we see in practice: below ~50M units/month, managed wins; above ~100M units/month, self-hosted Langfuse wins on pure cost, but only with real ClickHouse operational muscle. Teams that migrate to self-hosting to save $500/month and then burn two engineer-weeks tuning ClickHouse have not saved anything.

Tracing & observability

This is where both tools shine, in different ways. LangSmith's trace view is built around nested runs: every chain step, tool call, and retriever hit renders as a collapsible tree with inputs, outputs, latency, and token counts per node. For LangGraph agents, the trajectory view — watching the agent bounce between tools and reasoning steps — is the best we've used anywhere. Filtering by project, tagging runs, and comparing a failing run against a passing one all felt fast and well thought through.

LangSmith tracing dashboard showing nested runs of a LangGraph agent with per-step latency and tokens
LangSmith: nested runs make agent trajectories easy to follow step by step.

Langfuse's trace view is built around the same tree concept but adds sessions (grouping traces by user conversation) and user-level analytics — useful when your question is "which users are having bad experiences?" rather than "what did this one call do?" The span-level detail (exact prompt sent, response, token counts, model name, cost) is equivalent. Where Langfuse pulls ahead for non-LangChain teams is instrumentation flexibility: first-class OpenTelemetry GenAI support means spans from your existing OTel pipeline land natively, and the OpenAI drop-in wrapper traced our test app with barely any code changes.

Langfuse tracing dashboard showing a trace tree with session grouping and cost per trace
Langfuse: trace trees plus session grouping and per-trace cost attribution.

Verdict on tracing: LangSmith wins for LangChain/LangGraph agent trajectories; Langfuse wins for framework-agnostic setups and session-level analytics. Both are excellent at the core job — if tracing alone decided it, you'd be happy with either.

One more observability difference worth knowing: alerting. Langfuse ships alerting on any observation or score metric, with separate warning and alert thresholds, no-data handling, and delivery to Slack, webhooks, or GitHub Actions — available on both cloud and self-hosted. LangSmith offers rules-based alerting that covers the basics well. In our testing, Langfuse's alerting felt more flexible for production on-call setups. Neither tool offers hard spending caps, though — both will happily bill you for a runaway agent loop, so configure alerts before you need them.

Evaluations & testing

Here's where the comparison gets interesting, because both tools take evaluation seriously — they just emphasize different parts. LangSmith's eval story is the most mature we've tested: build datasets from production traces (or upload your own), run LLM-as-judge evaluators or code-based checks, compare experiments pairwise with statistical summaries, and route ambiguous traces to human reviewers through a genuinely well-designed annotation queue. If your bottleneck is "we can't tell whether the new prompt is better," LangSmith is a strong, complete answer.

Langfuse covers the same surface — datasets, experiments, LLM-as-judge and code-based evaluators, scores attached to traces, online evaluators running on production traffic, and annotation queues (unlimited on Pro) — and adds things LangSmith doesn't emphasize, like user-session-level analysis of eval results. In our testing, LangSmith's eval UX felt about half a step ahead in polish (the pairwise experiment comparison in particular), while Langfuse's open-source nature meant we could see exactly how scores were computed and extend the pipeline. For teams that want evals gating deployments automatically rather than dashboards to review, it's also worth looking at Braintrust, which is purpose-built for CI/CD-gated evaluation.

Verdict on evals: LangSmith by a nose on maturity and annotation workflow; Langfuse on openness, online evals, and cost. Most teams would be productive with either.

The annotation-queue comparison deserves a closer look, since it's where LangSmith most clearly leads. In LangSmith, routing ambiguous traces to human reviewers — with queues, reviewer assignment, and agreement tracking — felt like a finished product built for teams where domain experts label outputs daily. Langfuse's annotation queues (unlimited on Pro) cover the same workflow and we had no functional complaints, but the reviewer UX is less refined. If your quality process depends on non-engineers doing high-volume labeling, that polish matters; if engineers do occasional spot-checks, it doesn't.

Developer experience

We timed onboarding for both, starting from a fresh account with our small RAG test app. LangSmith, on a LangChain app: set two environment variables, run the app, traces appear — under two minutes, genuinely zero code changes. On a non-LangChain app (raw OpenAI SDK): install the SDK, wrap functions with @traceable, configure the project — about fifteen minutes, still pleasant. The docs are thorough, though the pricing docs took longer to parse than the SDK docs. Langfuse: sign up for Hobby (no card), grab the API keys, use the OpenAI drop-in wrapper or the Python SDK — first trace in the dashboard in under ten minutes. Self-hosting via Docker Compose took about twenty minutes on a fresh VM, most of it waiting for ClickHouse to initialize.

SDK quality is high on both sides (Python and TypeScript first-class), and both have solid docs. The DX difference that actually matters long-term isn't onboarding speed — it's billing transparency. Langfuse's usage dashboard shows units consumed in near-real time; LangSmith's base-vs-extended trace distinction meant we had to read the pricing docs twice to model our own bill. For a developer tool, that friction counts.

On docs and community: both are strong, but the flavor differs. LangSmith's docs assume LangChain knowledge and its community produces abundant walkthroughs; Langfuse's docs are more standalone-friendly, and being open source means obscure questions get answered in GitHub issues with code references. We found answers faster in Langfuse's repo; we found more step-by-step tutorials for LangSmith.

The honest downsides

Neither tool is perfect, and the marketing pages won't tell you this. Langfuse's units-based billing punishes deep instrumentation — the more spans you emit per trace, the faster the meter runs, which creates a perverse incentive to instrument less precisely when you want more visibility. Its self-hosted story is genuinely free, but operating ClickHouse, Redis, and blob storage in production is real operational work, and teams routinely underestimate it. LangSmith's downsides are structural: per-seat pricing means the bill grows with headcount even if usage doesn't, the base-vs-extended trace distinction makes bills hard to predict, and you're betting your observability layer on a closed-source platform whose roadmap you don't control. Neither downside is a dealbreaker — but go in with eyes open.

Verdict on DX: LangSmith wins the first ten minutes if you're on LangChain; Langfuse wins on billing clarity and framework freedom. Docs and SDKs are a draw.

Final verdict: which should you choose?

There is no single winner — there's a right tool per situation. Here's how we'd decide:

If you…ChooseWhy
Build on LangChain / LangGraphLangSmithZero-setup tracing and the deepest agent trajectory views
Need to self-hostLangfuseMIT license, free — LangSmith only self-hosts on Enterprise
Want the lowest billLangfuseUsage-based from $29/mo beats $39/seat + usage in our models
Live outside LangChainLangfuseFramework-agnostic with first-class OpenTelemetry
Need the best annotation workflowLangSmithMost mature human-review queues we tested
Want evals + tracing, open sourceLangfuseComplete surface, and you can read the code

Our personal take after testing both: if we were starting a new agent project today outside the LangChain ecosystem, we'd pick Langfuse — the combination of self-hosting, sane billing, and complete features is hard to argue with. If we were already deep in LangGraph with a team doing heavy prompt evaluation, we'd pay LangSmith's premium without much complaint. The most common mistake we see is choosing on brand familiarity instead of architecture: decide based on where your traces actually come from and what your evaluators need to prove, not on which logo you've seen more often. And if neither fits — per-seat pricing too rich, or you want something lighter — see all LangSmith alternatives or all Langfuse alternatives, or zoom out to our 10 best LLM observability tools guide for the full category.

Try Langfuse →   Try LangSmith →

Looking for more developer tooling? Browse our AI coding tools category.

Frequently asked questions

Which is cheaper, Langfuse or LangSmith?

Langfuse is cheaper in almost every scenario we modeled. Langfuse Cloud starts at $29/month with no seat fees (and self-hosting is free under the MIT license), while LangSmith Plus is $39 per seat per month before any usage charges. For a 5-person team logging 100k traces/month, we estimated roughly $101/month for Langfuse versus ~$240/month for LangSmith — and the gap widens for agent workloads because LangSmith's "extended" traces bill ~9x the base rate. Pricing changes often, so verify on both official pricing pages.

Can Langfuse do everything LangSmith does?

For the core AI engineering workflow — tracing, prompt management, evaluation, and experiments — yes. What Langfuse deliberately does not do is host or run your agents; it works with whatever runtime you choose instead. LangSmith's deepest advantages are its LangChain/LangGraph-native tracing (zero-setup via environment variables) and its mature annotation workflow for human review.

Is LangSmith only for LangChain users?

Not only, but it's at its best there. Outside LangChain you can use the @traceable decorator (Python/TypeScript) or push OpenTelemetry spans to LangSmith's OTel endpoint. The zero-setup path — tracing via environment variables with no code changes — is exclusive to LangChain and LangGraph apps.

Which has better evaluations, Langfuse or LangSmith?

LangSmith's evaluation suite is more mature: datasets, LLM-as-judge evaluators, pairwise experiment comparison, and a well-built annotation queue for human review. Langfuse covers the same surface — datasets, experiments, online evals, scores, annotation queues — and its open-source nature means you can inspect and extend the pipeline, but LangSmith's eval UX still feels a half-step ahead.

Can I switch from LangSmith to Langfuse (or vice versa)?

Yes. Tracing integrations on both sides are thin — an SDK init plus environment variables — so switching vendors is typically hours to a day of work, not a rewrite. Historical trace data doesn't migrate automatically, so export anything you need via API before you switch.

Do Langfuse and LangSmith have free tiers?

Both do. Langfuse's Hobby tier is free with 50,000 units/month, 30-day retention, and 2 users (no credit card required), and the full platform is MIT-licensed for free self-hosting. LangSmith's Developer tier is free with 5,000 base traces/month, 1 seat, and 14-day retention.

AT
About Aitopkit

We test AI tools hands-on before recommending them — free tiers, real tasks, real screenshots. If you buy through our links we may earn a commission at no extra cost to you. Read our disclosure.