Langfuse

About

Langfuse is an open-source LLM engineering platform that provides tools for the full development workflow, including tracing, evaluations, prompt management, and metrics to debug and improve LLM applications. It works with any LLM app and model, offering SDKs for Python & JS/TS and native integrations for popular libraries. Langfuse is committed to open source and can be run locally or self-hosted. Langfuse Cloud is SOC 2 Type II and ISO 27001 certified and GDPR compliant.

Features & Capabilities

• —Detailed production traces for faster debugging of LLM applications.
• —Version control and collaborative deployment of prompts with low-latency retrieval.
• —In-UI testing of different prompts and models.
• —Collection of user feedback, annotation, and execution of evaluation functions.
• —Derivation of datasets from production data for model fine-tuning and application testing.
• —Tracking of cost, latency, and quality metrics.

Industry Focus