Langfuse

Langfuse is an open-source LLM engineering platform designed for debugging, analyzing, and iterating on LLM applications. It offers comprehensive tracing, prompt management, and evaluation tools, along with various SDKs and integrations for popular LLM frameworks. The platform supports both cloud-hosted and self-hosted deployments, catering to individual developers and enterprises.

Langfuse is an open-source LLM engineering platform that offers observability, analytics, and experimentation features. It provides API access through various SDKs (Python, JS/TS) and integrations with popular LLM frameworks like OpenAI SDK, Langchain, and LlamaIndex. While it doesn't directly offer conversational AI models, it supports tracing and evaluation for conversational AI applications. The platform includes features for fine-tuning and custom models through its evaluation and dataset management capabilities, allowing users to test and iterate on prompt versions and model configurations. Enterprise solutions are clearly outlined in their pricing, including features like SSO, RBAC, and dedicated support. Langfuse also supports multi-modality and attachments in its tracing features, indicating multimodal AI capabilities. Furthermore, it has a dedicated 'LLM Security' section and offers security and compliance features like SOC2 Type II and ISO27001 reports, aligning with safety and red teaming aspects.