🧊 Open source LLM-Observability Platform for Developers. One-line integration for monitoring, metrics, evals, agent tracing, prompt management, playground, etc. Supports OpenAI SDK, Vercel AI SDK, Anthropic SDK, LiteLLM, LLamaIndex, LangChain, and more. 🍓 YC W23

Docs • Discord • Roadmap • Changelog • Bug reports

See Helicone in Action! (Free)

• 🔌 Integrate: One-line of code to log all your requests to OpenAI, Anthropic, LangChain, Gemini, TogetherAI, LlamaIndex, LiteLLM, OpenRouter, and more
• 📊 Observe: Inspect and debug traces & sessions for agents, chatbots, document processing pipelines, and more
• 📈 Analyze: Track metrics like cost, latency, quality, and more. Export to PostHog in one-line for custom dashboards
• 🎮 Playground: Rapidly test and iterate on prompts, sessions and traces in our UI
• 🧠 Prompt Management: Version and experiment with prompts using production data. Your prompts remain under your control, always accessible.
• 🔍 Evaluate: Automatically run evals on traces or sessions using the latest platforms: LastMile or Ragas (more coming soon)
• 🎛️ Fine-tune: Fine-tune with one of our fine-tuning partners: OpenPipe or Autonomi (more coming soon)
• 🛜 Gateway: Caching, custom rate limits, LLM security, and more with our gateway
• 🛡️ Enterprise Ready: SOC 2 and GDPR compliant

🎁 Generous monthly free tier (100k requests/month) - No credit card required!

1. Get your write-only API key by signing up here.

2. Update only the baseURL in your code:

   import OpenAI from "openai";
   
   const openai = new OpenAI({
     apiKey: process.env.OPENAI_API_KEY,
     baseURL: `https://oai.helicone.ai/v1/${process.env.HELICONE_API_KEY}`,
   });

or - use headers for more secure environments

import OpenAI from "openai";

const openai = new OpenAI({
  apiKey: process.env.OPENAI_API_KEY,
  baseURL: `https://oai.helicone.ai/v1`,
  defaultHeaders: {
   "Helicone-Auth": `Bearer ${process.env.HELICONE_API_KEY}`,
  },
});

3. 🎉 You're all set! View your logs at Helicone.

This quick start uses Helicone Cloud with OpenAI. For other providers or self-hosted options, see below.

The fastest and most reliable way to get started with Helicone. Get started for free at Helicone US or Helicone EU. Your first 100k requests are free every month, after which you'll pay based on usage. Try our demo to see Helicone in action!

Integrations: View our supported integrations.

Latency Concerns: Helicone's Cloud offering is deployed on Cloudflare workers and ensures the lowest latency (~10ms) add-on to your API requests. View our latency benchmarks.

Helicone is simple to self-host and update. To get started locally, just use our docker-compose file.

Pre-Request:

• Copy the shared directory to the valhalla directory
• Create a valhalla folder in the valhalla directory and put /valhalla/jawn in it

# Clone the repository
git clone https://github.com/Helicone/helicone.git
cd docker
cp .env.example .env

# Start the services
docker compose up

For Enterprise workloads, we also have a production-ready Helm chart available. To access, contact us at enterprise@helicone.ai.

Manual deployment is not recommended. Please use Docker or Helm. If you must, follow the instructions here.

Helicone is comprised of five services:

• Web: Frontend Platform (NextJS)
• Worker: Proxy Logging (Cloudflare Workers)
• Jawn: Dedicated Server for serving collecting logs (Express + Tsoa)
• Supabase: Application Database and Auth
• ClickHouse: Analytics Database
• Minio: Object Storage for logs.

This list may be out of date. Don't see your provider or framework? Check out the latest integrations in our docs. If not found there, request a new integration by contacting help@helicone.ai.

learnthisrepo.com/helicone |

We ❤️ our contributors! We warmly welcome contributions for documentation, integrations, costs, and feature requests.

• If you have an idea for how Helicone can be better, create a GitHub issue or vote on the roadmap
• Update costs instructions in costs/README.md
• Join discord to ask questions

Helicone is licensed under the Apache v2.0 License.

• Data Management: Manage and export your Helicone data with our API.

  • Guides: ETL, Request Exporting

• Data Ownership: Learn about Data Ownership and Autonomy

For more information, visit our documentation.