Helicone
Helicone is a powerful observability platform that provides valuable insights into your LLM usage. Check out Helicone - Pricing for more information about their product and pricing.
To enable Helicone observability in RAGChat, you simply need to pass your Helicone API key when initializing your model. Here’s how to do it for both custom models and OpenAI:
Install RAG Chat SDK
Initialize the project and install the required packages:
Setup Upstash Redis
Create a Redis database using Upstash Console or Upstash CLI and copy the UPSTASH_REDIS_REST_URL
and UPSTASH_REDIS_REST_TOKEN
into your .env
file.
Setup Upstash Vector
Create a Vector index using Upstash Console or Upstash CLI and copy the UPSTASH_VECTOR_REST_URL
and UPSTASH_VECTOR_REST_TOKEN
into your .env
file.
Setup QStash LLM
Navigate to QStash Console and copy the QSTASH_TOKEN
into your .env
file.
Setup Helicone
Create a Helicone account and get an API key from Helicone -> Settings -> API Keys. Set your Helicone API key as an environment variable:
Setup the Project
Initialize RAGChat with Helicone analytics:
Add context to the RAG Chat:
Chat with the RAG Chat:
Run
Run the project:
Go to the Helicone Dashboard to view your analytics.
Was this page helpful?