RAG Evaluation with LlamaIndex and RAGas

Functionality

This script loads a webpage, creates a vector index using LlamaIndex, queries the index, and evaluates the responses using RAGas metrics.

Dependencies

• llama_index
• ragas
• os
• dotenv

Usage

1. Set up environment variables in a .env file.
2. Load a webpage using SimpleWebPageReader.
3. Configure the vector store and LLLM.
4. Create a vector index from the documents.
5. Query the index for information.
6. Define evaluation metrics.
7. Prepare evaluation questions and answers.
8. Evaluate the system's performance.

Enjoy your journey with RAG evaluation!