This script loads a webpage, creates a vector index using LlamaIndex, queries the index, and evaluates the responses using RAGas metrics.
- llama_index
- ragas
- os
- dotenv
- Set up environment variables in a
.env
file. - Load a webpage using
SimpleWebPageReader
. - Configure the vector store and LLLM.
- Create a vector index from the documents.
- Query the index for information.
- Define evaluation metrics.
- Prepare evaluation questions and answers.
- Evaluate the system's performance.
Enjoy your journey with RAG evaluation!