Super Agent Evaluation Runner

🕵️‍♂️ Super Agent: The AI Answer Machine 🚀

Welcome to Super Agent – the AI agent built to be evaluated on GAAI benchmark to complete the AI agents course by Hugging Face!

✨ Features

• 🔍 Web Search: Finds up-to-date info using DuckDuckGo or Tavily.
• 📊 Excel & Data Extraction: Reads and analyzes Excel files.
• 🎧 Audio & YouTube Transcripts: Extracts transcripts from audio files and YouTube videos.
• 🧮 Math Tools: Adds numbers, checks commutativity, and more.
• 🧠 RAG-Ready: Retrieval-Augmented Generation for smarter, more accurate answers.
• 🤖 LLM Integration: Works with Google Gemini, HuggingFace, and OpenAI models.
• 🛡️ Exact Match Mode: Answers are evaluated for exactness.
• 🛠️ Extensible Tooling: Easily add new tools for more superpowers.
• ⏳ Gemini Rate Limiter: Includes a rate limiter implementation for Gemini, perfect for handling free tier API limits.

🧩 Supported Tools

• web_search – Search the web for up-to-date info
• extract_data_from_excel – Download and parse Excel files
• extract_transcript_from_youtube – Get YouTube video transcripts
• extract_transcript_from_audio – Get transcripts from audio files
• add_numbers_in_list – Add up numbers
• check_commutativity – Test if a binary operation is commutative