GAIA Benchmark Agent Evaluation
Implementation Overview:
- Orchestration: ReAct-style agent built with LangGraph (
StateGraph+ToolNode) and Gemini (langchain-google-genai) with built-in rate limiting (15 RPM). - Tools:
web_search&extract_webpage: Web search and full-page text extraction powered by Tavily.python_interpreter: Subprocess Python execution for calculations, logic puzzles,.pyscripts, and.xlsxspreadsheets (pandas/openpyxl).analyze_media: Multimodal inspection of YouTube videos,.mp3audio, and.pngimages via thegoogle-genaiSDK.
Log in with your Hugging Face account below and click Run Evaluation & Submit All Answers to evaluate the agent on the GAIA benchmark subset.
Questions and Agent Answers