kennethleungty/Wikipedia-Scraping-with-LLM-Agents
Scraping Wikipedia by combining LangChain's agents and tools with OpenAI's LLMs and function calling
This tool helps researchers, data analysts, or curious individuals quickly gather specific information from Wikipedia. You provide a list of topics, and it intelligently navigates Wikipedia to find and extract relevant details about each one. The output is structured data you can use for further analysis or reporting.
No commits in the last 6 months.
Use this if you need to efficiently collect factual data from Wikipedia without manually sifting through pages or writing complex scraping scripts.
Not ideal if you need to scrape data from websites other than Wikipedia or require very high-volume, real-time data extraction.
Stars
27
Forks
4
Language
Jupyter Notebook
License
MIT
Category
Last pushed
Jan 03, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/kennethleungty/Wikipedia-Scraping-with-LLM-Agents"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
langchain-ai/langchain-aws
Build LangChain Applications on AWS
brainlid/langchain
Elixir implementation of a LangChain style framework that lets Elixir projects integrate with...
langchain-ai/langchain-weaviate
🦜🔗 LangChain interface to Weaviate
langchain-ai/langchain-litellm
🦜🔗 LangChain interface to LiteLLM
langchain-ai/langchain-mongodb
Integrations between MongoDB, Atlas, LangChain, and LangGraph