AI-Scraper
AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot
- 10
- Python
- 13 mo ago
AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot
List of libraries, tools and APIs for web scraping and data processing.
Google popular times API alternative: place opening hours, ratings and review counts from Google Maps via ScrapingBee.
Web scraping API examples in Python, Node, Go, Java, PHP, Ruby, cURL and CLI. Proxies, JS rendering, AI extraction, 9 scrapers.
Google AI Mode scraper API in Python and Node using ScrapingBee. Pull the AI-generated answer, citations, and sources as JSON.
Yandex reverse image search API in Python and Node: source pages, similar images, products and OCR via ScrapingBee.
Expedia scraper API returning 100 hotels per call with nightly rate, stay total, guest score and room offers, verified live via ScrapingBee.
Idealista API scraper for Spanish listings with price, m², rooms, energy rating and district, field by field, via ScrapingBee.
Taobao scraper API for public keyword pages with CNY and local prices, Chinese script handling and translation-ready JSONL via ScrapingBee.
Grocery API comparing Tesco, ALDI UK and Walmart prices per litre, kg and item in one normalised schema and price matrix via ScrapingBee.
Yad2 API scraper turning Hebrew real estate listings into an English schema with ILS prices, rooms, size and RTL-clean text via ScrapingBee.
Shopee scraper and API: structured product, price, rating and variant data from Shopee Indonesia via ScrapingBee.
Transfermarkt scraper and API: player market values, clubs, contracts and profile facts as JSON via ScrapingBee.
WSJ API and scraper: Market Data Center index levels, changes and headlines as JSON via ScrapingBee.
DuckDuckGo API and search scraper: ten organic results per query for 1 credit, no JavaScript, via ScrapingBee.
TradingView API scraper: live quote, ISIN, CUSIP, FIGI and exchange from symbol pages for 1 credit via ScrapingBee.
Expired domain scraper: all 14 listing columns from expireddomains.net decoded and parsed for 1 credit via ScrapingBee.
OLX scraper and API: 52 listings per credit with titles, prices and promoted flags from OLX search pages via ScrapingBee.
YouTube Shorts API scraper in Python and Node: find Shorts by duration, pull views, likes and comments via ScrapingBee.
GasBuddy API scraper: station identity, address and reviews for 1 credit, live fuel prices via ScrapingBee.
Patreon scraper API in Python and Node: pull public creator pages, entry tiers and about text via ScrapingBee.
Snapchat scraper API in Python and Node: public profile data, follower counts and Spotlight videos via ScrapingBee.
Meesho scraper API in Python and Node: catalog, price and supplier data from Meesho product pages via ScrapingBee.
No code Amazon scraper: pull products, prices and featured or sponsored placements with Make, Airtable and ScrapingBee.