Scrapinghub provides users with a variety of web crawling and data processing services. Its APIs allow users to schedule scraping jobs, retrieve scraped items, retrieve the log for a job, retrieve information about spiders, and retrieve autoscraping project specifications in slybot format. The APIs also allow users to upload python eggs and to upload reports that are attached to a scraping job. The Scrapinghub APIs operate via REST calls in JSON or JSONP.
Scrapinghub has taken the next step in its web scraping and data extraction tools development. Its latest Developer Data Extraction API is an AI-driven data extraction API that eliminates the need to build custom spiders for each target site. The API extracts product data and article data.
As another week comes to a close, we take a look back at some of the APIs that caught our attention. This week there were 37 APIs added to our directory this week and our team picked the ones that stood out.