The Robot Text as a Service API enables developers to keeps track of rules for web crawlers or SEO tools on different websites. Developers can use GET or POST requests to check resources to see whether they can be crawled using a given user agent. The alpha release of this API is being offered for free.
Fifteen APIs have been added to the ProgrammableWeb directory in categories including Natural Language Processing, Transcription, Bots, and Security. Highlights include an API for adding subtitles to video and an API for web crawler management. Here's a rundown of the latest additions.