Serritor Cloud

Serritor Cloud is a cloud platform for creating and running web crawlers.

Serritor Cloud is a cloud platform for creating and running web crawlers. It is built on top of the open source Serritor web crawler framework. It allows you to extract structured data from websites in an automated way. Crawlers can be configured while browsing the site you wish to crawl. Configure your crawler: Several attributes of the crawler can be configured for your purposes. You can for example configure the starting URLs, the crawl strategy to use for determining the order of requests, the duplicate and offsite request filters, the crawl delay strategy which specifies the amount of time to wait between each request etc. Describe the format of your data: Specify the attributes of the data that you wish to extract and the crawler will save the results accordingly. You will be able to view and download your data in a readable, structured format. Control your crawler: Specify the commands to execute on each page the crawler visits. You can choose from simple user actions like clicking buttons, typing text into fields or from more complex control structures such as selections (e.g. if-else) and iterations (e.g. for loop). Run your crawler: You can follow the crawl progress real time. With the live crawl statistics you can track the status of the current crawl. You also have the ability to see a grouped overview of the latest crawled items. When the crawler is finished, you can view and download all of your items. Schedule your crawler: Sometimes it is required to run a crawler at a specific time in the future. You can create schedules that will automatically run your crawler at the specified time periodically or just once. Free to use for basic needs: Our Standard plan includes everything you need to create a basic crawler.