About

Testomatobot is the web crawler used by Testomato to access checked websites, submit HTML forms, and download web pages and other resources according to each project's configuration.

Testomatobot identifies itself with the following User-Agent string. The platform and minicrawler version vary between checks, so match on Testomatobot rather than on the whole string:

Testomatobot/1.0 (Linux x86_64; +https://testomato.com/bot) minicrawler/<version>

IP addresses

Testomatobot runs from a fixed set of addresses, listed with their locations on testomato.com/bot and as plain text, one address per line, at ipv4.txt and ipv4-ipv6.txt.

Tip

If a firewall, a WAF or a rate limiter is blocking the bot, see Firewall and allowlisting for rules you can copy.

Open source

Testomatobot uses Minicrawler to perform HTTP requests and retrieve responses, including headers. Minicrawler was developed to have the smallest possible memory and processor footprint, built specifically for Testomato's needs. It is open-sourced under the AGPL License.

We welcome any suggestions or contributions. Feel free to try it out and let us know what you think.

Tip

If you would like Testomatobot to stop accessing your server, please contact us at info@testomato.com.