SoomaBot
The web crawler run by Sooma.com – Web Services, Lda (Matosinhos, Portugal).
SoomaBot visits public websites under .pt, .it, .es, .fr,
.de and .nl to record how each domain is used: whether there is an active site, a parked
page or a redirect, what technology and hosting it runs on, and the business contact details the site publishes
(company name, VAT number, business email and phone).
Why we collect it
- Market research on web hosting and email security.
- Domain-reputation signals for our email filtering.
- Contacting businesses about our services.
How it behaves
- It reads
robots.txtfirst and follows it for every page it fetches. - Per domain it fetches the homepage and at most two other pages: the legal notice and the contact page.
- No more than 4 requests at a time to any one server.
- It does not run JavaScript, submit forms, log in or follow links beyond those pages.
- It identifies itself with this User-Agent:
Mozilla/5.0 (compatible; SoomaBot/1.0; +https://crawler.sooma.com)
Opting out
Add this to your site's robots.txt and SoomaBot will not fetch your pages:
User-agent: SoomaBot Disallow: /
Or write to crawler@sooma.com with your domain, and we will delete the data we hold about it and leave it out of future crawls.
Your data
- Controller
- Sooma.com – Web Services, Lda, Rua D. João I 99, 4450-164 Matosinhos, Portugal
- Data
- Information published on the website itself: company name, VAT and company register numbers, business email addresses and phone numbers, and technical details of the domain (DNS, hosting, software).
- Legal basis
- Legitimate interest, Article 6(1)(f) GDPR.
- Retention
- Up to 24 months after the last crawl, or until you ask us to delete it.
- Your rights
- Access, correction, deletion and objection: write to crawler@sooma.com. You can also complain to the Portuguese data protection authority, the CNPD (cnpd.pt).
Crawler address
SoomaBot only connects from 2.29.146.71 (reverse DNS crawler.sooma.com), over IPv4.