Mediatoolkitbot
Determ's media-monitoring crawler, formerly Mediatoolkit. It checks pages for phrases customers track; on our site it polled the same pages every half hour.
| Operator | Determ (Mediatoolkit) |
|---|---|
| Type | Monitoring: monitoring |
| robots.txt token | Mediatoolkitbot |
| Follows robots.txt | Yes, by the operator's account; Crawl-delay honoured |
| Sends visitors | No |
| Links to your pages | Not applicable |
| Can end up in AI training | Not documented |
| Verification |
None published
Our tracker does not verify it yet. |
| Our call |
Publisher: Allow, slowed down E-commerce: Allow, slowed down Expert site: Allow, slowed down What the profiles mean |
How to recognize it
User agent, as it reaches our logs:
Mediatoolkitbot ([email protected])
No browser prefix and no version, just the name and a complaints address under the old brand. Determ’s page documents the token, not a full string. Match on Mediatoolkitbot.
- robots.txt token:
Mediatoolkitbot - IP list: none published.
- Reverse DNS: none published.
What it does
Determ, which used to be called Mediatoolkit, monitors the web for its customers. Its crawler reads public pages and matches their text against the phrases and brands that customers track, then alerts them. Determ says it obeys robots.txt and a Crawl-delay set under its own user agent, and warns that a robots.txt with errors may not be recognised.
What you gain by allowing it
- Mentions on your site reach the companies and agencies that monitor them, such as a brand you wrote about.
What you lose
By allowing it
- Repeated polling of the same pages, which on our site added up to more requests than any search crawler.
By blocking it
- Your mentions drop out of Determ’s alerts. That rarely matters to the site itself; it matters to whoever is mentioned.
How to verify it
Determ publishes no IP list or reverse DNS pattern. Cloudflare flags it as a verified bot in the category “Aggregator”, and in our data it flagged every request.
Gotchas and history
- Polling, not crawling: it returns to the same few pages over and over rather than discovering new ones. A
Crawl-delayunderMediatoolkitbotis the documented way to slow it down. - Old brand: the user agent still carries the old brand’s address,
mediatoolkit.com; the documentation lives at determ.com.
What we observed
Data: Cloudflare Logpush for two of our sites, 19-26 October 2026 (8 days).
- 3,450 requests, all to the WordPress site, all from one address, all flagged by Cloudflare.
- They covered just 13 paths, about 330 requests each: the topic pages, “about” and “contact”. That is one visit per page roughly every 35 minutes, day and night.
- 167 got a 404 from the origin server, and none asked for
/robots.txtin the 8 days. The scanner did not use this name.
About Determ (Mediatoolkit)
Determ, formerly Mediatoolkit, runs one crawler, Mediatoolkitbot, for media monitoring. It obeys robots.txt and Crawl-delay under its own group. Complaints go to [email protected].