CompDexBot
CompDexBot reads the public pages of UK prize competition sites so CompDex can list their competitions side by side. Every listing links to the competition on the operator's own site, where people buy their tickets. CompDex doesn't sell tickets or take entries.
Which sites it reads
Only sites whose website terms allow it, or whose operator has told us they're happy for us to. We read each site's terms before it reads a single competition page.
How it behaves
- It names itself on every request:
CompDexBot/1.0 (+https://compdex.co.uk/bot). - It reads robots.txt first and follows it.
- It waits at least 5 seconds between requests to the same site, or longer if your robots.txt sets a
Crawl-delay. - It checks every 3 hours, and hourly in a competition's last 24 hours.
- It reads your list of live competitions, and a competition's own page when needed. Nothing else.
- It never logs in, enters, fills in forms or uses a basket.
- It never collects entrants' or winners' names, and nothing it reads is used to train AI.
- If your site blocks it, it stops. It never tries again in disguise.
To stop it, or correct a listing
Email operators@compdex.co.uk. If you ask us to stop, your listings come down within 24 hours. Corrections are made within two working days.
Or block it in your robots.txt, and it stops at its next check:
User-agent: CompDexBot
Disallow: /