Species Profile
π€ AI Crawler
An identifiable automated crawler associated with AI search, retrieval, or assistant features.
884
Observations
3
Countries observed
First seen
2026-09-21T01:49:16+00:00Last seen
2026-11-17T15:36:45+00:00Advertisement experiment slot
Frequently visited paths
| Path | Observations |
|---|---|
| /robots.txt | 469 |
| /sitemap.xml | 48 |
| / | 23 |
| /zh/reports/ | 8 |
| /ko/reports/ | 8 |
| /ja/reports/ | 8 |
| /en/reports/ | 8 |
| /style.css | 4 |
| /ja/ | 3 |
| /favicon.ico | 3 |
| /en/observations/ | 3 |
| /zh/species/wp-scanner | 2 |
Recent sightings
| Time | Country | Path | Status |
|---|---|---|---|
| 2026-11-17T15:36:45+00:00 | US | /favicon.ico/ | 404 |
| 2026-11-17T15:36:45+00:00 | US | /robots.txt | 200 |
| 2026-11-17T15:36:44+00:00 | US | /favicon.ico | 307 |
| 2026-11-17T15:35:47+00:00 | US | /sitemap.xml | 200 |
| 2026-11-17T15:35:05+00:00 | US | /en/species/wp-scanner | 200 |
| 2026-11-17T15:35:04+00:00 | US | /en/contact | 200 |
| 2026-11-17T15:35:04+00:00 | US | /ko/species/wp-probe | 200 |
| 2026-11-17T15:35:03+00:00 | US | /ko/species/generic-crawler | 200 |
| 2026-11-17T15:35:03+00:00 | US | /zh/species/generic-crawler | 200 |
| 2026-11-17T15:35:02+00:00 | US | /ko/privacy | 200 |
Related species
π Search Crawler
A crawler that visits sites for search indexing and content discovery.
π¦ Social Preview Crawler
A crawler that fetches page metadata to generate social or messaging link previews.
πΈοΈ Metadata Crawler
An automated crawler that checks standard public metadata paths such as security.txt and ads.txt.
Automated classification is based on User-Agent and request paths and does not establish malicious intent by any person or organization.