Server Access Log Lines (Apache / Nginx / Cloudflare)

192.168.1.10 - - [15/Jan/2026:10:14:32 +0000] "GET /robots.txt HTTP/1.1" 200 412 "-" "Mozilla/5.0 (compatible; GPTBot/1.2; +https://openai.com/gptbot)"
192.168.1.11 - - [15/Jan/2026:10:15:01 +0000] "GET /llms.txt HTTP/1.1" 200 1024 "-" "Mozilla/5.0 (compatible; ClaudeBot/1.0; +https://anthropic.com/claudebot)"
192.168.1.12 - - [15/Jan/2026:10:16:45 +0000] "GET /blog/ai-trends HTTP/1.1" 200 4520 "-" "PerplexityBot/1.0 (+https://perplexity.ai/perplexitybot)"
192.168.1.13 - - [15/Jan/2026:10:17:10 +0000] "GET /docs/api HTTP/1.1" 404 210 "-" "Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com)"
192.168.1.14 - - [15/Jan/2026:10:18:22 +0000] "GET /agentscan/ HTTP/1.1" 200 8920 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36"
192.168.1.15 - - [15/Jan/2026:10:19:00 +0000] "GET /sitemap.xml HTTP/1.1" 200 1540 "-" "Google-Extended/1.0"
192.168.1.10 - - [15/Jan/2026:10:20:15 +0000] "GET /blog/ai-trends HTTP/1.1" 200 4520 "-" "Mozilla/5.0 (compatible; GPTBot/1.2; +https://openai.com/gptbot)"

AI Crawler Log Analyzer Server Access Log Parser