ClueWeb-Crawler/1.0

ClueWeb-Crawler/1.0 (+https://boston.lti.cs.cmu.edu/CMU-ClueWeb-Crawler/; mailto:cmu-clueweb-crawler@andrew.cmu.edu)


07:22 o'clock	ClueWeb-Crawler/1.0 (+https://boston.lti.cs.cmu.edu/CMU-ClueWeb-Crawler/; mailto:cmu-clueweb-crawler@andrew.cmu.edu) \| Robot http://www.aibobar.de/information.html \| 12248 \| 975 ms http://www.aibobar.de/robots.txt \| 26 \| 5 ms
Yesterday 23:55 o'clock	ClueWeb-Crawler/1.0 (+https://boston.lti.cs.cmu.edu/CMU-ClueWeb-Crawler/; mailto:cmu-clueweb-crawler@andrew.cmu.edu) \| Robot http://www.aibobar.de/franzi.html \| 9726 \| 20 ms http://www.aibobar.de/robots.txt \| 26 \| 7 ms
Yesterday 11:59 o'clock	ClueWeb-Crawler/1.0 (+https://boston.lti.cs.cmu.edu/CMU-ClueWeb-Crawler/; mailto:cmu-clueweb-crawler@andrew.cmu.edu) \| Robot http://www.aibobar.de/franzi/137.html \| 8773 \| 22 ms http://www.aibobar.de/robots.txt \| 26 \| 7 ms http://www.aibobar.de/ \| 26515 \| 49 ms http://www.aibobar.de/robots.txt \| 26 \| 5 ms
21.10.2026 11:57 o'clock	ClueWeb-Crawler/1.0 (+https://boston.lti.cs.cmu.edu/CMU-ClueWeb-Crawler/; mailto:cmu-clueweb-crawler@andrew.cmu.edu) \| Robot http://www.aibobar.de/yaba/23.html \| 9033 \| 279 ms http://www.aibobar.de/ \| 26515 \| 49 ms http://www.aibobar.de/robots.txt \| 26 \| 7 ms