dizzysoft

web development for search engine optimization

dizzysoft Bot

Here’s what you need to know about the dizzysoft web crawler.

This bot is manually run to check websites, one page at a time. Its purpose is to determine whether or not a site is allowing access to this particular bot. It’s a diagnostic tool and does not view content on a page beyond the robots meta tag.

It respects all robots directives. If you want or need to exclude this from your site, please add the following to your robots.txt file:

User-Agent: dizzysoft
Disallow: /

If you encounter any problems with this bot, please contact me asap.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Examples

Recent Comments

Topics