1. What is GenieBot?

GenieBot is a Web crawler used by GenieKnows to download Web pages from the Internet.

2. What is a Web crawler?

A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner. It does so by following hyperlinks (URLs) one the Web pages downloaded. For more information see Wikipedia's Web crawler article.

3. Why does GenieKnows use a Web crawler?

The crawled pages are used in the "Related Websites" feature of GenieKnows Local, and to provide Web search results in GenieKnows Games and GenieKnows Health.

4. How frequently will GenieBot download pages from my site?

The crawling frequency varies depending on the size of the site and other factors. It ranges from 1 second to several hours or days.

5. Does GenieBot observe the Robot Exclusion Standard?

Yes, GenieBot follows the Robots Exclusion Standard. For more information, see The Web Robots Pages.

6. How can I prevent GenieBot from crawling all or part of my site/URL?

You can use the robots.txt file to limit or prevent GenieBot's crawling of your site. The robot name of our crawler is genieBot. For more information, see The Web Robots Pages

7. How can I register my site to be crawled by GenieBot?

You may submit your Web site using the feedback form. Please submit on the home page of your site.

8. Does GenieBot support sitemaps?

The current GenieBot does not support sitemaps. We are working on incorporating this feature in our crawler.

9. Why my page does not appear on your site even though GenieBot has accessed it?

A lot of processing happens in the background after a page is downloaded before it can become available on our site. Therefore, there is a delay between the time we access your site and the time your site shows up in search results on GenieKnows. Additionally, we apply many filters to downloaded Web sites to identify spam, inappropriate, or irrelevant content.

10. How can I get additional information?

Our contact information is listed on the contact us page.