The robots.txt file is important for controlling search engines and other robots. Since most people do not know how to make one, this robots.txt generator tool will make one for you.
Please select which of the following web crawlers / engines you wish to allow access to your website. If you select the engine, they will crawl and index the website. If you de-select it, they will not crawl nor index the website.