Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Free Robots.txt Generator tool!
A robots.txt file is essential to tell search engine spiders what to index on your site and when. Generate a free robots.txt file here and upload it to the root of your website directory