This tutorial will cover how to create a robots.txt file for your wordpress blog, website, drupal site, or static HTML site. What is a robots.txt file? A robots.txt file is a text file you can plac…