robots.txt

edited May 2011 in Modules
What is the best practice to implement the robots.txt file in Fuel?

Comments

  • edited 7:30PM
    You probably don't want to have it spider anything in the fuel/* directory although, the only links that should be visible from the robot are the links to module asset files.
Sign In or Register to comment.