Hello,
What is the importance of robot.txt in SEO?