robot.txt disallow specific path and below code example Example: robots.txt disallow User-agent: * Disallow: /