how to know which pages to block with robots.txt code example
Example 1: seo disallow
User-agent: *
Disallow: /
Example 2: robots txt no index entire site
User-agent: *
Disallow: /
User-agent: *
Disallow: /
User-agent: *
Disallow: /