How do I disallow an entire directory with robots.txt?
You don't need the trailing slash to block those directories. This will work:
Disallow: /first_url/*
Disallow: /second_url/*
This Google help page covers this quite well.
You don't need the trailing slash to block those directories. This will work:
Disallow: /first_url/*
Disallow: /second_url/*
This Google help page covers this quite well.