What is an example of the type of contents that could be gathered from a website?

Example: Name the key term of what a "Crawler" is used to do

retrive and "index" webpages from the internet.