Web Crawler

Also known as a 'web robot' or 'web spider', it is a program or automated script which browses the World Wide Web in a methodical, automated manner.