English Web crawler Cited by user Thiekus on 11 Nov 2020 A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for…