The word “spider,” often associated with the spider, is used to refer to the computer program of a search engine responsible for crawling and indexing web pages. For more information, please see: .