Crawl (Crawling)

The process performed by the search engine crawlers where the complete content/code of a website is analyzed. In simplified terms, this happens by the crawler following all internal and external links.