.Google.com's Gary Illyes discloses Googlebot picks up web links instead of "complying with" them, opposing main information.Googlebot accumulates links as opposed to following all of them in real-time.Gary Illyes discussed this relevant information in Google's 'Search Off The Record' podcast.Google's documentation opposes the actual crawler behavior.