.Google's Gary Illyes shows Googlebot accumulates links rather than "following" them, negating main documents.Googlebot collects links instead of observing all of them in real-time.Gary Illyes discussed this info in Google's 'Browse Off The Document' podcast.Google's records opposes the true crawler habits.