Do excluded URLs, not in sitemap, detract from crawl budget?

bernard

BuSo Pro
Joined
Dec 31, 2016
Messages
2,529
Likes
2,223
Degree
6
I'm using a javascript based cloaking/tracking service, that generates a link with the typical /subfolder/product structure.

The problem is that Google has seemingly crawled, and excluded, 13.000 such links on my site.

These links are nofollow, noindexed inside the redirect, but not the actual links (feed generated).

These links are not in the sitemap.

I'm wondering because Google seems to not be in a hurry to index my newer posts.
 
You definitely want your set up to be like that, where those fake pages (redirects) aren't indexed. Make sure you do NOT nofollow them or you'll end up with blank pages indexed.

You don't need to worry about crawl budget, honestly, until you have a million pages, I think John Mueller says.

I'm not positive, but if I had to make a guess I'd think that once they crawled the redirect, even without knowing it was a redirect, and seeing that it ultimately is, that "splits" into another branch for the spiders and has an impact on the destination site's budget and not your own.
 
Back