Problem: Using Prerender.io to index/store pages of one site, I keep getting path requests that only exist on my old site
Example: on Prerender I'll see that Googlebot requested http://www.new-site.com/old/site/path
I have an old website old-website.com
and a new one (new-site.com
).
Both websites are on separate servers with different IP addresses, (though old-website
used to live on the server that new-site
now lives on. new-site
does not have these old path URL's anywhere in any of the site-maps, additionally these pages return 404's.
I'm not sure where to tell google to stop requesting these pages. For a quick solution I've added these to my robots.txt but that feels like a short term hack. The new site is a single page application, and old site is wordpress.