support.google.com/maps/thread/...
support.google.com/maps/thread/...
Are there any sys admins or big data people who would like to help? I am a developer, but mostly focus on front-end to "middle". I need an expert partner if this is going to work.
Are there any sys admins or big data people who would like to help? I am a developer, but mostly focus on front-end to "middle". I need an expert partner if this is going to work.
Part of the issue is the Wayback Machine is relatively slow, so this can't be helped, but this method is not scalable.
Part of the issue is the Wayback Machine is relatively slow, so this can't be helped, but this method is not scalable.
1. Scrape and download the content from the Wayback Machine from a "safe" date. I've been using January 29.
2. Store the data. I'm expecting terrabytes of data.
3. Serve the sites from a host that can handle this amount of data and potential traffic.
1. Scrape and download the content from the Wayback Machine from a "safe" date. I've been using January 29.
2. Store the data. I'm expecting terrabytes of data.
3. Serve the sites from a host that can handle this amount of data and potential traffic.