web crawlers - How to properly (dis)allow the archive.org bot? Did things change, if so when? - Webmasters Stack Exchange
archive.today - Wikipedia
Wayback Machine Error: Page cannot be displayed due to robots.txt. - What it Means
Wayback Machine Error: Page cannot be displayed due to robots.txt. - What it Means
Internet Archive on The Economist Magazine : Free Download, Borrow, and Streaming : Internet Archive
Jeff Atwood on Twitter: "New domain owners using robots.txt to erase history makes me so, so angry. It's not right. https://t.co/aM6LB1QOtD" / Twitter
Using The Wayback Machine – Internet Archive Help Center
How to Find Old Redirect Opportunities & Reclaim Links (with the Wayback Machine)
How to restore websites from the Web Archive - archive.org. Part 2
Did the Wayback machine break? — Parallax Forums
robots.txt was changed to block saving hot questions page in Wayback Machine, why? - Meta Stack Exchange
Top 9 Wayback Machine Alternative Sites (Web Archive Sites)
The Internet Archive: Include Every Site on the Wayback Machine, Regardless of Robots.txt
The Internet Archive will soon stop honoring robots.txt files
Can the Internet Be Archived? | The New Yorker
2018-04-24: Why we need multiple web archives: the case of blog.reidreport.com
How to Use the Internet Archive's Wayback Machine: 9 Steps
What is robots.txt? | How a robots.txt file works | Cloudflare
A Complete Guide to Robots.txt & Why It Matters
Robots.txt: The Tiny Website File That Can Make or Break Your SEO
How to Use the Internet Archive's Wayback Machine: 9 Steps
Internet Archive Wayback Machine: Robots.txt Query Exclusi… | Flickr
How to block Archive.org?
Internet Archive to ignore robots.txt directives | Boing Boing
