Justin du Coeur (jducoeur) wrote,
Justin du Coeur
jducoeur

As if I didn't hate domain thieves enough already...

During today's massive update of the Period Games Homepage, I'm discovering a new horror. Many of the sites I point to are now dead, which isn't a surprise. Many of them have been taken over by domain thieves, which also isn't a surprise.

What *is* a surprise is that many of those thieves have turned on robots.txt files that wind up blocking the Wayback Machine from producing results: it appears that archive.org respects robots.txt a little *too* much. The result is that a large number of useful pages are just plain inaccessible -- I can't even get at their archived versions. Grr...

(BTW, time for another reminder that archive.org is one of the most important and unsung sites on the Web -- the Wayback Machine is the only really good archive of the Web's history, and is often invaluable. I've given them another donation today...)
Subscribe

  • Adtech

    Here's an interesting article about "adtech" -- those automated algorithms that companies like Google and Facebook use to spy on you and serve up…

  • Picking at the ball of twine is always dangerous

    What I set out to do: add "Unsubscribe" links to the bottom of all emails sent from Querki, so we properly comply with CAN-SPAM requirements. What…

  • Voice API and Querki?

    Here's an *immensely* speculative idea, looking for thoughts from the folks who've used Querki (or simply been listening to me burble about it for…

  • Post a new comment

    Error

    Anonymous comments are disabled in this journal

    default userpic

    Your reply will be screened

    Your IP address will be recorded 

  • 4 comments