Monthly Archives: May 2009

Retroactive Robots Exclusion

In going through to-do items in my mailbox, I stumbled on this post which I thought I had posted here, but realized I hadn’t. It may be out of date, but it may prove interesting, at least to someone.

I recently [edit: August 2006] discovered exactly how the Wayback Machine deals with changes to robots.txt.

First, some background. I have a weblog I’ve been running since 2002, switching from B2 to WordPress and changing the permalink structure twice (with appropriate HTTP redirects each time) as nicer structures became available. Unfortunately, some spiders kept hitting the old URLs over and over again, despite the fact that they forwarded with a 301 permanent redirect to the new locations. So, foolishly, I added the old links to robots.txt to get the spiders to stop.

Flash forward to earlier this week. I’ve made a post on Slashdot, which reminds me of a review I did of Might and Magic IX nearly four years ago. I head to my blog, pull up the post… and to my horror, discover that it’s missing half a sentence at the beginning of a paragraph and I don’t remember the sense of what I originally wrote!

My backups are too recent (ironic, that), so I hit the Wayback Machine. They only have the post going back to 2004, which is still missing the chunk of text. Then I remember that the link structure was different, so I try hitting the oldest archived copies of the main page, and I’m able to pull up the summary with a link to the original location. I click on it… and I see:

Excluded by robots.txt (or words to that effect).

Now this is a page that was not blocked at the time that ia_archiver spidered it, but that was later blocked. The Wayback machine retroactively blocked access to the page based on the robots.txt content. I searched through the documentation and couldn’t determine whether the data had actually been removed or just blocked, so I decided to alter my site’s robots.txt file, fire off a request for clarification, and see what happened.

As it turns out, several days later, they unblocked the file, and I was able to restore the missing text.

In summary, the Wayback Machine will block end-users from accessing anything that is in your current robots.txt file. If you remove the restriction from your robots.txt, it will re-enable access, but only if it had archived the page in the first place.

(Originally posted as a Slashdot comment.)

Posted in Computers/Internet | Tagged , , | Leave a comment

On Ebay: Angel DVDs, Tori Amos CDs, and a Star Trek T-Shirt

Star Trek T-ShirtI hope you won’t mind me using this blog for a little self-promotion. We’re selling off some duplicate CDs and DVDs, plus a Star Trek T-shirt from the Paramount panel at Comic-Con International 2007.

  • DVDs: Angel Seasons 1-5 (individual season boxed sets)
  • CDs: Tori Amos “A Piano” boxed set (massive 5-disc archive of hits, rarities, alternate mixes, etc.)
  • T-Shirt: Star Trek (XL) from the new J.J. Abrams movie. Handed out at San Diego Comic-Con in 2007, still has the original 12-25-08 release date on the back. It’s never been worn.

Here’s the link to all the auctions. Most of them run through Sunday, May 24.

Posted in Buffy/Angel, Entertainment, Music | Tagged , , , | Leave a comment

Buy a Sports Bar!

Grocery Aisle 10 includes sports bars

Somehow I don’t think that’s the kind of bar they’re talking about…

Posted in Signs of the Times | Tagged | 2 Comments

Spammy to the Max (Plus Jetpack Launch!)

  • 83 copies of the same fake-Facebook spam sent to the same spamtrap address via botnet in one day seems a wee bit excessive. #
  • “rm spam” – if only it were that easy. #
  • Also: Mozilla Launches Jetpack! # (Couldn’t resist the headline.)

Posted in Mozilla, Spam | Tagged , , , | Leave a comment

Crossover Names

Have you ever run into a name that you can’t help associating with a completely different context? Like when people realize that one guy in Office Space is named Michael Bolton? Or when you look at “AD&D,” and instead of “Accidental Death and Dismemberment” your first thought is “Advanced Dungeons and Dragons?”

Yeah. Especially in IKEA.

For example, here we have Harry Potter’s favorite instructor in Defense Against the Dark Arts at Hogwarts, magically transformed into a set of venetian blinds.

Lupin blinds

And here’s the thief who ends up as one of Blake’s 7 on the Liberator…as a set of sheets. (Nine of them, no doubt, to the wind.)

Vila sheets

And it’s not just IKEA. Robin of the Teen Titans has his criminal counterpart in this bottle of wine:

Red X Wine

Or the older daughter of Eddard Stark, playing music instead of the Game of Thrones.

Sansa MP3 Players

So, what good crossover names have you seen?

Posted in Harry Potter, Sci-Fi/Fantasy, Signs of the Times | Tagged , , , | Leave a comment

W|A, Episode I and Hubble Street

  • A bit disturbed that Wolfram|Alpha shares a name with 2 Joss Whedon villains. #
  • *sigh* Looks like I’ll have to wait a little longer for that Android update on my G1 #
  • 10 years ago today I was really, really tired after seeing a 3AM showing of Star Wars Episode I: The Phantom Menace. #
  • Drove past Hubble street while listening to story about Hubble Space Telescope. #
  • I love 419 scam emails that start out by saying that sure, most of the messages like this are fake, but THIS one’s real! #

Posted in Computers/Internet, Spam, Star Wars | Tagged , , , , , , , , , | Leave a comment

Forgotten Election

  • Totally forgot about the special election today. No biggie, the lines will probably be nonexistent even in the evening. #
  • Basically no line, but there were a few people voting. #
  • Polling place volunteers were playing poker to pass the time between voters. #

Posted in Politics | Tagged , | Leave a comment

Brainsaw

Brainsaw

Apparently it’s a marketing company, but the name brings to mind an image of either a surgical tool or a weapon to use against zombies.

Posted in Signs of the Times | Leave a comment

New Spring & Unfollow

  • Robert Jordan’s New Spring #6 comic delayed to next week, but after waiting 3 years, what’s 1 week? Also: Wheel of Time: Eye of the World #0 out this week! #
  • WTF? I can barely keep up with ~45 people on Twitter, never mind 45,000! (via @rzazueta) #

Posted in Comics, Computers/Internet | Tagged , , , , | Leave a comment

Star Trek: Experiencing Seismic Activity

Finally went to see the new Star Trek movie on Friday, and enjoyed it quite a bit. As a long-term fan (if a lapsed one — I only watched the first 3-4 seasons of DS9, and gave up on Voyager and Enterprise after only a few episodes each, and still haven’t seen Nemesis) I liked it a lot.

We went again Sunday afternoon to see it in IMAX, but the 4:00 showing sold out while we were in line. So we bought tickets for 7:10 and bummed around the mall for the next three hours. Not my first choice, but with Terminator: Salvation taking over the IMAX screens in a few days, it was a limited window.

So we were in the movie during the earthquake.

Quake

Not that I noticed. I’d just leaned over to Katie to whisper something about a music cue reminding me of another soundtrack, so I was moving, and didn’t notice that the chair and floor were moving. (Similarly, I managed to miss the Whittier Narrows quake despite the fact that everyone I knew felt it. As near as I could tell, I must have been standing at or walking to/from my locker at the time.) But a murmur went through the entire audience as they realized what had just happened.

The timing was perfect, too — right at the point that characters in the film open a huge, loud, grinding door to a remote outpost. People thought at first that it was the speakers rumbling. Everyone settled down immediately and went back to watching the movie, but it was the second most popular topic of conversation among people leaving afterward.

Crash

It reminded me of another real-world/movie confluence, way back when I saw Star Trek VI: The Undiscovered Country. That film opened with a massive explosion in space that sent a shock wave so far that it hit Captain Sulu’s ship, the Excelsior. Either at the moment of the explosion or at the moment it hit the ship, we heard an incredibly loud BOOM!, and thought at first that it was just a very impressive sound effect…until we noticed that the curtain was draped across a quarter of the screen. The curtain rod had broken during the movie. After a few minutes they stopped the movie, canceled a showing of something else, and moved us all over into another theater (it was opening night, and they had a theater full of Star Trek fans who’d waited for several hours to get in — they were not going to risk our wrath by sending us home, even with refunds).

Back to the Film

Judging by audience reaction, there were definitely lots of people seeing it for the first time today, so I’ll keep this non-spoilery as much as possible.

  • The film manages to recapture the Kirk, Spock and McCoy dynamic that gave the original show its heart.
  • Each character gets at least something to do, even if it does focus heavily on Kirk and Spock.
  • The actors really manage to convey the same characters, rather than new characters with the same names. Especially McCoy and Spock. Karl Urban in particular seems to be channeling DeForest Kelley the way Ewan MacGregor channeled Alec Guinness in the Star Wars prequels. (And yes, Kirk is different, but there’s a reason for it, and that reason is critical to the story and his character’s journey.)
  • The plot moves and holds together (mostly).
  • The effects of course are incredible.
  • They remembered that Trek can have humor — something that ST: TNG and later shows seemed to avoid as if it would somehow taint their artistic value (except when Q was around).
  • The nods to established elements of the series, from character quirks to design elements to music cues, that are there if you know what to look for, but don’t bog down the story if you don’t.

I had no problems with the obvious canon changes, and thought that the huge event 1/3 of the way in was probably the best way they could recapture dramatic suspense and establish the idea that anything can happen.

In fact, the things that bothered me have very little to do with other versions of Star Trek. Again, trying to be as non-spoilery as I can for the people who haven’t seen it.

  • Supernovas are not that dangerous unless you’re in the same solar system. For planet X to be destroyed, it would have to have been that planet’s sun that went supernova.
  • Another planet, to provide the view that it offered of a significant event, would have to have been a moon of the planet on which that event took place.
  • Engineering doesn’t look like a spaceship. It looks like a brewery.
  • It relies heavily on the same dead-relative-as-motivation trope that’s bothering me so much in Flash: Rebirth. But I can see what they were going for and why they did it.
  • A piece of miracle technology is invented which would revolutionize space travel to the point that it would make any further voyages irrelevant, and will most likely be ignored because of this. (Of course, the TV series did the same thing all the time.)

Music

Also, while I liked the music in context, it’s very repetitive. The theater was playing the score while we waited for the film to start, and an awful lot of it is the same theme, over and over, in different arrangements.

My favorite Star Trek music is a toss-up between James Horner’s scores for The Wrath of Khan and The Search for Spock, and Cliff Eidelman’s score for The Undiscovered Country. We were talking about the music before the movie, and neither of us could think of anything else Eidelman had done, so I looked him up on IMDB. It turns out that he’s written music for about 20 films since Star Trek VI, and I recognized almost all of them…I just hadn’t actually seen any of them.

Posted in Sci-Fi/Fantasy, Strange World | Tagged , , | Leave a comment