| Notes on the Atrocities Like a 100-watt radio station, broadcasting to the dozens... |
|
Monday, October 27, 2003 Something's rotten on Google, and Jesse Berney has found the source. Yesterday Atrios reported that the White House has rigged the search engines so searchers can no longer track back to the White House webpage if they search for "Iraq." (Not that, you know, anything's gone horribly wrong there.)
First, a bit of technical background. Most major websites include a text file named robots.txt that tells search engines which directories not to include in search results. (Here's an example: the Democrats.org robots.txt file lists folders with content — like images — that search engines can't index.) By adding a directory to robots.txt, you ensure that nothing in that folder will ever show up in a Google search and — more important for this discussion — never be archived by sites like Google.
It's easy enough to understand the reasoning if you look at past White House actions. Earlier this year, the White House revised pages on its website claiming that "combat" was over in Iraq, changing them to say "major combat."
|
|
||||
|
|
|||||