When President Obama signed the American Recovery and Reinvestment Act of 2009 into law Tuesday, he announced that Recovery.gov, a Web site he first spoke about last month, was live. The new Web site is committed to transparently showing citizens where all of the $787 billion in the stimulus package is being spent.
While I applaud the Obama Administration for their committment to openness and for using the Web as their main tool of transparency, Recovery.gov has some issues.
First, CNET reported that Recovery.gov initially included a robots.txt file. A robots.txt file blocks so-called bots (including search engine crawlers) from accessing a Web site. While the White House has since removed the bot-blocker, one can't help but wonder why someone wouldn't want Google crawling a Web site about transparency in the first place. The White House did not comment on this.
Perhaps most importantly, the Web site only scratches the surface of breaking down the massive package into bits and pieces. While the federal government begins to dole out stimulus money, it seems the Web site is still a work in progress -- one can only see two metrics: a state-by-state breakdown of job creation and a very broad estimate of investments made. Yet the bill contains very specific uses for the money -- a point that someone would never understand by looking at the fancy yet hardly useful graphics on this Web site.
However, we have yet to see the full potential of this new site. A searchable database of some sort seems to be on the way -- as evidenced by strict reporting requirements mandated by the Office of Management and Budget. Hopefully the database will implement a user-friendly design to tackle the hoards of data soon to flow through government computers.
It also seems like individual states have mimicked the concept. Colorado, where Obama signed the stimulus, has created their own economic stimulus Web site. This action is not neccessary (I wonder if we'll see it in states with Republican governors) but should prove to serve as a nice complement to the main Recovery.gov Web site.
One thing is for certain: despite a bumpy start, if Recovery.gov works as intended, we've surely entered a new era of Web-based transparency.


Salon.com
Comments
As far as Joseph's question re: robots.txt, oftentimes these bots can cause higher server loads and strain bandwidth -- so it's often advantageous for people to block access. Also, one can often gain access through a site like Google to secure areas of Web sites if a robots.txt file is not employed properly.
Jim, I'm in total agreement with you. First things first!!!!!
(rated)
When I am working on a website, I typically make an entry in the robots.txt to file to not index. When the site is ready to go live I change it to index. It is always my fear that I will forget to do this. I wonder if this is just a task that got forgotten.
What I also find interesting is that Google disregarded the robots file and indexed the site anyway.
Also, if you want more information on the guidance that is being provided to federal agencies and webmasters about transparency, accountability and reporting, you can check out this document, http://www.recovery.gov/files/Initial%20Recovery%20Act%20Implementing%20Guidance.pdf.