HOME



Digby's Hullabaloo
2801 Ocean Park Blvd.
Box 157
Santa Monica, Ca 90405



Facebook: Digby Parton

Twitter:
@digby56
@Gaius_Publius
@BloggersRUs (Tom Sullivan)
@spockosbrain



emails:
Digby:
thedigbyblog at gmail
Dennis:
satniteflix at gmail
Gaius:
publius.gaius at gmail
Tom:
tpostsully at gmail
Spocko:
Spockosbrain at gmail
tristero:
Richardein at me.com








Infomania

Salon
Buzzflash
Mother Jones
Raw Story
Huffington Post
Slate
Crooks and Liars
American Prospect
New Republic
Common Dreams
AmericanPoliticsJournal
Smirking Chimp
CJR Daily
consortium news

Blog-o-rama

Eschaton
BagNewsNotes
Daily Kos
Political Animal
Driftglass
Firedoglake
Taylor Marsh
Spocko's Brain
Talk Left
Suburban Guerrilla
Scoobie Davis
Echidne
Electrolite
Americablog
Tom Tomorrow
Left Coaster
Angry Bear
oilprice.com
Seeing the Forest
Cathie From Canada
Frontier River Guides
Brad DeLong
The Sideshow
Liberal Oasis
BartCop
Juan Cole
Rising Hegemon
alicublog
Unqualified Offerings
Alas, A Blog
RogerAiles
Lean Left
Oliver Willis
skippy the bush kangaroo
uggabugga
Crooked Timber
discourse.net
Amygdala
the talking dog
David E's Fablog
The Agonist


Denofcinema.com: Saturday Night at the Movies by Dennis Hartley review archive

01/01/2003 - 02/01/2003 02/01/2003 - 03/01/2003 03/01/2003 - 04/01/2003 04/01/2003 - 05/01/2003 05/01/2003 - 06/01/2003 06/01/2003 - 07/01/2003 07/01/2003 - 08/01/2003 08/01/2003 - 09/01/2003 09/01/2003 - 10/01/2003 10/01/2003 - 11/01/2003 11/01/2003 - 12/01/2003 12/01/2003 - 01/01/2004 01/01/2004 - 02/01/2004 02/01/2004 - 03/01/2004 03/01/2004 - 04/01/2004 04/01/2004 - 05/01/2004 05/01/2004 - 06/01/2004 06/01/2004 - 07/01/2004 07/01/2004 - 08/01/2004 08/01/2004 - 09/01/2004 09/01/2004 - 10/01/2004 10/01/2004 - 11/01/2004 11/01/2004 - 12/01/2004 12/01/2004 - 01/01/2005 01/01/2005 - 02/01/2005 02/01/2005 - 03/01/2005 03/01/2005 - 04/01/2005 04/01/2005 - 05/01/2005 05/01/2005 - 06/01/2005 06/01/2005 - 07/01/2005 07/01/2005 - 08/01/2005 08/01/2005 - 09/01/2005 09/01/2005 - 10/01/2005 10/01/2005 - 11/01/2005 11/01/2005 - 12/01/2005 12/01/2005 - 01/01/2006 01/01/2006 - 02/01/2006 02/01/2006 - 03/01/2006 03/01/2006 - 04/01/2006 04/01/2006 - 05/01/2006 05/01/2006 - 06/01/2006 06/01/2006 - 07/01/2006 07/01/2006 - 08/01/2006 08/01/2006 - 09/01/2006 09/01/2006 - 10/01/2006 10/01/2006 - 11/01/2006 11/01/2006 - 12/01/2006 12/01/2006 - 01/01/2007 01/01/2007 - 02/01/2007 02/01/2007 - 03/01/2007 03/01/2007 - 04/01/2007 04/01/2007 - 05/01/2007 05/01/2007 - 06/01/2007 06/01/2007 - 07/01/2007 07/01/2007 - 08/01/2007 08/01/2007 - 09/01/2007 09/01/2007 - 10/01/2007 10/01/2007 - 11/01/2007 11/01/2007 - 12/01/2007 12/01/2007 - 01/01/2008 01/01/2008 - 02/01/2008 02/01/2008 - 03/01/2008 03/01/2008 - 04/01/2008 04/01/2008 - 05/01/2008 05/01/2008 - 06/01/2008 06/01/2008 - 07/01/2008 07/01/2008 - 08/01/2008 08/01/2008 - 09/01/2008 09/01/2008 - 10/01/2008 10/01/2008 - 11/01/2008 11/01/2008 - 12/01/2008 12/01/2008 - 01/01/2009 01/01/2009 - 02/01/2009 02/01/2009 - 03/01/2009 03/01/2009 - 04/01/2009 04/01/2009 - 05/01/2009 05/01/2009 - 06/01/2009 06/01/2009 - 07/01/2009 07/01/2009 - 08/01/2009 08/01/2009 - 09/01/2009 09/01/2009 - 10/01/2009 10/01/2009 - 11/01/2009 11/01/2009 - 12/01/2009 12/01/2009 - 01/01/2010 01/01/2010 - 02/01/2010 02/01/2010 - 03/01/2010 03/01/2010 - 04/01/2010 04/01/2010 - 05/01/2010 05/01/2010 - 06/01/2010 06/01/2010 - 07/01/2010 07/01/2010 - 08/01/2010 08/01/2010 - 09/01/2010 09/01/2010 - 10/01/2010 10/01/2010 - 11/01/2010 11/01/2010 - 12/01/2010 12/01/2010 - 01/01/2011 01/01/2011 - 02/01/2011 02/01/2011 - 03/01/2011 03/01/2011 - 04/01/2011 04/01/2011 - 05/01/2011 05/01/2011 - 06/01/2011 06/01/2011 - 07/01/2011 07/01/2011 - 08/01/2011 08/01/2011 - 09/01/2011 09/01/2011 - 10/01/2011 10/01/2011 - 11/01/2011 11/01/2011 - 12/01/2011 12/01/2011 - 01/01/2012 01/01/2012 - 02/01/2012 02/01/2012 - 03/01/2012 03/01/2012 - 04/01/2012 04/01/2012 - 05/01/2012 05/01/2012 - 06/01/2012 06/01/2012 - 07/01/2012 07/01/2012 - 08/01/2012 08/01/2012 - 09/01/2012 09/01/2012 - 10/01/2012 10/01/2012 - 11/01/2012 11/01/2012 - 12/01/2012 12/01/2012 - 01/01/2013 01/01/2013 - 02/01/2013 02/01/2013 - 03/01/2013 03/01/2013 - 04/01/2013 04/01/2013 - 05/01/2013 05/01/2013 - 06/01/2013 06/01/2013 - 07/01/2013 07/01/2013 - 08/01/2013 08/01/2013 - 09/01/2013 09/01/2013 - 10/01/2013 10/01/2013 - 11/01/2013 11/01/2013 - 12/01/2013 12/01/2013 - 01/01/2014 01/01/2014 - 02/01/2014 02/01/2014 - 03/01/2014 03/01/2014 - 04/01/2014 04/01/2014 - 05/01/2014 05/01/2014 - 06/01/2014 06/01/2014 - 07/01/2014 07/01/2014 - 08/01/2014 08/01/2014 - 09/01/2014 09/01/2014 - 10/01/2014 10/01/2014 - 11/01/2014 11/01/2014 - 12/01/2014 12/01/2014 - 01/01/2015 01/01/2015 - 02/01/2015 02/01/2015 - 03/01/2015 03/01/2015 - 04/01/2015 04/01/2015 - 05/01/2015 05/01/2015 - 06/01/2015 06/01/2015 - 07/01/2015 07/01/2015 - 08/01/2015 08/01/2015 - 09/01/2015 09/01/2015 - 10/01/2015 10/01/2015 - 11/01/2015 11/01/2015 - 12/01/2015 12/01/2015 - 01/01/2016 01/01/2016 - 02/01/2016 02/01/2016 - 03/01/2016 03/01/2016 - 04/01/2016 04/01/2016 - 05/01/2016 05/01/2016 - 06/01/2016 06/01/2016 - 07/01/2016 07/01/2016 - 08/01/2016 08/01/2016 - 09/01/2016 09/01/2016 - 10/01/2016 10/01/2016 - 11/01/2016 11/01/2016 - 12/01/2016 12/01/2016 - 01/01/2017 01/01/2017 - 02/01/2017 02/01/2017 - 03/01/2017 03/01/2017 - 04/01/2017 04/01/2017 - 05/01/2017 05/01/2017 - 06/01/2017 06/01/2017 - 07/01/2017 07/01/2017 - 08/01/2017 08/01/2017 - 09/01/2017 09/01/2017 - 10/01/2017 10/01/2017 - 11/01/2017 11/01/2017 - 12/01/2017 12/01/2017 - 01/01/2018


 

This page is powered by Blogger. Isn't yours?

Hullabaloo


Wednesday, January 25, 2017

 
Preserving reality

by digby



















It's hard to believe it has come to this but it has:
As Donald Trump was sworn into office as the new president of the US on Jan. 20, a group of around 60 programmers and scientists were gathered in the Department of Information Studies building at the University of California-Los Angeles, harvesting government data.

A spreadsheet detailed their targets: Webpages dedicated to the Department of Energy’s solar power initiative, Energy Information Administration data sets that compared fossil fuels to renewable energy sources, and fuel cell research from the National Renewable Energy Laboratory, to name a few out of hundreds.

Many of the programmers who showed up at UCLA for the event had day jobs as IT consultants or data managers at startups; others were undergrad computer science majors. The scientists in attendance, including ecologists, lab managers, and oceanographers, came from universities all over Southern California. A motley crew of data enthusiasts who assemble for projects like this is becoming something of a trend at universities across the country: Volunteer “data rescue” events in Toronto, Philadelphia, Chicago, Indianapolis, and Michigan over the last few weeks have managed to scrape hundreds of thousands of pages off of EPA.gov, NASA.gov, DOE.gov, and whitehouse.gov, uploading them to the Internet Archive. Another is planned for early February at New York University.

Hackers, librarians, scientists, and archivists had been working around the clock, at these events and in the days between, to download as much federal climate and environment data off government websites as possible before Trump took office. But suddenly, at exactly noon on Friday as Trump was sworn in, and just as the UCLA event kicked off, some of their fears began to come true: The climate change-related pages on whitehouse.gov disappeared. It’s typical of incoming administrations to take down some of their predecessor’s pages, but scrubbing all mentions of climate change is a clear indication of the Trump administration’s position on climate science.

“We’re having a heart attack,” said Laurie Allen on Friday afternoon. Allen is the assistant director for digital scholarship in the University of Pennsylvania libraries and the technical lead on a recent data-rescuing event there. “In the last four days I think we’ve been working 22 hours a day, because we were hearing that these precise changes were going to happen.”

“I wish we had been wrong about our concerns. But this is what we internally had predicted and prepared for,” added Bethany Wiggin, the director of the environmental humanities program at Penn and another organizer of the data-rescuing event.

Over the first 100 days of the new administration, a volunteer team of programmers will be scanning government websites and comparing them to the archived, pre-Trump versions, to check for changes. “We’ll be letting people know what the changes exactly are. We hope to produce a weekly report on changes,” Wiggin says, perhaps in the form of a newsletter.

While Wiggin and Allen say the changes to whitehouse.gov are disconcerting, they also note they are small potatoes compared with what could come next: the large government data sets related to climate change and environmental health that scientists use for research. For example, there’s a massive Environmental Protection Agency database of air quality monitoring data that might become a target of Trump-appointed EPA administrator Scott Pruitt’s office, based on Pruitt’s history of suing the EPA to roll back air pollution regulations.

That’s where the data rescuing hackathons come in: The volunteer programmers at each event have been writing custom scripts to harvest the bigger, more complicated federal data sets, too. And they’re sharing the scripts with each other. “These events build onto each other. We might use tools that were built at other events,” says Irene Pasquetto, one of the organizers of the UCLA event.

Large data sets are being organized and uploaded to datarefuge.org, a website based on a version of the open-source data portal software Ckan, customized by Allen. All the various data-rescue hackathons are using the site for data storage, and hope it will act as an alternative repository for pre-Trump federal information during the new administration.

There will, thanks to Michael Riedyk, CEO of the Canadian data-archiving company Page Freezer, also be a copy stored outside the US.
There's more at the link.These are not paranoid people. They have good reason to do this.  The Trump administration is already shutting down the ability of agencies to disseminate information to the public. We will not know if they have changed or destroyed important information. we won't know what to believe.

And that's terrifying.

.