depressing, interesting

The New York Times has an interesting (and somewhat depressing) interactive times series graph of US unemployment rates. The controls let you slice the data demographically to get a sense of how groups you are not a part of might be feeling the effects of the recession. For the dryness of the presentation, this data tells a very compelling and human story.

geolocation + open data = awwesome

Coming across our desk via tweet from Sir Time Berneers Lee: an amazing (if not amazing looking) google maps based data mashup showing marine traffic throughout the world. That is to say, Real Time (not really but close) data showing position, speed and heading for ships throut the worlds major shipping lanes. The Mashup runs on top of a big open data set hosted by the Department of Product and Systems Design Engineering, University of the Aegean, Greece. More information about the project can be found at the open dot dot dot blog. Anyway go check it out.

One funny thing, it shows traffic on canals and rivers, so when you first look at the map you may wonder why there are forty boats in Missouri.

So, so cool.

The team behind the core technology that became photosynth is taking things to a much higher level. Sameer Agarwal and his band of computer vision desperadoes rebuilt Rome (or a reasonable simulation thereof) in just under 24 hours. This feat was pulled off using 150,000 images pulled from Flickr and some extremely hot computer vision research.

Check out the digest version here and the full nerd monty here.

FlowingData, if you don't already read them: start now

FlowingData has a nice post today rounding up 20 data visualizations related to crime and criminals. Most revolve around maps with temporal components shoehorned into a few. We love maps here at Graphient. We love them for how they visually describe space, and we really love them for the way they provide a fixed contextual grid for organizing other kinds of data. The map visualizations presented at FlowingData stop short of adding in other data and stick to simply reporting the facts of crime, but those maps could have been used to introduce and connect all sorts of other (possibly sensitive) socioeconomic data and maybe tell a deeper story about crime.

Detail of the map in question.

I took a picture of the map because of the wear pattern created by countless travelers tracing their fingers over it. In that wear pattern we can see those travelers working out their routes on the Silverline and picking out the different transfer points throughout the system. In essence the map carries a second channel of data relative to the first. Of course this second channel is pretty unscientific but we haven’t let that stop us from appreciating the aesthetics of information presentation before and we won’t start now.

Later in the day I was talking to my Dad about this phenomena, and the idea that data is being recorded in the physical world all around us, all the time, simply by the way we use things. He mentioned Wells Cathedral in Somerset, England. The stone stairs of the cathedral’s chapter house date to 1306, and they have been eroded along the preferred path worshippers and clergy have taken ascending and descending those stairs all these years.

Those very steps

While much of this naturally recorded information is of limited utility or has ambiguous meaning, we find ourselves oddly stimulated by the idea that a channel of information is projected onto the world in this way.

I’m posting this now because the Open Data movement seems to be getting some traction–at least in Government circles. A couple of weeks ago the Obama administration launched Data.gov a clearing house for government data. Washington D.C. has become a leader in municipal public data, putting some 260 feeds of data out in raw form. And now the UK has decided to get in on the act: Gordon Brown the embattled Prime Minister, announced yesterday that none other than Sir Tim Himself would be heading up the initiative to open  England’s data up to the public.

This was largely damage control after a series of embarrassing disclosures about how members of Parliament expense things, but it is a welcome development all the same.

We here at Graphient wish Sir Tim the best of luck moving forward and very much hope that FreeTime will become the application of choice for those looking at all that data.

Read the BBC article here.

Graphient is building an application called FreeTime. FreeTime makes dynamic visual time lines out of whatever data or records you have laying around provided they have a time stamp or an identifiable time component.  It doesn’t matter to FreeTime whether this is a database of some kind, or a spreadsheet or a website. FreeTime uses the common framework of time to bring all these kinds of data into one view so the user can explore it better. Because time is a common dimension to data and information FreeTime can bring data from many different disciplines together.

Example uses include really simple stuff like interactive historical time lines, or very complex things like media analysis or longitudinal study analysis. Some people we’ve talked to just want to use it to see what music they were listening to on a particular day.

We see time as a way to create context for the rapidly proliferating large-open-data-sets out there. We’ll be talking more about this as things develop. In the meantime, if you’re interested in being a beta tester get in touch.

Ok, randomness is a really hard thing. Deriving actual randomness is hard work. A lot of mathematical models have been created over the years to describe randomness. Conveniently for you dear reader, this guy Daniel A. Becker has visualized a bunch of them for you. Enjoy this tasty and nutritious treat here.

Poisson Distribution. Look out Roger Mexico.