Heroic Feats of Data Scientists Doing Good

Photo by Sean MacEntee via Flickr. (CC BY 2.0)

Data scientists are a tireless lot: between using their multidisciplinary skills to solve critical business challenges, fielding job offers, and competing in Kaggle competitions, many practitioners moonlight in service of the public good. These heroic data divers serve a critical need, devoting nights and weekends to munging messy XML files, developing models, and unearthing insights for non-profits and advocacy groups that lack these skills or resources.

Read more »

The 2012 Code for America Summit: Democracy Behind and Beyond the Dashboard

cfa_summit

The growth of the civic tech movement in recent years is impressive. Ranging from citizen-developed bus tracking mobile apps to municipal and federal open data portals, the scope and goals of these efforts vary widely. What unites this loose-knit federation of policy makers, developers, data divers, journalists, advocacy groups, and entrepreneurs is the goal to apply the innovations of open source software, the real-time web, and Big Data analytics, to make government more efficient, transparent, and representative.

Read more »

Delve Into the Deep Blue Sea of Oceanic Data with Marinexplore

marineexplore_thumb

It’s widely known that most of the Earth is covered in water; the ocean alone covers 71% of the planet’s surface to be exact. The ocean contains fathoms of data, and with over 90% of it still to be explored, its processing and analysis is the very model of a Big Data problem. Marinexplore is a new open data collaboration platform and community containing 463,447,500 oceanographic measurements collected from 23,422 sensors.

Read more »

SDSS Releases the Largest-Ever 3-D Map of the Universe

Screen Shot 2012-08-10 at 3.24.20 PM

While the landing of the Mars rover Curiosity has understandably monopolized the science headlines this week, the Sloan Digital Sky Survey III (SDSS) released an immense amount of data that is no less breathtaking. The international consortium of research institutions states that it constitutes the largest-ever map of the universe.

Read more »

Understanding How Data Flows Through Your Organization

Factual Blog

The deluge of Big Data is a well-known challenge, but a recent post on the Factual blog draws attention to a problem no less imposing: How does data flow through an organization? For a business to even get a handle on its available data, it must have a “coherent picture of how data flows from beginning to end when it is put to use.” An incoherent or inadequate understanding of this can lead to duplicated efforts by remote teams, and a drain on the knowledge and skills each team has accrued.

Read more »