The Dark Data Blog

How Dark Data led us astray

Missing frequencies in energy data

Philip Q. Hanser of Northeastern University sent me this very nice example of DD-Type 14 dark data: ‘I was studying the question of wind turbine output variability to try to understand how much non-wind turbine back-up resources are needed to ensure the electrical...

read more

Covid-19 and dark data

Ideally, whenever we have to make a decision we collect all the relevant data and condense it down so that we can make the best decision. However, the notion of “all the relevant data” is an elusive one, and very often, perhaps most often, much of the relevant data...

read more
Patriot Missile

Patriot Missile

Much dark data arises in the form of entire records missing – people who refuse to take part in surveys, stars which do not radiate in the visible spectrum, patients not yet showing symptoms, and so on. But other dark data are more subtle. One example is when numbers...

read more