4 Steps to uncovering dark data
(Dark data is any data that is not being mined, analyzed)
Here are the 4 basic steps on how best to uncover the dark data:
Step 1 - List out all the decisions that are being made with "gut instincts", "experience", "status quo" etcUse a brainstorming session type format to elicit this list from the middle and upper level managers.
Step 2 - Look for data sources that can help with decisions listed in Step 1Check with your management team to see which data sources could be used to help with decision making. No data source is out of bound. Videos, Audios, Emails, Twitter feeds and everything else.
Step 3 - Do a quick back-of-the-envelope cost-benefit analysis of the decisions from Step 1This step makes me a little queasy since this step itself is not supported with data but then again you need to bootstrap. And eventually this decision making itself could be driven by data available to you.
Step 4 - Get your data/IT team together and plan out the next stepsBe ready to deal with a bunch of engineers telling you why things will not work and how insane you are. Deal with it. And tell them to deal with it as well. That is it.
Hint: Take baby steps towards big data