experience sampling method

You too can collect big data!

by KATHY BAXTER, Google EPIC2014 Workshop by Anna Avrekh, Kathy Baxter, & Bob Evans At the EPIC 2013 Keynote, Tricia Wang observed that, if you are not working with “Big Data,” the implication is that your data are “small.” Although the number of data points or participants may not be in the millions or ever thousands, the data we gather is actually far richer. As our community knows, web analytics or logs can tell us WHAT people are doing but never WHY. We may attempt to infer it based on what we see but unless we ask our users why they are doing something that we have recorded (with or without their knowledge), we can never know for sure. Later in the conference, I hosted a Salon on “Big Data” with discussants Jens Riegelsberger (Google) and Todd Cherkasky (SapientNitro). The interest in the salon far exceeded the space available. One key theme that emerged was a desire to learn how to incorporate “Big Data” into their work. Few of the participants had the means to pull logs and do deep statistical analysis...