DEW projects use a range of multimedia devices such as those pictured above to record fine details of cognition in action in a variety of settings. Tools include multiple video cameras, audio recording devices,mobile eye tracking devices, as well as digital pen and paper technology developed by Nadir Weibel. Equipping cognitive ecosystems with this range of recording devices provides many advantages - but is incredibly data intensive. An elegant solution to this problem has been An elegant solution to this problem has been Adam Fouse's development of ChronoViz - a flexible tool for the visualization and analysis of mutliple data streams (see next slide)

Once on-site data collection is complete, all data are integrated into the ChronoViz platform. ChronoViz integrates multimodal sets of time-coded data, with a focus on the analysis of video in combination with other data sources. In addition to the integration and navigation of data, ChronoViz allows users to easily create annotations of their data during review. Time series data, including annotations, can be arranged across multiple timelines.

Fouse and Weibel have collaborated on the recent release of ChronoViz 2.0 - the ChronoViz Digital Pen and Paper system - which allows users to employ digital pen technology to link notes taken on digital paper to the rest of their data in ChronoViz, and to navigate with paper-based controls. Find out more about these capabilities at chronoviz.com.

The image above is a screenshot of data collected during a simulated flight. The left camera view is taken from the mobile eyetracking glasses on the pilot flying. An over-the-shoulder video is presented on the upper right. The audio stream is the first timeline below the video screens, followed by image snapshots taken at regular intervals throughout the recording. The graph below is of of velocity over time, however this is just one of many variables that can be stacked on multiple timelines. The colored blocks below represent audio transcriptions, shown in full on the upper right corner. The loweset level of the timeline shows annotations created by researchers reviewing the data in ChronoViz. Digital notes taken by observers on site are shown to the right of the main view. Clicking on the notes will navigate to the time that note was taken in the recording session. Finally, on the lower right portion of the screenshot is a map with the flight path overlayed and colored relative to the ChronoViz annotations.

Click here to see more DEW projects