StoryFlow: Tracking the Evolution of Stories

IEEE Transactions on Visualization and Computer Graphics (IEEE InfoVis 2013)

Shixia Liu1    Yingcai Wu1     Enxun Wei1,2     Mengchen Liu1     Yang Liu1    
1Microsoft Research Asia      2Shanghai Jiao Tong University

Teaser Image

A storyline visualization of the movie The Lord of the Rings. The yellow line indicates the path of the ring. The black layers are the armies. For example, the one at the bottom is Sauron's army bundled by the level of detail technique.

Case Study using Twitter Data - 2012 US Presidential Election

Visualization of the 2012 US presidential election. It contains 89,174,308 tweets, 900 opinion leaders, and 63 time frames. The opinion leaders are organized by a 2-level topic hierarchy and are bundled together by the LOD technique. Each color represents an opinion leader group. Three interesting attention transition patterns related to (a) the Benghazi issue of the Obama administration, (b) the Sensata scandal of Romney, and (c) hurricane Sandy have been identified.

Abstract

Storyline visualizations, which are useful in many applications, aim to illustrate the dynamic relationships between entities in a story. However, the growing complexity and scalability of stories pose great challenges for existing approaches. In this paper, we propose an efficient optimization approach to generating an aesthetically appealing storyline visualization, which effectively handles the hierarchical relationships between entities over time. The approach formulates the storyline layout as a novel hybrid optimization approach that combines discrete and continuous optimization. The discrete method generates an initial layout through the ordering and alignment of entities, and the continuous method optimizes the initial layout to produce the optimal one. The efficient approach makes real-time interactions (e.g., bundling and straightening) possible, thus enabling users to better understand and track how the story evolves. Experiments and case studies are conducted to demonstrate the effectiveness and usefulness of the optimization approach.

Feedback from Users

To evaluate the usefulness of StoryFlow, we conducted a semistructured interview with three domain experts, a film professor (User F), a sociology PhD student (User S), and a professor (User P) in media and communication studies.

User S was very impressed by the visualization and commented "It is stunning and engaging. It definitely outperforms the static infographics that I have seen before." User P said, "StoryFlow would be particularly useful for data-driven journalism because it not only provides a clear visual summary of events but also shows informative context for investigative analysis". Both scholars suggested several potential applications for StoryFlow. For example, User S indicated that it would be interesting to see the dynamic relationships of the liberal and conservative opinion leaders over time, while User P suggested adding sentiment information to the StoryFlow visualization to provide richer context for further analysis.

Overall, StoryFlow was well received by User F. He commented, "I love this visualization! It is a great way to show the interactions between characters over time, which can definitely help filmmaking." He suggested several use scenarios:

Storyline Visualization Applications

Storyline visualizations were originally invented by XKCD for illustrating interactions among characters in movies. In recent years, the visualizations have been applied to solving different practical problems where dynamic relationships are involved. The followings are some of the typical use scenarios of the technique.

Paper

Download the paper

Video

Download the video (15MB)

Slide Deck
StoryFlow - Visually Tracking Evolution of Stories from Yingcai Wu

Download the slides (30MB)

BibTeX

@article {YWu2013a,
author = {Shixia Liu and Yingcai Wu and Enxun Wei and Mengchen Liu and Yang Liu},
title = {{StoryFlow}: Tracking the Evolution of Stories},
journal = {IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE InfoVis 2013},
year = {2013},
volume = {19},
number = {12},
pages = {2436--2445}
}

Acknowledgements

The authors would like to thank Yuzuru Tanahashi for providing the comparison data and helping generate some of the comparison examples and Stephen Lin for proofreading the paper.