Information for

Logo VISUS

Vis-Text Interaction

A picture is worth a thousands words.” There is certainly some truth in the saying, but is it true always? - No, also pictures need captions. Abstract facts can often be described much easier in a few words than a picture. Hence, images and text usually complement each other. This is particularly true if the image is a visualization: labels make sense of the abstract geometric shapes, a legend needs to explain the data mapping, and only a text connects the displayed data into a story. Yet, text and visualization are often treated as separate entities, reducing the accessibility of the presented data and hindering knowledge extraction. In this project, we want bring visualization and text closer together by interactively linking them in visually augmented digital text documents.

The project investigates two application scenarios. First, scientific publications aim at communicating insights gained from data to the readers. Diagrams and charts have become integral part of scientific publications, but are only loosely linked to the text by references. Making those links interactively explorable, we would like to strengthen the integration. For instance, clicking on a statement in the text, the diagram could adapt to a version that provides more explanations or evidence underlining the textual statement. Or, vice versa, selecting a data point in the visualization, related text sections become highlighted. Embedded additional texts and visualizations explain the relationship. Even more directly, word-sized graphics, known as sparklines, can augment the text with extra information. The second scenario will investigate similar approaches in context of software engineering. Tightly integrated visualization enrich software documentation, requirements, or bug reports with data retrieved from the software system.

The project is supported by the Baden-Württemberg Stiftung as part of the Postdoctoral Fellowship for Leading Early Career Researchers granted to VISUS researcher Fabian Beck.

Related Publications

2017

Word-Sized Eye Tracking Visualizations
Beck, Fabian; Blascheck, Tanja; Ertl, Thomas; Weiskopf, Daniel: Word-Sized Eye Tracking Visualizations. In: Burch, Michael and Chuang, Lewis and Fisher, Brian and Schmidt, Albrecht and Weiskopf, Daniel: Eye Tracking and Visualization: Foundations, Techniques, and Applications. ETVIS 2015. Springer, 2017.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]

2016

Visual Analysis and Dissemination of Scientific Literature Collections with SurVis
Beck, Fabian; Koch, Sebastian; Weiskopf, Daniel: Visual Analysis and Dissemination of Scientific Literature Collections with SurVis. In: IEEE Transactions on Visualization and Computer Graphics: Vol. 22, No. 1 (2016), pp. 180-189.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
An Expert Evaluation of Word-Sized Visualizations for Analyzing Eye Movement Data
Beck, Fabian; Acurana, Yasett; Blascheck, Tanja; Netzel, Rudolf; Weiskopf, Daniel: An Expert Evaluation of Word-Sized Visualizations for Analyzing Eye Movement Data. In: , 2016.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
Visual Analysis and Coding of Data-Rich User Behavior
Blascheck, Tanja; Beck, Fabian; Baltes, Sebastian; Ertl, Thomas; Weiskopf, Daniel: Visual Analysis and Coding of Data-Rich User Behavior. In: IEEE Conference on Visual Analytics Science & Technology 2016, pp. 141-150, 2016.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
Visually Exploring Object Mutation
Schulz, Rodrigo; Beck, Fabian; Cerezo Felipez, Jhonny W.; Bergel, Alexandre: Visually Exploring Object Mutation. In: VISSOFT 2016 NIER (to appear).
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]

2015

Navigate, Understand, Communicate: How Developers Locate Performance Bugs
Baltes, Sebastian; Moseler, Oliver; Beck, Fabian; Diehl, Stephan: Navigate, Understand, Communicate: How Developers Locate Performance Bugs. In: Proceedings of the 9th International Symposium on Empirical Software Engineering and Measurement (ESEM '15), pp. 225-234, 2015.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
Rethinking User Interfaces for Feature Location
Beck, Fabian; Dit, Bogdan; Velasco-Madden, Jaleo; Weiskopf, Daniel; Poshyvanyk, Denys: Rethinking User Interfaces for Feature Location. In: ICPC '15: Proceedings of the IEEE 23rd International Conference on Program Comprehension, pp. 151-162, 2015.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
Visualizing Work Processes in Software Engineering with Developer Rivers
Burch, Michael; Munz, Tanja; Beck, Fabian; Weiskopf, Daniel: Visualizing Work Processes in Software Engineering with Developer Rivers. In: Proceedings of the 3rd IEEE Working Conference on Software Visualization (VISSOFT '15), pp. 116-124, 2015.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
Exploring Word-Sized Graphics for Visualizing Eye Tracking Data within Transcribed Experiment Recordings
Beck, Fabian; Blascheck, Tanja; Ertl, Thomas; Weiskopf, Daniel: Exploring Word-Sized Graphics for Visualizing Eye Tracking Data within Transcribed Experiment Recordings. In: ETVIS 2015, 2015.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]

2014

RegViz: Visual Debugging of Regular Expressions
Beck, Fabian; Gulan, Stefan; Biegel, Benjamin; Baltes, Sebastian; Weiskopf, Daniel: RegViz: Visual Debugging of Regular Expressions. In: ICSE Companion '14: Companion Proceedings of the 36th International Conference on Software Engineering, pp. 504-507, 2014.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]

2013

Visual Monitoring of Numeric Variables Embedded in Source Code
Beck, Fabian; Hollerich, Fabrice; Diehl, Stephan; Weiskopf, Daniel: Visual Monitoring of Numeric Variables Embedded in Source Code. In: VISSOFT '13: Proceedings of the first IEEE Working Conference on Software Visualization, pp. 1-4, 2013.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]
In Situ Understanding of Performance Bottlenecks through Visually Augmented Code
Beck, Fabian; Moseler, Oliver; Diehl, Stephan; Rey, Günter D.: In Situ Understanding of Performance Bottlenecks through Visually Augmented Code. In: ICPC '13: Proceedings of the 21st International Conference on Program Comprehension, pp. 63-72, 2013.
[XPS] [PDF] [DOI] [OpenXML] [BibTeX] [Slides] [Details]