Abdelaal, Moataz ; Amtsberg, Felix ; Becher, Michael ; Duque Estrada, Rebeca ; Kannenberg, Fabian ; Sousa Calepso, Aimee ; Wagner, Hans Jakob Jakob ; Reina, Guido ; u. a.: Visualization for Architecture, Engineering, and Construction: Shaping the Future of Our Built World. In: IEEE Computer Graphics and Applications, IEEE Computer Graphics and Applications. (2022), S. 1–1
Abstract
Our built world is one of the most important factors for a livable future, accounting for massive impact on resource and energy use, climate change, but also the social and economic aspects coming with population growth. The architecture, engineering, and construction industry is facing the challenge that it needs to substantially increase its productivity, yet alone the quality of the building of the future. In this paper, we discuss these challenges in more detail, focusing on how digitization can facilitate this transformation of the industry, and link them to opportunities for visualization and augmented reality research. We illustrate solution strategies for advanced building systems based on wood and fiber.BibTeX
Abdelaal, Moataz ; Schiele, Nathan D. ; Angerbauer, Katrin ; Kurzhals, Kuno ; Sedlmair, Michael ; Weiskopf, Daniel: Comparative Evaluation of Bipartite, Node-Link, and Matrix-Based Network Representations. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022), S. 1–11
Abstract
This work investigates and compares the performance of node-link diagrams, adjacency matrices, and bipartite layouts for visualizing networks. In a crowd-sourced user study (n = 150), we measure the task accuracy and completion time of the three representations for different network classes and properties. In contrast to the literature, which covers mostly topology-based tasks (e.g., path finding) in small datasets, we mainly focus on overview tasks for large and directed networks. We consider three overview tasks on networks with 500 nodes: (T1) network class identification, (T2) cluster detection, and (T3) network density estimation, and two detailed tasks: (T4) node in-degree vs. out-degree and (T5) representation mapping, on networks with 50 and 20 nodes, respectively. Our results show that bipartite layouts are beneficial for revealing the overall network structure, while adjacency matrices are most reliable across the different tasks.BibTeX
Abdelaal, Moataz ; Schiele, Nathan Daniel ; Angerbauer, Katrin ; Kurzhals, Kuno ; Sedlmair, Michael ; Weiskopf, Daniel: Supplemental Materials for: Comparative Evaluation of Bipartite, Node-Link, and Matrix-Based Network Representations, DaRUS (2022)
BibTeX
Achberger, Alexander ; Arulrajah, Pirathipan ; Sedlmair, Michael ; Vidackovic, Kresimir: STROE: An Ungrounded String-Based Weight Simulation Device. In: IEEE Conference on Virtual Reality and 3D User Interfaces (VR), IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2022, S. 112–120
BibTeX
Achberger, Alexander ; Heyen, Frank ; Vidackovic, Kresimir ; Sedlmair, Michael: Touching data with PropellerHand. In: Journal of Visualization, Journal of Visualization. (2022)
Abstract
Immersive analytics often takes place in virtual environments which promise the users immersion. To fulfill this promise, sensory feedback, such as haptics, is an important component, which is however not well supported yet. Existing haptic devices are often expensive, stationary, or occupy the user’s hand, preventing them from grasping objects or using a controller. We propose PropellerHand, an ungrounded hand-mounted haptic device with two rotatable propellers, that allows exerting forces on the hand without obstructing hand use. PropellerHand is able to simulate feedback such as weight and torque by generating thrust up to 11 N in 2-DOF and a torque of 1.87 Nm in 2-DOF. Its design builds on our experience from quantitative and qualitative experiments with different form factors and parts. We evaluated our prototype through a qualitative user study in various VR scenarios that required participants to manipulate virtual objects in different ways, while changing between torques and directional forces. Results show that PropellerHand improves users’ immersion in virtual reality. Additionally, we conducted a second user study in the field of immersive visualization to investigate the potential benefits of PropellerHand there.BibTeX
Angerbauer, Katrin ; Rodrigues, Nils ; Cutura, Rene ; Öney, Seyda ; Pathmanathan, Nelusa ; Morariu, Cristina ; Weiskopf, Daniel ; Sedlmair, Michael: Accessibility for Color Vision Deficiencies: Challenges and Findings of a Large Scale Study on Paper Figures. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. New Orleans, LA, USA : Association for Computing Machinery, 2022 — ISBN 9781450391573
Abstract
We present an exploratory study on the accessibility of images in publications when viewed with color vision deficiencies (CVDs). The study is based on 1,710 images sampled from a visualization dataset (VIS30K) over five years. We simulated four CVDs on each image. First, four researchers (one with a CVD) identified existing issues and helpful aspects in a subset of the images. Based on the resulting labels, 200 crowdworkers provided 30,000 ratings on present CVD issues in the simulated images. We analyzed this data for correlations, clusters, trends, and free text comments to gain a first overview of paper figure accessibility. Overall, about 60 % of the images were rated accessible. Furthermore, our study indicates that accessibility issues are subjective and hard to detect. On a meta-level, we reflect on our study experience to point out challenges and opportunities of large-scale accessibility studies for future research directions.BibTeX
Angerbauer, Katrin ; Sedlmair, Michael: Toward Inclusion and Accessibility in Visualization Research: Speculations on Challenges, Solution Strategies, and Calls for Action (Position Paper). In: 2022 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV), 2022 IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV), 2022, S. 20–27
Abstract
Inclusion and accessibility in visualization research have gained increasing attention in recent years. However, many challenges still remain to be solved on the road toward a more inclusive, shared-experience-driven visualization design and evaluation process. In this position paper, we discuss challenges and speculate about potential solutions, based on related work, our own research, as well as personal experiences. The goal of this paper is to start discussions on the role of accessibility and inclusion in visualization design and evaluation.BibTeX
Baumann, Martin ; Satkunarajan, Jena ; Koch, Steffen ; Ertl, Thomas: Hierarchical Multifocus Navigation in Text Annotation Data. In: Misue, K. (Hrsg.) ; Misue, K. (Hrsg.): Proc. IEEE Pac. Vis. Symp. (PacificVis), Proc. IEEE Pac. Vis. Symp. (PacificVis), 2022, S. 166--170
BibTeX
Becher, Michael ; Herr, Dominik ; Müller, Christoph ; Kurzhals, Kuno ; Reina, Guido ; Wagner, Lena ; Ertl, Thomas ; Weiskopf, Daniel: Situated Visual Analysis and Live Monitoring for Manufacturing. In: IEEE Computer Graphics and Applications, IEEE Computer Graphics and Applications. (2022), S. 1–1
Abstract
Modern machines continuously log status reports over long periods of time, which are valuable data to optimize working routines. Data visualization is a commonly used tool to gain insights into these data, mostly in retrospective, e.g. to determine causal dependencies between faults of different machines. We present an approach to bring such visual analyses to the shop floor to support reacting to faults in real time. This approach combines combines spatio-temporal analyses of time series using a handheld touch device with augmented reality for live monitoring. Important information augments machines directly in their real-world context and detailed logs of current and historical events are displayed on the handheld device. In collaboration with an industry partner, we designed and tested our approach on a live production line to obtain feedback from operators. We compare our approach for monitoring and analysis with existing solutions that are currently deployed.BibTeX
Beck, Samuel ; Frank, Sebastian ; Hakamian, Alireza ; van Hoorn, André: How is Transient Behavior Addressed in Practice? Insights from a Series of Expert Interviews. In: Companion of the 2022 ACM/SPEC International Conference on Performance Engineering, Companion of the 2022 ACM/SPEC International Conference on Performance Engineering. Bejing, China : Association for Computing Machinery, 2022 — ISBN 9781450391597, S. 105–112
Abstract
Transient behavior occurs when a running software system changes from one steady-state to another. In microservice systems, such disruptions can, for example, be caused by continuous deployment, self-adaptation, and various failures. Although transient behavior could be captured in non-functional requirements, little is known of how that is handled in practice. Our objective was to study how architects and engineers approach runtime disruptions, which challenges they face, whether or not they specify transient behavior, and how currently employed tools and methods can be improved. To this end, we conducted semi-structured interviews with five experienced practitioners from major companies in Germany. We found that a big challenge in the industry is a lack of awareness of transient behavior by software stakeholders. Consequently, they often do not consider specifying it in non-functional requirements. Additionally, better tooling is needed to reduce the effort of analyzing transient behavior. We present two prototypes that we developed corresponding to these findings to improve the current situation. Beyond that, the insights we present can serve as pointers for interesting research directions for other researchers.BibTeX
Bruder, Valentin ; Larsen, Matthew ; Ertl, Thomas ; Childs, Hank ; Frey, Steffen: A Hybrid In Situ Approach for Cost Efficient Image Database Generation. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022), S. 1–1
Abstract
The visualization of results while the simulation is running is increasingly common in extreme scale computing environments. We present a novel approach for in situ generation of image databases to achieve cost savings on supercomputers. Our approach, a hybrid between traditional inline and in transit techniques, dynamically distributes visualization tasks between simulation nodes and visualization nodes, using probing as a basis to estimate rendering cost. Our hybrid design differs from previous works in that it creates opportunities to minimize idle time from four fundamental types of inefficiency: variability, limited scalability, overhead, and rightsizing. We demonstrate our results by comparing our method against both inline and in transit methods for a variety of configurations, including two simulation codes and a scaling study that goes above 19K cores. Our findings show that our approach is superior in many configurations. As in situ visualization becomes increasingly ubiquitous, we believe our technique could lead to significant amounts of reclaimed cycles on supercomputers.BibTeX
CHEN, KUN-TING: It’s a Wrap! Visualisations that Wrap Around Cylindrical, Toroidal, or Spherical Topologies, Monash University (2022)
BibTeX
Chiossi, Francesco ; Zagermann, Johannes ; Karolus, Jakob ; Rodrigues, Nils ; Balestrucci, Priscilla ; Weiskopf, Daniel ; Ehinger, Benedikt ; Feuchtner, Tiare ; u. a.: Adapting visualizations and interfaces to the user. In: it - Information Technology, it - Information Technology. Bd. 64 (2022), Nr. 4–5, S. 133–143
Abstract
Adaptive visualization and interfaces pervade our everyday tasks to improve interaction from the point of view of user performance and experience. This approach allows using several user inputs, whether physiological, behavioral, qualitative, or multimodal combinations, to enhance the interaction. Due to the multitude of approaches, we outline the current research trends of inputs used to adapt visualizations and user interfaces. Moreover, we discuss methodological approaches used in mixed reality, physiological computing, visual analytics, and proficiency-aware systems. With this work, we provide an overview of the current research in adaptive systems.BibTeX
Dosdall, Sarah ; Angerbauer, Katrin ; Merino, Leonel ; Sedlmair, Michael ; Weiskopf, Daniel: Toward In-Situ Authoring of Situated Visualization with Chorded Keyboards. In: Burch, M. ; Wallner, G. ; Limberger, D. (Hrsg.) ; Burch, M. ; Wallner, G. ; Limberger, D. (Hrsg.): VINCI ’22: Proceedings of the 15th International Symposium on Visual Information Communication and Interaction, VINCI ’22: Proceedings of the 15th International Symposium on Visual Information Communication and Interaction : ACM, 2022, S. 1–5
Abstract
Authoring situated visualizations in-situ is challenging due to the need of writing code in a mobile and highly dynamic fashion. To provide better support for that, we define requirements for text input methods that target situated visualization authoring. We identify wearable chorded keyboards as a potentially suitable method that fulfills some of these requirements. To further investigate this approach, we tailored a chorded keyboard device to visualization authoring, developed a learning application, and conducted a pilot user study. Our results confirm that learning a high number of chords is the main barrier for adoption, as in other application areas. Based on that, we discuss ideas on how chorded keyboards with a strongly reduced alphabet, hand gestures, and voice recognition might be used as a viable, multi-modal support for authoring situated visualizations in-situ.BibTeX
Eirich, L ; Münch, M. ; Jäckle, D. ; Sedlmair, M. ; Bonart, J. ; Schreck, T.: RfX: A Design Study for the Interactive Exploration of a Random Forest to Enhance Testing Procedures for Electrical Engines (2022)
BibTeX
Fleck, Philipp ; Sousa Calepso, Aimée ; Hubenschmid, Sebastian ; Sedlmair, Michael ; Schmalstieg, Dieter: RagRug: A Toolkit for Situated Analytics. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022)
Abstract
We present RagRug, an open-source toolkit for situated analytics. The abilities of RagRug go beyond previous immersive analytics toolkits by focusing on specific requirements emerging when using augmented reality (AR) rather than virtual reality. RagRug combines state of the art visual encoding capabilities with a comprehensive physical-virtual model, which lets application developers systematically describe the physical objects in the real world and their role in AR. We connect AR visualization with data streams from the Internet of Things using distributed dataflow. To this aim, we use reactive programming patterns so that visualizations become context-aware, i.e., they adapt to events coming in from the environment. The resulting authoring system is low-code; it emphasises describing the physical and the virtual world and the dataflow between the elements contained therein. We describe the technical design and implementation of RagRug, and report on five example applications illustrating the toolkit's abilities.BibTeX
Franke, Max ; Knabben, Moritz ; Lang, Julian ; Koch, Steffen ; Blascheck, Tanja: A Comparative Study of Visualizations for Multiple Time Series. In: Hurter, C. ; Purchase, H. ; Bouatouch, K. (Hrsg.) ; Hurter, C. ; Purchase, H. ; Bouatouch, K. (Hrsg.): Proceedings of the 17th International Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, Proceedings of the 17th International Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP : SciTePress, 2022 — ISBN 978-989-758-555-5, S. 103--112
BibTeX
Frey, Steffen ; Bruder, Valentin ; Frieß, Florian ; Gralka, Patrick ; Rau, Tobias ; Ertl, Thomas ; Reina, Guido: Parameter Adaptation In Situ: Design Impacts and Trade-Offs. In: Childs, H. ; Bennett, J. C. ; Garth, C. (Hrsg.) ; Childs, H. ; Bennett, J. C. ; Garth, C. (Hrsg.): In Situ Visualization for Computational Science, In Situ Visualization for Computational Science. Cham : Springer International Publishing, 2022 — ISBN 978-3-030-81627-8, S. 159--182
BibTeX
Garkov, Dimitar ; Müller, Christoph ; Braun, Matthias ; Weiskopf, Daniel ; Schreiber, Falk: Research Data Curation in Visualization: Position Paper. In: Sedlmair, M. (Hrsg.) ; Sedlmair, M. (Hrsg.): Proceedings of the Ninth Workshop on Evaluation and BEyond - methodoLogIcal approaches for Visualization (BELIV), Proceedings of the Ninth Workshop on Evaluation and BEyond - methodoLogIcal approaches for Visualization (BELIV), 2022
Abstract
Research data curation is the act of carefully preparing research data and artifacts for sharing and long-term preservation. Research data management is centrally implemented and formally defined in a data management plan to enable data curation. In tandem, data curation and management facilitate research repeatability. In contrast to other research fields, data curation and management in visualization are not yet part of the researcher’s compendium. In this position paper, we discuss the unique challenges visualization faces and propose how data curation can be practically realized. We share eight lessons learned in managing data in two large research consortia, outline the larger curation workflow, and define the typical roles. We complement our lessons with minimum criteria for selecting a suitable data repository and five challenging scenarios that occur in practice. We conclude with a vision of how the visualization research community can pave the way for new curation standards.BibTeX
Gebhardt, Patrick ; Yu, Xingyao ; Köhn, Andreas ; Sedlmair, Michael: MolecuSense: Using Force-Feedback Gloves for Creating and Interacting with Ball-and-Stick Molecules in VR. In: Proceedings of the 15th International Symposium on Visual Information Communication and Interaction, Proceedings of the 15th International Symposium on Visual Information Communication and Interaction. Chur, Switzerland : Association for Computing Machinery, 2022 — ISBN 9781450398060, S. 1–5
Abstract
We contribute MolecuSense, a virtual version of a physical molecule construction kit, based on visualization in Virtual Reality (VR) and interaction with force-feedback gloves. Targeting at chemistry education, our goal is to make virtual molecule structures more tangible. Results of an initial user study indicate that the VR molecular construction kit was positively received. Compared to a physical construction kit, the VR molecular construction kit is on the same level in terms of natural interaction. Besides, it fosters the typical digital advantages though, such as saving, exporting, and sharing of molecules. Feedback from the study participants has also revealed potential future avenues for tangible molecule visualizations.BibTeX
Heyen, Frank ; Aygün, Dilara ; Sedlmair, Michael: A Web-Based MIDI Controller for Music Live Coding (2022)
Abstract
We contribute an interactive visual frontend to live coding environments, which allows live coders and performers to influence the behavior of their code more quickly and efficiently. Users can trigger actions and change parameters via instruments, buttons, and sliders, instead of only inside the code. For instance, toggling a loop or controlling a fading effect through mouse or touch interaction on a screen is faster than editing code. While this kind of control has already been possible with hardware MIDI devices, we provide a more accessible, easy-to-use, and customizable alternative that only requires a web browser. With examples, we show how users perform live-coded music faster and more easily with our design compared to using pure code.BibTeX
Heyen, Frank ; Kohler, Yannik ; Triebener, Sebastian ; Rigling, Sebastian ; Sedlmair, Michael: Immersive Visual Analysis of Cello Bow Movements (2022)
Abstract
We propose a 3D immersive visualization environment for analyzing the right hand movements of a cello player. To achieve this, we track the position and orientation of the cello bow and record audio. As movements mostly occur in a shallow volume and the motion is therefore mostly two-dimensional, we use the third dimension to encode time. Our concept further explores various mappings from motion and audio data to spatial and other visual attributes. We work in close cooperation with a cellist and plan to evaluate our prototype through a user study with a group of cellists in the near future.BibTeX
Heyen, Frank ; Ngo, Quynh Quang ; Kurzhals, Kuno ; Sedlmair, Michael: Data-Driven Visual Reflection on Music Instrument Practice. In: ACM CHI Workshop on Intelligent Music Interfaces (IMI), ACM CHI Workshop on Intelligent Music Interfaces (IMI) : ACM, 2022
Abstract
We propose a data-driven approach to music instrument practice that allows studying patterns and long-term trends through visualization. Inspired by life logging and fitness tracking, we imagine musicians to record their practice sessions over the span of months or years. The resulting data in the form of MIDI or audio recordings can then be analyzed sporadically to track progress and guide decisions. Toward this vision, we started exploring various visualization designs together with a group of nine guitarists, who provided us with data and feedback over the course of three months.BibTeX
Heyen, Frank ; Sedlmair, Michael: Augmented Reality Visualization for Musical Instrument Learning (2022)
Abstract
We contribute two design studies for augmented reality visualizations that support learning musical instruments. First, we designed simple, glanceable encodings for drum kits, which we display through a projector. As second instrument, we chose guitar and designed visualizations to be displayed either on a screen as an augmented mirror or an an optical see-through AR headset. These modalities allow us to also show information around the instrument and in 3D. We evaluated our prototypes through case studies and our results demonstrate the general effectivity and revealed design-related and technical limitations.BibTeX
Hube, Natalie ; Vidačković, Krešimir ; Sedlmair, Michael: Using Expressive Avatars to Increase Emotion Recognition: A Pilot Study. In: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHIEA’22), Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHIEA’22). New York, NY, USA : Association for Computing Machinery, 2022
BibTeX
Huth, Franziska ; Blascheck, Tanja ; Koch, Steffen ; Ertl, Thomas: Animated Transitions for Small-Scale Visualizations. In: 15th International Symposium on Visual Information Communication and Interaction, 15th International Symposium on Visual Information Communication and Interaction. Chur, Switzerland : Association for Computing Machinery, 2022 — ISBN 9781450398060, S. 8
Abstract
When visualizations are used to augment text, geographical information on a map, or on mobile devices, there often is not enough space to show complex data with approaches like juxtaposed visualizations or coordinated views. To alleviate this issue, we propose the use of animated transitions between several small-scale visualizations. We discuss design considerations for animated transitions in small-scale visualizations. We further present the results of a study on the effectiveness of those animated transitions in conveying information and attribute relations, and the mental load of following the animated transitions.BibTeX
Huth, Franziska ; Kaminski, Lukas ; Grioui, Fairouz ; Blascheck, Tanja: Online Study on Reading Behavior of Data-Rich Texts with Integrated Word-Scale Visualizations. In: Postersession at the IEEE Conference on Visualization, Postersession at the IEEE Conference on Visualization, 2022. — Reviewed Poster
BibTeX
Hägele, David ; Krake, Tim ; Weiskopf, Daniel: Uncertainty-Aware Multidimensional Scaling. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. Bd. 29 (2022), Nr. 1, S. 1–10
Abstract
We present an extension of multidimensional scaling (MDS) to uncertain data, facilitating uncertainty visualization of multidimensional data. Our approach uses local projection operators that map high-dimensional random vectors to low-dimensional space to formulate a generalized stress. In this way, our generic model supports arbitrary distributions and various stress types. We use our uncertainty-aware multidimensional scaling (UAMDS) concept to derive a formulation for the case of normally distributed random vectors and a squared stress. The resulting minimization problem is numerically solved via gradient descent. We complement UAMDS by additional visualization techniques that address the sensitivity and trustworthiness of dimensionality reduction under uncertainty. With several examples, we demonstrate the usefulness of our approach and the importance of uncertainty-aware techniques.BibTeX
Hägele, David ; Schulz, Christoph ; Beschle, Cedric ; Booth, Hannah ; Butt, Miriam ; Barth, Andrea ; Deussen, Oliver ; Weiskopf, Daniel: Uncertainty Visualization: Fundamentals and Recent Developments. In: it - Information Technology, it - Information Technology. Bd. 64 (2022), Nr. 4–5, S. 121–132
Abstract
This paper provides a brief overview of uncertainty visualization along with some fundamental considerations on uncertainty propagation and modeling. Starting from the visualization pipeline, we discuss how the different stages along this pipeline can be affected by uncertainty and how they can deal with this and propagate uncertainty information to subsequent processing steps. We illustrate recent advances in the field with a number of examples from a wide range of applications: uncertainty visualization of hierarchical data, multivariate time series, stochastic partial differential equations, and data from linguistic annotation.BibTeX
Islam, Alaul ; Aravind, Ranjini ; Blascheck, Tanja ; Bezerianos, Anastasia ; Isenberg, Petra: Preferences and Effectiveness of Sleep Data Visualizations for Smartwatches and Fitness Bands. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems : ACM, 2022
BibTeX
Islam, Alaul ; Blascheck, Tanja ; Isenberg, Petra: Context Specific Visualizations on Smartwatches. In: EUROVIS 2022 - Posters, EUROVIS 2022 - Posters : The Eurographics Association, 2022, S. 67–69
BibTeX
Islam, Alaul ; Yao, Lijie ; Bezerianos, Anastasia ; Blascheck, Tanja ; He, Tingying ; Lee, Bongshin ; Vuillemot, Romain ; Isenberg, Petra: Reflections on Visualization in Motion for Fitness Trackers. In: MobileHCI’22: Workshop on New Trends in HCI and Sports, MobileHCI’22: Workshop on New Trends in HCI and Sports : CEUR Workshop Proceedings, 2022, S. 1–14
BibTeX
Jahedi, Azin ; Mehl, Lukas ; Rivinius, Marc ; Bruhn, Andrés: Multi-Scale RAFT: combining hierarchical concepts for learning-based optical flow estimation. In: IEEE International Conference on Image Processing (ICIP), IEEE International Conference on Image Processing (ICIP), 2022
Abstract
Many classical and learning-based optical flow methods rely on hierarchical concepts to improve both accuracy and robustness. However, one of the currently most successful approaches -- RAFT -- hardly exploits such concepts. In this work, we show that multi-scale ideas are still valuable. More precisely, using RAFT as a baseline, we propose a novel multi-scale neural network that combines several hierarchical concepts within a single estimation framework. These concepts include (i) a partially shared coarse-to-fine architecture, (ii) multi-scale features, (iii) a hierarchical cost volume and (iv) a multi-scale multi-iteration loss. Experiments on MPI Sintel and KITTI clearly demonstrate the benefits of our approach. They show not only substantial improvements compared to RAFT, but also state-of-the-art results -- in particular in non-occluded regions.BibTeX
Klein, Karsten ; Sedlmair, Michael ; Schreiber, Falk: Immersive Analytics: An Overview. In: it - Information Technology, it - Information Technology. Bd. 64 (2022), Nr. 4–5, S. 155–168
Abstract
Immersive Analytics is concerned with the systematic examination of the benefits and challenges of using immersive environments for data analysis, and the development of corresponding designs that improve the quality and efficiency of the analysis process. While immersive technologies are now broadly available, practical solutions haven’t received broad acceptance in real-world applications outside of several core areas, and proper guidelines on the design of such solutions are still under development. Both fundamental research and applications bring together topics and questions from several fields, and open a wide range of directions regarding underlying theory, evidence from user studies, and practical solutions tailored towards the requirements of application areas. We give an overview on the concepts, topics, research questions, and challenges.BibTeX
Klötzl, Daniel ; Krake, Tim ; Zhou, Youjia ; Hotz, Ingrid ; Wang, Bei ; Weiskopf, Daniel: Local bilinear computation of Jacobi sets. In: The Visual Computer, The Visual Computer. Bd. 38 (2022), S. 3435–3448
Abstract
We propose a novel method for the computation of Jacobi sets in 2D domains. The Jacobi set is a topological descriptor based on Morse theory that captures gradient alignments among multiple scalar fields, which is useful for multi-field visualization. Previous Jacobi set computations use piecewise linear approximations on triangulations that result in discretization artifacts like zig-zag patterns. In this paper, we utilize a local bilinear method to obtain a more precise approximation of Jacobi sets by preserving the topology and improving the geometry. Consequently, zig-zag patterns on edges are avoided, resulting in a smoother Jacobi set representation. Our experiments show a better convergence with increasing resolution compared to the piecewise linear method. We utilize this advantage with an efficient local subdivision scheme. Finally, our approach is evaluated qualitatively and quantitatively in comparison with previous methods for different mesh resolutions and across a number of synthetic and real-world examples.BibTeX
Klötzl, Daniel ; Krake, Tim ; Zhou, Youjia ; Stober, Jonathan ; Schulte, Kathrin ; Hotz, Ingrid ; Wang, Bei ; Weiskopf, Daniel: Reduced Connectivity for Local Bilinear Jacobi Sets. In: : IEEE, 2022 — ISBN 978-1-6654-9354-3, S. 39–48
Abstract
We present a new topological connection method for the local bilinear computation of Jacobi sets that improves the visual representation while preserving the topological structure and geometric configuration. To this end, the topological structure of the local bilinear method is utilized, which is given by the nerve complex of the traditional piecewise linear method. Since the nerve complex consists of higher-dimensional simplices, the local bilinear method (visually represented by the 1-skeleton of the nerve complex) leads to clutter via crossings of line segments. Therefore, we propose a homotopy-equivalent representation that uses different collapses and edge contractions to remove such artifacts. Our new connectivity method is easy to implement, comes with only little overhead, and results in a less cluttered representation.BibTeX
Knittel, Johannes ; Koch, Steffen ; Tang, Tan ; Chen, Wei ; Wu, Yingcai ; Liu, Shixia ; Ertl, Thomas: Real-Time Visual Analysis of High-Volume Social Media Posts. In: IEEE Transactions on Visualization & Computer Graphics, IEEE Transactions on Visualization & Computer Graphics. Bd. 28. Los Alamitos, CA, USA, IEEE Computer Society (2022), Nr. 01, S. 879–889
BibTeX
Koch, Maurice ; Weiskopf, Daniel ; Kurzhals, Kuno: A Spiral into the Mind: Gaze Spiral Visualization for Mobile Eye Tracking. In: Proceedings of the ACM on Computer Graphics and Interactive Techniques, Proceedings of the ACM on Computer Graphics and Interactive Techniques. Bd. 5. New York, NY, USA, Association for Computing Machinery (2022), Nr. 2
Abstract
Comparing mobile eye tracking data from multiple participants without information about areas of interest (AOIs) is challenging because of individual timing and coordinate systems. We present a technique, the gaze spiral, that visualizes individual recordings based on image content of the stimulus. The spiral layout of the slitscan visualization is used to create a compact representation of scanpaths. The visualization provides an overview of multiple recordings even for long time spans and helps identify and annotate recurring patterns within recordings. The gaze spirals can also serve as glyphs that can be projected to 2D space based on established scanpath metrics in order to interpret the metrics and identify groups of similar viewing behavior. We present examples based on two egocentric datasets to demonstrate the effectiveness of our approach for annotation and comparison tasks. Our examples show that the technique has the potential to let users compare even long-term recordings of pervasive scenarios without manual annotation.BibTeX
Krake, Tim ; Bruhn, Andrés ; Eberhardt, Bernhard ; Weiskopf, Daniel: Efficient and Robust Background Modeling with Dynamic Mode Decomposition. In: Journal of Mathematical Imaging and Vision (2022), Journal of Mathematical Imaging and Vision (2022). (2022)
Abstract
A large number of modern video background modeling algorithms deal with computational costly minimization problems that often need parameter adjustments. While in most cases spatial and temporal constraints are added artificially to the minimization process, our approach is to exploit Dynamic Mode Decomposition (DMD), a spectral decomposition technique that naturally extracts spatio-temporal patterns from data. Applied to video data, DMD can compute background models. However, the original DMD algorithm for background modeling is neither efficient nor robust. In this paper, we present an equivalent reformulation with constraints leading to a more suitable decomposition into fore- and background. Due to the reformulation, which uses sparse and low-dimensional structures, an efficient and robust algorithm is derived that computes accurate background models. Moreover, we show how our approach can be extended to RGB data, data with periodic parts, and streaming data enabling a versatile use.BibTeX
Krake, Tim ; Klötzl, Daniel ; Eberhardt, Bernhard ; Weiskopf, Daniel: Constrained Dynamic Mode Decomposition. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022), S. 1–11
Abstract
Frequency-based decomposition of time series data is used in many visualization applications. Most of these decomposition methods (such as Fourier transform or singular spectrum analysis) only provide interaction via pre- and post-processing, but no means to influence the core algorithm. A method that also belongs to this class is Dynamic Mode Decomposition (DMD), a spectral decomposition method that extracts spatio-temporal patterns from data. In this paper, we incorporate frequency-based constraints into DMD for an adaptive decomposition that leads to user-controllable visualizations, allowing analysts to include their knowledge into the process. To accomplish this, we derive an equivalent reformulation of DMD that implicitly provides access to the eigenvalues (and therefore to the frequencies) identified by DMD. By utilizing a constrained minimization problem customized to DMD, we can guarantee the existence of desired frequencies by minimal changes to DMD. We complement this core approach by additional techniques for constrained DMD to facilitate explorative visualization and investigation of time series data. With several examples, we demonstrate the usefulness of constrained DMD and compare it to conventional frequency-based decomposition methods.BibTeX
Krake, Tim ; von Scheven, Malte ; Gade, Jan ; Abdelaal, Moataz ; Weiskopf, Daniel ; Bischoff, Manfred: Efficient Update of Redundancy Matrices for Truss and Frame Structures. In: Journal of Theoretical, Computational and Applied Mechanics, Journal of Theoretical, Computational and Applied Mechanics. (2022)
Abstract
Redundancy matrices provide insights into the load carrying behavior of statically indeterminate structures. This information can be employed for the design and analysis of structures with regard to certain objectives, for example reliability, robustness, or adaptability. In this context, the structure is often iteratively examined with the help of slight adjustments. However, this procedure generally requires a high computational effort for the recalculation of the redundancy matrix due to the necessity of costly matrix operations. This paper addresses this problem by providing generic algebraic formulations for efficiently updating the redundancy matrix (and related matrices). The formulations include various modifications like adding, removing, and exchanging elements and are applicable to truss and frame structures. With several examples, we demonstrate the interaction between the formulas and their mechanical interpretation. Finally, a performance test for a scaleable structure is presented.BibTeX
Mayr, Eva ; Windhager, Florian ; Liem, Johannes ; Beck, Samuel ; Koch, Steffen ; Kusnick, Jakob ; Jänicke, Stefan: The Multiple Faces of Cultural Heritage: Towards an Integrated Visualization Platform for Tangible and Intangible Cultural Assets. In: 2022 IEEE 7th Workshop on Visualization for the Digital Humanities (VIS4DH), 2022 IEEE 7th Workshop on Visualization for the Digital Humanities (VIS4DH), 2022, S. 13–18
Abstract
Linking and visualizing multiple types of entities in a DH knowledge graph generates the need to deal with multiple types of data and media modalities both on the designer and the user side. The InTaVia project develops synoptic visual representations for a multimodal historical knowledge graph which draws together transnational data about cultural objects and historical actors. In this paper we reflect on the question how to integrate and mediate the informational and visual affordances of both kinds of cultural data with hybrid designs and show how a user-centered design process can help to ground the required selections and design choices in an empirical procedure.BibTeX
Munz, Tanja ; Väth, Dirk ; Kuznecov, Paul ; Vu, Ngoc Thang ; Weiskopf, Daniel: Visualization-based improvement of neural machine translation. In: Computers & Graphics, Computers & Graphics. Bd. 103 (2022), S. 45–60
Abstract
We introduce a novel visual-interactive approach for analyzing, understanding, and correcting neural machine translation. Our system supports users in automatically translating documents using neural machine translation and identifying and correcting possible erroneous translations. User corrections can then be used to fine-tune the neural machine translation model and automatically improve the whole document. While translation results of neural machine translation can be impressive, there are still many challenges such as over- and under-translation, domain-specific terminology, and handling long sentences, making it necessary for users to verify translation results. Our system aims at supporting users in this task. Our visual analytics approach combines several visualization techniques in an interactive system. A parallel coordinates plot with multiple metrics related to translation quality can be used to find, filter, and select translations that might contain errors. An interactive beam search visualization and graph- or matrix-based visualizations for attention weights can be used for post-editing and understanding machine-generated translations. The machine translation model is updated from user corrections to improve the translation quality of the whole document. We designed our approach for an LSTM-based translation model and extended it to also include the Transformer architecture. We show for representative examples possible mistranslations and how to use our system to deal with them. A user study revealed that many participants favor such a system over manual text-based translation, especially for translating large documents. Furthermore, we performed quantitative computer-based experiments that show that our system can be used to improve translation quality and reduce post-editing efforts for domain-specific documents.BibTeX
Müller, Christoph ; Heinemann, Moritz ; Weiskopf, Daniel ; Ertl, Thomas: Power Overwhelming: Quantifying the Energy Cost of Visualisation. In: Proceedings of the 2022 IEEE Workshop on Evaluation and Beyond - Methodological Approaches for Visualization, Proceedings of the 2022 IEEE Workshop on Evaluation and Beyond - Methodological Approaches for Visualization, 2022, S. 38–46
BibTeX
Ngo, Quynh Quang ; Dennig, Frederik L. ; Keim, Daniel A. ; Sedlmair, Michael: Machine Learning Meets Visualization – Experiences and Lessons Learned. In: it - Information Technology, it - Information Technology. Bd. 64 (2022), Nr. 4–5, S. 169–180
Abstract
In this article, we discuss how Visualization (VIS) with Machine Learning (ML) could mutually benefit from each other. We do so through the lens of our own experience working at this intersection for the last decade. Particularly we focus on describing how VIS supports explaining ML models and aids ML-based Dimensionality Reduction techniques in solving tasks such as parameter space analysis. In the other direction, we discuss approaches showing how ML helps improve VIS, such as applying ML-based automation to improve visualization design. Based on the examples and our own perspective, we describe a number of open research challenges that we frequently encountered in our endeavors to combine ML and VIS.BibTeX
Philipp, Markus ; Bacher, Neal ; Sauer, Stefan ; Mathis-Ullrich, Franziska ; Bruhn, Andrés: From Chairs To Brains: Customizing Optical Flow For Surgical Activity Localization. In: 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI) : IEEE, 2022, S. 1–5
Abstract
Recent approaches for surgical activity localization rely on motion features derived from the optical flow (OF). However, although they consider state-of-the-art CNNs when computing the OF, they typically resort to pre-trained implementations which are domain-unaware. We address this problem in two ways: (i) Using the pre-trained OF-CNN of recent localization approach, we analyze the impact of video properties such as reflections, motion and blur on the quality of the OF from neurosurgical data. (ii) Based on this analysis, we design a specifically tailored synthetic training dataset which allows us to customize the pre-trained OF-CNN for surgical activity localization. Our evaluation clearly shows the benefit of this customization approach. It not only leads to an improved accuracy of the OF itself but, even more importantly, also to an improved performance for the actual localization task.BibTeX
Rau, Simeon ; Heyen, Frank ; Wagner, Stefan ; Sedlmair, Michael: Visualization for AI-Assisted Composing. In: Proceedings of the 23rd International Society for Music Information Retrieval Conference, Proceedings of the 23rd International Society for Music Information Retrieval Conference : ISMIR, 2022, S. 151–159
Abstract
We propose a visual approach for interactive, AI-assisted composition that serves as a compromise between fully automatic and fully manual composition. Instead of generating a whole piece, the AI takes on the role of an assistant that generates short melodies for the composer to choose from and adapt. In an iterative process, the composer queries the AI for continuations or alternative fill-ins, chooses a suggestion, and adds it to the piece. As listening to many suggestions would take time, we explore different ways to visualize them, to allow the composer to focus on the most interesting-looking melodies. We also present the results of a qualitative evaluation with five composers.BibTeX
Richer, Gaëlle ; Pister, Alexis ; Abdelaal, Moataz ; Fekete, Jean-Daniel ; Sedlmair, Michael ; Weiskopf, Daniel: Scalability in Visualization. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022), S. 1–15
Abstract
We introduce a conceptual model for scalability designed for visualization research. With this model, we systematically analyze over 120 visualization publications from 1990 to 2020 to characterize the different notions of scalability in these works. While many papers have addressed scalability issues, our survey identifies a lack of consistency in the use of the term in the visualization research community. We address this issue by introducing a consistent terminology meant to help visualization researchers better characterize the scalability aspects in their research. It also helps in providing multiple methods for supporting the claim that a work is “scalable.” Our model is centered around an effort function with inputs and outputs. The inputs are the problem size and resources, whereas the outputs are the actual efforts, for instance, in terms of computational run time or visual clutter. We select representative examples to illustrate different approaches and facets of what scalability can mean in visualization literature. Finally, targeting the diverse crowd of visualization researchers without a scalability tradition, we provide a set of recommendations for how scalability can be presented in a clear and consistent way to improve fair comparison between visualization techniques and systems and foster reproducibility.BibTeX
Rodrigues, Nils ; Schulz, Christoph ; Doring, Soren ; Baumgartner, Daniel ; Krake, Tim ; Weiskopf, Daniel: Relaxed Dot Plots: Faithful Visualization of Samples and Their Distribution. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022), S. 59:1-59:7
Abstract
We introduce relaxed dot plots as an improvement of nonlinear dot plots for unit visualization. Our plots produce more faithful data representations and reduce moire´ effects. Their contour is based on a customized kernel frequency estimation to match the shape of the distribution of underlying data values. Previous nonlinear layouts introduce column-centric nonlinear scaling of dot diameters for visualization of high-dynamic-range data with high peaks. We provide a mathematical approach to convert that column-centric scaling to our smooth envelope shape. This formalism allows us to use linear, root, and logarithmic scaling to find ideal dot sizes. Our method iteratively relaxes the dot layout for more correct and aesthetically pleasing results. To achieve this, we modified Lloyd's algorithm with additional constraints and heuristics. We evaluate the layouts of relaxed dot plots against a previously existing nonlinear variant and show that our algorithm produces less error regarding the underlying data while establishing the blue noise property that works against moire´ effects. Further, we analyze the readability of our relaxed plots in three crowd-sourced experiments. The results indicate that our proposed technique surpasses traditional dot plots.BibTeX
Rodrigues, Nils ; Shao, Lin ; Yan, Jia Jun ; Schreck, Tobias ; Weiskopf, Daniel: Eye Gaze on Scatterplot: Concept and First Results of Recommendations for Exploration of SPLOMs Using Implicit Data Selection. In: 2022 Symposium on Eye Tracking Research and Applications, 2022 Symposium on Eye Tracking Research and Applications. Seattle, WA, USA : Association for Computing Machinery, 2022 — ISBN 9781450392525, S. 59:1-59:7
Abstract
We propose a three-step concept and visual design for supporting the visual exploration of high-dimensional data in scatterplots through eye-tracking. First, we extract subsets in the underlying data using existing classifications, automated clustering algorithms, or eye-tracking. For the latter, we map gaze to the underlying data dimensions in the scatterplot. Clusters of data points that have been the focus of the viewers’ gaze are marked as clusters of interest (eye-mind hypothesis). In a second step, our concept extracts various properties from statistics and scagnostics from the clusters. The third step uses these measures to compare the current data clusters from the main scatterplot to the same data in other dimensions. The results enable analysts to retrieve similar or dissimilar views as guidance to explore the entire data set. We provide a proof-of-concept implementation as a test bench and describe a use case to show a practical application and initial results.BibTeX
Schmalfuss, Jenny ; Mehl, Lukas ; Bruhn, Andrés: Attacking Motion Estimation with Adversarial Snow. In: Proc. ECCV Workshop on Adversarial Robustness in the Real World (AROW), Proc. ECCV Workshop on Adversarial Robustness in the Real World (AROW), 2022
Abstract
Current adversarial attacks for motion estimation (optical flow) optimize small per-pixel perturbations, which are unlikely to appear in the real world. In contrast, we exploit a real-world weather phenomenon for a novel attack with adversarially optimized snow. At the core of our attack is a differentiable renderer that consistently integrates photorealistic snowflakes with realistic motion into the 3D scene. Through optimization we obtain adversarial snow that significantly impacts the optical flow while being indistinguishable from ordinary snow. Surprisingly, the impact of our novel attack is largest on methods that previously showed a high robustness to small L_p perturbations.BibTeX
Schmalfuss, Jenny ; Scholze, Philipp ; Bruhn, Andrés: A Perturbation-Constrained Adversarial Attack for Evaluating the Robustness of Optical Flow. In: Proceedings of the European Conference on Computer Vision (ECCV), Proceedings of the European Conference on Computer Vision (ECCV), 2022
Abstract
Recent optical flow methods are almost exclusively judged in terms of accuracy, while their robustness is often neglected. Although adversarial attacks offer a useful tool to perform such an analysis, current attacks on optical flow methods focus on real-world attacking scenarios rather than a worst case robustness assessment. Hence, in this work, we propose a novel adversarial attack - the Perturbation-Constrained Flow Attack (PCFA) - that emphasizes destructivity over applicability as a real-world attack. PCFA is a global attack that optimizes adversarial perturbations to shift the predicted flow towards a specified target flow, while keeping the L2 norm of the perturbation below a chosen bound. Our experiments demonstrate PCFA's applicability in white- and black-box settings, and show it finds stronger adversarial samples than previous attacks. Based on these strong samples, we provide the first joint ranking of optical flow methods considering both prediction quality and adversarial robustness, which reveals state-of-the-art methods to be particularly vulnerable.BibTeX
Schäfer, Peter ; Rodrigues, Nils ; Weiskopf, Daniel ; Storandt, Sabine: Group Diagrams for Simplified Representation of Scanpaths. In: Proceedings of the ACM Symposium on Visual Information Communication and Interaction (VINCI), Proceedings of the ACM Symposium on Visual Information Communication and Interaction (VINCI) : ACM, 2022
Abstract
We instrument Group Diagrams (GDs) to reduce clutter in sets
of eye-tracking scanpaths. Group Diagrams consist of trajectory
subsets that cover, or represent, the whole set of trajectories with
respect to some distance measure and an adjustable distance threshold.
The original GDs allow for an application of various distance
measures. We implement the GD framework and evaluate it on
scanpaths that were collected by a former user study on public transit
maps. We find that the Fréchet distance is the most appropriate
measure to get meaningful results, yet it is flexible enough to cover
outliers.We discuss several implementation-specific challenges and
improve the scalability of the algorithm.BibTeX
Skreinig, Lucchas Ribeiro ; Stanescu, Ana ; Mori, Shohei ; Heyen, Frank ; Mohr, Peter ; Sedlmair, Michael ; Schmalstieg, Dieter ; Kalkofen, Denis: AR Hero: Generating Interactive Augmented Reality Guitar Tutorials. In: 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)., IEEE (2022)
Abstract
We introduce a system capable of generating interactive Augmented Reality guitar tutorials by parsing common digital guitar tablature and by capturing the performance of an expert using a multi-camera array. Instructions are presented to the user in an Augmented Reality application using either an abstract visualization, a 3D virtual hand, or a 3D video. To support individual users at different skill levels the system provides full control of the playback of a tutorial, including its speed and looping behavior, while delivering live feedback on the user’s performance.BibTeX
Sousa Calepso, Aimée ; Hube, Natalie ; Berenguel Senn, Noah ; Brandt, Vincent ; Sedlmair, Michael: cARdLearner: Using expressive Virtual Agents when learning vocabulary in Augmented Reality : ACM, 2022
Abstract
Augmented reality (AR) has a diverse range of applications, including language teaching. When studying a foreign language, one of the biggest challenges learners face is memorizing new vocabulary. While augmented holograms are a promising means of supporting this memorization process, few studies have explored their potential in the language learning context. We demonstrate the possibility of using flashcard along with an expressive holographic agent on vocabulary learning. Users scan a flashcard and play an animation that is connected with an emotion related to the word they are seeing. Our goal is to propose an alternative to the traditional use of flashcards, and also introduce another way of using AR in the association process.BibTeX
Straub, Alexander ; Boblest, Sebastian ; Karch, Grzegorz K. ; Sadlo, Filip ; Ertl, Thomas: Droplet-Local Line Integration for Multiphase Flow. In: 2022 IEEE Visualization and Visual Analytics (VIS), 2022 IEEE Visualization and Visual Analytics (VIS), 2022 — ISBN 978-1-6654-8812-9, S. 135–139
Abstract
Line integration of stream-, streak-, and pathlines is widely used and popular for visualizing single-phase flow. In multiphase flow, i.e., where the fluid consists, e.g., of a liquid and a gaseous phase, these techniques could also provide valuable insights into the internal flow of droplets and ligaments and thus into their dynamics. However, since such structures tend to act as entities, high translational and rotational velocities often obfuscate their detail. As a remedy, we present a method for deriving a droplet-local velocity field, using a decomposition of the original velocity field removing translational and rotational velocity parts, and adapt path- and streaklines. Generally, the resulting integral lines are thus shorter and less tangled, which simplifies their analysis. We demonstrate and discuss the utility of our approach on droplets in two-phase flow data and visualize the removed velocity parts employing glyphs for context.BibTeX
Tarner, H. ; Bruder, V. ; Ertl, T. ; Frey, S. ; Beck, F.: Visually Comparing Rendering Performance from Multiple Perspectives. In: Bender, J. ; Botsch, M. ; Keim, D. (Hrsg.) ; Bender, J. ; Botsch, M. ; Keim, D. (Hrsg.): Vision, Modeling, and Visualization, Vision, Modeling, and Visualization : The Eurographics Association, 2022
Abstract
Evaluation of rendering performance is crucial when selecting or developing algorithms, but challenging as performance can largely differ across a set of selected scenarios. Despite this, performance metrics are often reported and compared in a highly aggregated way. In this paper we suggest a more fine-grained approach for the evaluation of rendering performance, taking into account multiple perspectives on the scenario: camera position and orientation along different paths, rendering algorithms, image resolution, and hardware. The approach comprises a visual analysis system that shows and contrasts the data from these perspectives. The users can explore combinations of perspectives and gain insight into the performance characteristics of several rendering algorithms. A stylized representation of the camera path provides a base layout for arranging the multivariate performance data as radar charts, each comparing the same set of rendering algorithms while linking the performance data with the rendered images. To showcase our approach, we analyze two types of scientific visualization benchmarks.BibTeX
Wang, Yao ; Bâce, Mihai ; Bulling, Andreas: Scanpath Prediction on Information Visualisations, 2022
Abstract
We propose Unified Model of Saliency and Scanpaths (UMSS) -- a model that learns to predict visual saliency and scanpaths (i.e. sequences of eye fixations) on information visualisations. Although scanpaths provide rich information about the importance of different visualisation elements during the visual exploration process, prior work has been limited to predicting aggregated attention statistics, such as visual saliency. We present in-depth analyses of gaze behaviour for different information visualisation elements (e.g. Title, Label, Data) on the popular MASSVIS dataset. We show that while, overall, gaze patterns are surprisingly consistent across visualisations and viewers, there are also structural differences in gaze dynamics for different elements. Informed by our analyses, UMSS first predicts multi-duration element-level saliency maps, then probabilistically samples scanpaths from them. Extensive experiments on MASSVIS show that our method consistently outperforms state-of-the-art methods with respect to several, widely used scanpath and saliency evaluation metrics. Our method achieves a relative improvement in sequence score of 11.5% for scanpath prediction, and a relative improvement in Pearson correlation coefficient of up to 23.6% for saliency prediction. These results are auspicious and point towards richer user models and simulations of visual attention on visualisations without the need for any eye tracking equipment.BibTeX
Wang, Yao ; Jiao, Chuhan ; Bâce, Mihai ; Bulling, Andreas: VisRecall: Quantifying Information Visualisation Recallability Via Question Answering. In: IEEE Transactions on Visualization and Computer Graphics, IEEE Transactions on Visualization and Computer Graphics. (2022), S. 1–12
Abstract
Despite its importance for assessing the effectiveness of communicating information visually, fine-grained recallability of information visualisations has not been studied quantitatively so far. In this work, we propose a question-answering paradigm to study visualisation recallability and present VisRecall - a novel dataset consisting of 200 visualisations that are annotated with crowd-sourced human (N = 305) recallability scores obtained from 1,000 questions of five question types. Furthermore, we present the first computational method to predict recallability of different visualisation elements, such as the title or specific data values. We report detailed analyses of our method on VisRecall and demonstrate that it outperforms several baselines in overall recallability and FE-, F-, RV-, and U-question recallability. Our work makes fundamental contributions towards a new generation of methods to assist designers in optimising visualisations.BibTeX
Wang, Yao ; Koch, Maurice ; Bâce, Mihai ; Weiskopf, Daniel ; Bulling, Andreas: Impact of Gaze Uncertainty on AOIs in Information Visualisations. In: 2022 Symposium on Eye Tracking Research and Applications, 2022 Symposium on Eye Tracking Research and Applications : ACM, 2022, S. 1–6
Abstract
Gaze-based analysis of areas of interest (AOI) is widely used in information visualisation research to understand how people explore visualisations or assess the quality of visualisations concerning key characteristics such as memorability. However, nearby AOIs in visualisations amplify the uncertainty caused by the gaze estimation error, which strongly influences the mapping between gaze samples or fixations and different AOIs. We contribute a novel investigation into gaze uncertainty and quantify its impact on AOI-based analysis on visualisations using two novel metrics: the Flipping Candidate Rate (FCR) and Hit Any AOI Rate (HAAR). Our analysis of 40 real-world visualisations, including human gaze and AOI annotations, shows that uncertainty commonly appears in visualisations, which significantly impacts the analysis conducted in AOI-based studies. Moreover, we analysed four visualisation types and found that bar and scatter plots are commonly designed in a way that causes more uncertainty than line and pie plots in gaze-based analysis.BibTeX
Weiskopf, Daniel: Uncertainty Visualization: Concepts, Methods, and Applications in Biological Data Visualization. In: Frontiers in Bioinformatics, Frontiers in Bioinformatics. Bd. 2 (2022)
Abstract
This paper provides an overview of uncertainty visualization in general, along with specific examples of applications in bioinformatics. Starting from a processing and interaction pipeline of visualization, components are discussed that are relevant for handling and visualizing uncertainty introduced with the original data and at later stages in the pipeline, which shows the importance of making the stages of the pipeline aware of uncertainty and allowing them to propagate uncertainty. We detail concepts and methods for visual mappings of uncertainty, distinguishing between explicit and implict representations of distributions, different ways to show summary statistics, and combined or hybrid visualizations. The basic concepts are illustrated for several examples of graph visualization under uncertainty. Finally, this review paper discusses implications for the visualization of biological data and future research directions.BibTeX
Wieland, Markus ; Machulla, Tonja: Towards Inclusive Conversations in Virtual Reality for People with Visual Impairments, Gesellschaft für Informatik e.V. (2022)
BibTeX
Wieland, Markus ; Thevin, Lauren ; Schmidt, Albrecht ; Machulla, Tonja: Non-verbal Communication and Joint Attention Between People with and Without Visual Impairments: Deriving Guidelines for Inclusive Conversations in Virtual Realities. In: Miesenberger, K. ; Kouroupetroglou, G. ; Mavrou, K. ; Manduchi, R. ; Covarrubias Rodriguez, M. ; Penáz, P. (Hrsg.) ; Miesenberger, K. ; Kouroupetroglou, G. ; Mavrou, K. ; Manduchi, R. ; Covarrubias Rodriguez, M. ; Penáz, P. (Hrsg.): Computers Helping People with Special Needs, Computers Helping People with Special Needs. Cham : Springer International Publishing, 2022 — ISBN 978-3-031-08648-9, S. 295--304
Abstract
With the emergence of mainstream virtual reality (VR) platforms for social interactions, non-verbal communicative cues are increasingly being transmitted into the virtual environment. Since VR is primarily a visual medium, accessible VR solutions are required for people with visual impairments (PVI). However, existing propositions do not take into account social interactions, and therefore PVI are excluded from this type of experience. To address this issue, we conducted semi-structured interviews with eleven participants, seven of whom were PVI and four of whom were partners or close friends without visual impairments, to explore how non-verbal cues and joint attention are used and perceived in everyday social situations and conversations. Our goal was to provide guidelines for inclusive conversations in virtual environments for PVI. Our findings suggest that gaze, head direction, head movements, and facial expressions are important for both groups in conversations but often difficult to identify visually for PVI. From our findings, we provide concrete suggestions for the design of social VR spaces, inclusive to PVI.BibTeX