Leider ist dieser Inhalt nur in Englisch verfügbar. Aus praktischen Gründen wird der Inhalt unten in dieser Sprache angezeigt.
Overview
This thesis examines different factors that can influence the design of future AR systems for visual data analysis across three different groups:
- The individual person using an AR system for visual data analysis.
- The real-world, physical environment this system is used in.
- The system itself that AR is incorporated in.
More concretely, those three groups of characteristics allowed the derivation of the following three research questions:
- What factors should be considered for designing AR applications in a human-centered way?
- What influences does the environment have within AR applications?
- How can AR applications be combined with existing systems and devices?
To answer those research questions, I explore different human properties and real-world environments that can affect the same environment’s augmentations. For human factors, I investigate the competence in working with visualizations as visualization literacy, the visual perception of visualizations, and physical ergonomics like head movement. Regarding the environment, I examine two main factors: the visual background’s influence on reading and working with immersive visualizations and the possibility of using alternative placement areas in Augmented Reality. Lastly, to explore future Augmented Reality systems, I designed and implemented Hybrid User Interfaces and authoring tools for immersive environments. Throughout the different projects, I used empirical, qualitative, and iterative methods in studying and designing immersive visualizations and applications. With that, I contribute to understanding how developers can apply human and environmental parameters for designing and creating future AR applications, especially for visual data analysis.
Marc Satkowski
APB/2046, (+49) 351 / 463 38683
marc.satkowskiThis is a spam protection.tu-dresden.de
Quick Access
Defense
The successful defense of the PhD thesis took place on December 19, 2023.
Download
Understanding Immersive Environments for Visual Data Analysis (Marc Satkowski)
@phdthesis{fixme,
author = {Marc Satkowski},
title = {Understanding Immersive Environments for Visual Data Analysis (Marc Satkowski)},
year = {2024},
month = {2},
location = {Dresden},
url = {https://nbn-resolving.org/urn:nbn:de:bsz:14-qucosa2-889954},
publisher = {Qucosa - Technische Universit\"{a}t Dresden}
}Weitere Materialien
Research Projects
Moderating Effect of Visualization Literacy and Visual Adaptation
This chapter describes a research project focused on understanding the effect of user competence (i.e., visualization literacy) in combination with different visualization styles on scatter plots and bar charts. As the competence to work and understand visualizations is independent of the device type they are presented on, I decided not to use AR for this project. This allowed a first look at the fundamental issues caused by the increasing number of visualization users and the number of visualization types. With that, this chapter presents an empirical online study, and the evaluation of the collected data via linear mixed models.
@inproceedings{satkowski2022who,
author = {Marc Satkowski and Franziska Kessler and Susanne Narciss and Raimund Dachselt},
title = {Who benefits from Visualization Adaptations? Towards a better Understanding of the Influence of Visualization Literacy},
booktitle = {IEEE Transactions on Visualization and Computer Graphics},
year = {2022},
month = {10},
location = {Oklahoma City, USA (Hybrid)},
doi = {10.1109/VIS54862.2022.00027},
publisher = {IEEE}
}Weitere Materialien
Influence of Real-World Backgrounds on the Perception of AR Visualizations
Following, a research project is presented, that centers around one of the basic features of AR devices: the integration of virtual visual content into real-world scenes. Especially the potential influence of the environmental parameter of the real-world background and its visual features, i.e., luminance or color, are of interest in this project. For that, two studies were conducted. One focused on the influence of the visual background and the visual complexity of the visualization while the second focused on the impact of the visual background and a split-focus task design. Both studies were evaluated through various statistical tests.
@article{satkowski2021investigating,
author = {Marc Satkowski and Raimund Dachselt},
title = {Investigating the Impact of Real-World Environments on the Perception of 2D Visualizations in Augmented Reality},
booktitle = {Proceedings of the 2021 ACM Conference on Human Factors in Computing Systems},
year = {2021},
month = {05},
isbn = {978-1-4503-8096-6/21/05},
location = {Yokohama, Japan},
numpages = {14},
doi = {10.1145/3411764.3445330},
url = {https://doi.org/10.1145/3411764.3445330},
publisher = {ACM},
keywords = {User Study, Augmented Reality, Visual Perception, Immersive Analytics, In-Situ Visualization, AR Visualization, Industrial Scenario, Industry 4.0}
}Weitere Materialien
Pre-Recorded Talk, Video, Teaser, Study Material, Study Data, Statistical Analysis,
Understanding AR Content Placement on Ceiling and Floor
This chapter investigates alternative placement areas for virtual AR content beyond the eye level, i.e., on the ceiling and the floor. By exploring the placement areas as environmental parameters, it is possible to reduce the amount of content in the user’s FoV by placing it on the available and accessible spaces above and below the FoV. With that, this chapter presents a small survey on the use of ceiling and floor in the current literature, a definition of the placement, and the physical ergonomic parameters for placing content in either area. Following, two studies were conducted, one exploring how the ceiling and floor can be used in future AR applications while another defines optimal and preferred placement parameters for content in both areas. Lastly, a list of design recommendations on how both areas should be used in future AR systems is also presented.
@inproceedings{satkowski2022above,
author = {Marc Satkowski and Rufat Rzayev and Eva Goebel and Raimund Dachselt},
title = {ABOVE \& BELOW: Investigating Ceiling and Floor for Augmented Reality Content Placement},
booktitle = {Proceedings of the 21st IEEE International Symposium on Mixed and Augmented Reality},
series = {ISMAR '22},
year = {2022},
month = {10},
location = {Singapore},
doi = {10.1109/ISMAR55827.2022.00068},
publisher = {IEEE}
}Weitere Materialien
Pre-Recorded Talk, Video, Supplemental Material, Appendix PDF
Hybrid User Interfaces for Immersive Visualizations
Lastly, I explored how AR HMDs can co-exist and work in unison with other existing device classes in the current device ecology. I implemented such Hybrid User Interfaces (HUIs) for visualizations, focusing on an analysis or authoring workflow. The former workflow presents handcrafted visualizations spanning the different devices, while the latter enables in-situ visualization creation in any given immersive environment. Both workflows and systems demonstrate how a symbiosis of varying device types can be imagined and realized. With that said, the chapter investigates the term HUIs and the two described prototype systems in more detail.
@inproceedings{satkowski2023fantastic,
author = {Marc Satkowski and Juli\'{a}n M\'{e}ndez},
title = {Fantastic Hybrid User Interfaces and How to Define Them},
booktitle = {Proceedings of 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
series = {ISMAR '23},
year = {2023},
month = {10},
location = {Sydney},
doi = {10.1109/ISMAR-Adjunct60411.2023.00057},
publisher = {IEEE}
}Weitere Materialien
@inproceedings{satkowski2021visualization,
author = {Marc Satkowski and Weizhou Luo and Raimund Dachselt},
title = {A Visualization Authoring Model for Post-WIMP Interfaces},
booktitle = {Poster Program of the 2021 IEEE VIS Conference},
year = {2021},
month = {10},
location = {Virtual Event},
numpages = {2},
doi = {10.48550/arXiv.2110.14312},
url = {https://arxiv.org/abs/2110.14312}
}Weitere Materialien
@inproceedings{satkowski2021towards,
author = {Marc Satkowski and Weizhou Luo and Raimund Dachselt},
title = {Towards In-situ Authoring of AR Visualizations with Mobile Devices},
booktitle = {2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
year = {2021},
month = {10},
location = {Bari, Italy},
doi = {10.1109/ISMAR-Adjunct54149.2021.00073},
publisher = {IEEE}
}
@inproceedings{langner:2021:marvis,
author = {Ricardo Langner and Marc Satkowski and Wolfgang B\"{u}schel and Raimund Dachselt},
title = {MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis},
booktitle = {Proceedings of the 2021 ACM Conference on Human Factors in Computing Systems},
year = {2021},
month = {5},
isbn = {978-1-4503-8096-6/21/05},
location = {Yokohama, Japan},
numpages = {17},
doi = {10.1145/3411764.3445593},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {data visualization, mobile devices, head-mounted augmented reality, cross-device interaction, data analysis, mobile data visualization, augmented displays, immersive analytics}
}Weitere Materialien
Further Publications
In addition to the main research projects of the PhD thesis, a variety of further publications and workshops contributions were published:
@inproceedings{mendez2023explainability,
author = {Juli\'{a}n M\'{e}ndez and Marc Satkowski and Rufat Rzayev},
title = {How Does Explainability Look in Hybrid User Interfaces?},
booktitle = {Proceedings of 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
series = {ISMAR '23},
year = {2023},
month = {10},
location = {Sydney},
doi = {10.1109/ISMAR-Adjunct60411.2023.00058},
publisher = {IEEE}
}Weitere Materialien
@inproceedings{luo2023pearl,
author = {Weizhou Luo and Zhongyuan Yu and Rufat Rzayev and Marc Satkowski and Stefan Gumhold and Matthew McGinity and Raimund Dachselt},
title = {Pearl: Physical Environment based Augmented Reality Lenses for In-Situ Human Movement Analysis},
booktitle = {Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems},
series = {CHI '23},
number = {381},
year = {2023},
month = {04},
isbn = {9781450394215},
location = {Hamburg, Germany},
numpages = {15},
doi = {10.1145/3544548.3580715},
url = {https://doi.org/10.1145/3544548.3580715},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
keywords = {Immersive Analytics, physical referents, augmented/mixed reality, affordance, In-situ visualization, movement data analysis}
}Weitere Materialien
30-Second Video Preview, 5-min Video Figure, 10-min Recorded Talk, Appendix, GitHub Repository
@inproceedings{ellenberg2023spatiality,
author = {Mats Ole Ellenberg and Marc Satkowski and Weizhou Luo and Raimund Dachselt},
title = {Spatiality and Semantics - Towards Understanding Content Placement in Mixed Reality},
booktitle = {Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems},
series = {CHI EA'23},
year = {2023},
month = {04},
location = {Hamburg, Germany},
doi = {10.1145/3544549.3585853},
publisher = {ACM},
address = {New York, NY, USA}
}Weitere Materialien
@inproceedings{krug2023point,
author = {Katja Krug and Marc Satkowski and Reuben Docea and Tzu-Yu Ku and Raimund Dachselt},
title = {Point Cloud Alignment through Mid-Air Gestures on a Stereoscopic Display},
booktitle = {Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems},
series = {CHI EA'23},
year = {2023},
month = {04},
location = {Hamburg, Germany},
doi = {10.1145/3544549.3585862},
publisher = {ACM},
address = {New York, NY, USA}
}Weitere Materialien
@inproceedings{kessler2022conducive,
author = {Franziska Kessler and Sebastian Lorenz and Felix Miesen and Jonas Miesner and Florian Pelzer and Marc Satkowski and Anselm Klose and Leon Urbas},
title = {Conducive Design as an Iterative Process for Engineering CPPS},
booktitle = {13th International Conference on Applied Human Factors and Ergonomics (AHFE 2022)},
volume = {66},
year = {2022},
month = {07},
location = {New York, USA},
pages = {13--20},
numpages = {9},
doi = {10.54941/ahfe1002683}
}Weitere Materialien
@inproceedings{satkowski2021experiences,
author = {Marc Satkowski and Wolfgang B\"{u}schel and Raimund Dachselt},
title = {Experiences with User Studies in Augmented Reality},
booktitle = {CHI 2021 Workshop on Evaluating User Experiences in Mixed Reality},
year = {2021},
month = {05},
location = {Yokohama, Japan},
numpages = {14},
doi = {10.48550/arXiv.2104.03795},
url = {https://arxiv.org/abs/2104.03795},
keywords = {User Study, Augmented Reality}
}Weitere Materialien
Related Student Theses
Entwurf und Entwicklung hybrider Display-Layout-Strategien für die Datenvisualisierung und -exploration in der Augmented Reality
Lukas Stracke 9. Juli 2021 bis 28. Januar 2022
Betreuung: Weizhou Luo, Marc Satkowski, Raimund Dachselt
Untersuchung von Layout- und Platzierungsstrategien für Augmented Reality Visualisierung in immersiven Umgebungen
Mats Ole Ellenberg 3. Januar 2022 bis 4. Juli 2022
Betreuung: Marc Satkowski, Weizhou Luo, Raimund Dachselt
Wahrnehmung von AR Visualisierungen mit dynamischen Daten in realen Umgebungen
Christian Riedel 28. Januar 2020 bis 15. September 2020
Betreuung: Marc Satkowski, Raimund Dachselt
Kompetenz-basierende Adaption von Visualisierungen
Vincent Schmidt 26. November 2019 bis 11. August 2020
Betreuung: Marc Satkowski, Raimund Dachselt
Aufgabenbasierte Adaptation von Visualisierungssystemen
Pavel Taterentsev 17. Mai 2021 bis 19. November 2021
Betreuung: Marc Satkowski, Raimund Dachselt
Erstellen von Konzepten für das Authoring von Augmented Reality Visualisierungen mit Mobilen Endgeräten
Jingyan Xiedu 8. März 2021 bis 24. Mai 2021
Betreuung: Weizhou Luo, Marc Satkowski, Raimund Dachselt
Adaptive Parametervisualisierungen in Cyber-Physischen Produktionssystemen
Niclas Zellerhoff 21. Juni 2019 bis 6. September 2019
Betreuung: Marc Satkowski, Raimund Dachselt
Augmented Reality und Interaktive Displays: Untersuchung von Konfigurationen und Übergängen [INF-PM-FPA, SoSe 2021]
Mats Ole Ellenberg 3. Mai 2021 bis 20. September 2021
Betreuung: Marc Satkowski, Ricardo Langner, Raimund Dachselt