How can we develop appropriate and natural forms of communication between humans and computers? In the future, computers will hardly be perceived as such, but will be seamlessly integrated into our living and working environments, e.g. in cyber-physical systems. How can people be effectively supported with their experiences, sensory organs, gestural means of expression and social needs?

Our work focuses on the systematic and fundamental research of different, preferably natural interaction modalities and their synergistic combination. We are researching gestural multi-touch interaction, digital pens in combination with digital paper, the efficient combination of touch and pen input, gestural interaction with hands, head and feet, gaze-supported interaction for remote displays, and tangibles. Our focus is on small and large interactive surfaces (mini-displays, smartphones, tablets, tabletops, high-resolution large wall displays) and their effective combination in multi-display environments.

We apply the developed techniques and principles in various application domains and projects with academic and industrial partners from Germany and abroad. We also investigate how modern user interfaces and interaction techniques can be used effectively in the fields of interactive information visualization, music informatics and semantic web.

Recent Publications

  • EvonNemo – A Symbiosis of Datalog Tracing and Proof Tree Visualization.

    Gerlach, L.; Ivliev, A.; Méndez, J.; Meusel, S.; Dachselt, R.; Krötzsch, M.;

    @article{gerlach2024evonnemo,
       author = {Lukas Gerlach and Alex Ivliev and Juli\'{a}n M\'{e}ndez and Simon Meusel and Raimund Dachselt and Markus Kr\"{o}tzsch},
       title = {EvonNemo \&\#8211; A Symbiosis of Datalog Tracing and Proof Tree Visualization}
    }

  • Between Pages and Reality: Exploring a Book Metaphor for Unfolding Data-driven Storytelling in Immersive Environments.

    Luo, W.; Abdelaziz, M.; Méndez, J.; Rzayev, R.;

    @inproceedings{luo2024storybook,
       author = {Weizhou Luo and Mark Abdelaziz and Juli\'{a}n M\'{e}ndez and Rufat Rzayev},
       title = {Between Pages and Reality: Exploring a Book Metaphor for Unfolding Data-driven Storytelling in Immersive Environments},
       series = {ISMAR '24}
    }

  • @article{Schuessler-2024-GazingHeads,
       author = {Martin Schuessler and Luca Hormann and Raimund Dachselt and Andrew Blake and Carsten Rother},
       title = {Gazing Heads: Investigating Gaze Perception in Video-Mediated Communication},
       doi = {10.1145/3660343},
       url = {https://doi.org/10.1145/3660343},
       address = {New York, NY, USA}
    }

  • @inproceedings{krug2024inclusivemr,
       author = {Katja Krug and Juli\'{a}n M\'{e}ndez and Weizhou Luo and Raimund Dachselt},
       title = {Don\&\#8217;t Leave Me Out: Designing for Device Inclusivity in Mixed Reality Collaboration}
    }

  • @inproceedings{luo2024exploring,
       author = {Weizhou Luo},
       title = {Exploring Spatial Organization Strategies for Virtual Content in Mixed Reality Environments},
       series = {CHI EA '24},
       numpages = {6},
       doi = {10.1145/3613905.3638181},
       address = {New York, NY, USA},
       keywords = {Spatiality, spatial layout, content organization, affordance, Aug- mented Reality, Mixed Reality}
    }