How can we develop appropriate and natural forms of communication between humans and computers? In the future, computers will hardly be perceived as such, but will be seamlessly integrated into our living and working environments, e.g. in cyber-physical systems. How can people be effectively supported with their experiences, sensory organs, gestural means of expression and social needs?

Our work focuses on the systematic and fundamental research of different, preferably natural interaction modalities and their synergistic combination. We are researching gestural multi-touch interaction, digital pens in combination with digital paper, the efficient combination of touch and pen input, gestural interaction with hands, head and feet, gaze-supported interaction for remote displays, and tangibles. Our focus is on small and large interactive surfaces (mini-displays, smartphones, tablets, tabletops, high-resolution large wall displays) and their effective combination in multi-display environments.

We apply the developed techniques and principles in various application domains and projects with academic and industrial partners from Germany and abroad. We also investigate how modern user interfaces and interaction techniques can be used effectively in the fields of interactive information visualization, music informatics and semantic web.

Recent Research Projects

Preview for research project: Mixed Presence in Mixed Reality Mixed Presence in Mixed Reality Preview for research project: Visual Representations of Multi-View Relations in Mixed Reality Visual Representations of Multi-View Relations in Mixed Reality
Preview for research project: Mirror Me: Exploring Avatar Self-Views in Multi-User Virtual Reality Mirror Me: Exploring Avatar Self-Views in Multi-User Virtual Reality Preview for research project: nev: Nemo Explain Visualizer nev: Nemo Explain Visualizer
Preview for research project: Interaction Techniques for Spatial Arrangement of AR Documents Interaction Techniques for Spatial Arrangement of AR Documents Show all research projects

Recent Publications

  • SciFi-VIS: Way Out There – How SciFi and Visualization Influence Each Other.

    Günther, U.; Méndez, J.; Molina León, G.; Pantze, S.; Romero, M.; Adetunji Salako, A.; Ulschmid, A.;

    @article{GMMPRSU26,
       author = {Ulrik G\"{u}nther and Juli\'{a}n M\'{e}ndez and Gabriela Molina León and Samuel Pantze and Mario Romero and Abdulhaq Adetunji Salako and Annalena Ulschmid},
       title = {SciFi-VIS: Way Out There – How SciFi and Visualization Influence Each Other},
       numpages = {3},
       doi = {10.48550/arXiv.2606.24731}
    }

  • On the Integration of Explainable Formal Methods Tools into PMC-VIS.

    Baier, C.; Chau, C.; Dachselt, R.; Klüppelholz, S.; Korn, M.; Langner, R.; Lehmann, J.; Méndez, J.;

    @inproceedings{BCDKKLLM,
       author = {Christel Baier and Calvin Chau and Raimund Dachselt and Sascha Kl\"{u}ppelholz and Max Korn and Ricardo Langner and Johannes Lehmann and Juli\'{a}n M\'{e}ndez},
       title = {On the Integration of Explainable Formal Methods Tools into PMC-VIS},
       series = {ISoLA 2026},
       numpages = {20}
    }

  • Towards Visual Decision Support in Interactive Repair (Extended Abstract).

    Alrabbaa, C.; Baader, F.; Dachselt, R.; Kansakar, P.; Méndez, J.; Zanganeh, A.;

    @article{ABDKMZ26ea,
       author = {Christian Alrabbaa and Franz Baader and Raimund Dachselt and Pratistha Kansakar and Juli\'{a}n M\'{e}ndez and Afshin Zanganeh},
       title = {Towards Visual Decision Support in Interactive Repair (Extended Abstract)}
    }

  • Towards Visual Decision Support in Interactive Repair.

    Alrabbaa, C.; Baader, F.; Dachselt, R.; Kansakar, P.; Méndez, J.; Zanganeh, A.;

    @inproceedings{ABDKMZ26,
       author = {Christian Alrabbaa and Franz Baader and Raimund Dachselt and Pratistha Kansakar and Juli\'{a}n M\'{e}ndez and Afshin Zanganeh},
       title = {Towards Visual Decision Support in Interactive Repair}
    }

  • Iterative Planning with MUGS Explanations: Exploring the Design Space.

    Schmalz, J.; Groß, D.; Eifler, R.; Méndez, J.; Dachselt, R.; Gumhold, S.; Hoffmann, J.;

    @inproceedings{SGEMDGH,
       author = {Johannes Schmalz and David Gro\ss and Rebecca Eifler and Juli\'{a}n M\'{e}ndez and Raimund Dachselt and Stefan Gumhold and J\"{o}rg Hoffmann},
       title = {Iterative Planning with MUGS Explanations: Exploring the Design Space},
       numpages = {5}
    }

  • Show all publications