IPAR Projekt-LogoEine Benutzerin ändert mittels einer Mobile-Augmented-Reality-Anwendung die Farbe von Gardinen auf einem Tablet.

Die Erweiterte Realität (Augmented Reality) hat dank mobiler Endgeräte das Potenzial, künftig auch jenseits industrieller Anwendungen verstärkt zum Einsatz zu kommen. Zum Beispiel können im Bereich Architektur und Innenarchitektur virtuelle Möbel oder Fenster in realen Räumen platziert werden.

Für die Manipulation einer möglichst überzeugend augmentierten, realen Welt werden sowohl in Echtzeit generierte, photorealistische Darstellungen als auch natürliche, nahtlose Interaktionsformen mit den virtuellen Objekten benötigt. Dies sind zwei wesentliche Erfolgsaspekte für Augmented Reality-Anwendungen, die im Projekt IPAR erforscht werden.

Grundlage ist zunächst die Vermessung der komplexen, realen Lichtverhältnisse, die als Eingabe für die Echtzeit-Beleuchtung der virtuellen Objekte verwendet werden. Neben der Veränderung der real wirkenden virtuellen Objekte wird damit auch eine virtuelle Manipulation realer Objekte bei konsistenter Beleuchtung möglich. Für die Interaktionen werden einerseits indirekte Techniken untersucht, bei denen in der Hand gehaltene moderne Tablets als sogenannte „Magische Linsen“ zum Einsatz kommen. Analog zu einem Kameradisplay stellen sie ein Fenster in die virtuell angereicherte Realität dar, durch das Anwender Gegenstände manipulieren können. Andererseits sollen auch direkte gestische Interaktionstechniken in Kombination mit einer mobilen Projektion auf reale Objekte entwickelt und evaluiert werden.

Neben Forschungsfragen zur Vermessung und Modellierung zeitlich und räumlich variierender Beleuchtung in Innenräumen wird im Forschungsprojekt untersucht, welche Herausforderungen sich aus der nahtlosen Integration bezüglich der Nutzerinteraktion und Akzeptanz ergeben.

Videos


Publikationen

  • Foldable3D: Interacting with 3D Content Using Dual-Display Devices

    Foldable3D: Interacting with 3D Content Using Dual-Display Devices

    Büschel, W.; Reipschläger, P.; Dachselt, R.

    In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces.ISS '16, Niagara Falls, ON, Canada.ACM,page 367-372,2016.10.1145/2992154.2996782

    @inproceedings{fixme,
       author = {Wolfgang B\"{u}schel and Patrick Reipschl\"{a}ger and Raimund Dachselt},
       title = {Foldable3D: Interacting with 3D Content Using Dual-Display Devices},
       booktitle = {Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces},
       year = {2016},
       month = {11},
       isbn = {978-1-4503-4248-3},
       location = {Niagara Falls, ON, Canada},
       pages = {367--372},
       numpages = {6},
       doi = {10.1145/2992154.2996782},
       url = {https://doi.org/10.1145/2992154.2996782},
       acmid = {2996782},
       publisher = {ACM},
       address = {New York, NY, USA},
       keywords = {3d interaction, augmented reality, dual-display device, head-coupled perspective, virtual reality}
    }

    List of additional material

    Poster

  • Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content

    Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content

    Matulic, F.; Büschel, W.; Yang, M.; Ihrke, S.; Ramraika, A.; Rother, C.; Dachselt, R.

    In Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems.CHI EA '16, San Jose, CA, USA.ACM,page 2592-2600,2016.10.1145/2851581.2892545

    @inproceedings{fixme,
       author = {Fabrice Matulic and Wolfgang B\"{u}schel and Michael Yang and Stephan Ihrke and Anmol Ramraika and Carsten Rother and Raimund Dachselt},
       title = {Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content},
       booktitle = {Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems},
       series = {CHI EA '16},
       year = {2016},
       month = {5},
       isbn = {978-1-4503-4082-3},
       location = {San Jose, CA, USA},
       pages = {2592--2600},
       numpages = {9},
       doi = {10.1145/2851581.2892545},
       url = {http://dx.doi.org/10.1145/2851581.2892545},
       acmid = {2892545},
       publisher = {ACM},
       address = {New York, NY, USA},
       keywords = {projection everywhere, ubiquitous displays, projection surface detection, interaction with projected content}
    }

    List of additional material

    Poster

  • @article{fixme,
       author = {Kai Rohmer and Wolfgang B\"{u}schel and Raimund Dachselt and Thorsten Grosch},
       title = {Interactive Near-Field Illumination for Photorealistic Augmented Reality with Varying Materials on Mobile Devices},
       booktitle = {IEEE Transactions on Visualization and Computer Graphics},
       volume = {21 (12)},
       year = {2015},
       month = {12},
       isbn = {1077-2626},
       pages = {1349--1362 },
       numpages = {14},
       doi = {10.1109/TVCG.2015.2450717},
       url = {http://dx.doi.org/10.1109/TVCG.2015.2450717},
       publisher = {IEEE}
    }

    List of additional material

  • SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls

    SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls

    von Zadow, U.; Büschel, W.; Langner, R.; Dachselt, R.

    In Proceedings of the 2014 ACM International Conference on Interactive Tabletops and Surfaces.ITS '14, Dresden, Germany.ACM,page 129-138,2014.10.1145/2669485.2669507

    @inproceedings{Zadow-ITS-2014,
       author = {Ulrich von Zadow and Wolfgang B\"{u}schel and Ricardo Langner and Raimund Dachselt},
       title = {SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls},
       booktitle = {Proceedings of the 2014 ACM International Conference on Interactive Tabletops and Surfaces},
       year = {2014},
       month = {12},
       isbn = {978-1-4503-2587-5},
       location = {Dresden, Germany},
       pages = {129--138},
       numpages = {10},
       doi = {10.1145/2669485.2669507},
       url = {https://doi.org/10.1145/2669485.2669507},
       acmid = {2669507},
       publisher = {ACM}
    }

    List of additional material

    Video

  • Interactive Near-field Illumination for Photorealistic Augmented Reality on Mobile Devices

    Interactive Near-field Illumination for Photorealistic Augmented Reality on Mobile Devices

    Rohmer, K.; Büschel, W.; Dachselt, R.; Grosch, T.

    In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).ISMAR '14page 29-38,2014.10.1109/ISMAR.2014.6948406

    @inproceedings{fixme,
       author = {Kai Rohmer and Wolfgang B\"{u}schel and Raimund Dachselt and Thorsten Grosch},
       title = {Interactive Near-field Illumination for Photorealistic Augmented Reality on Mobile Devices},
       booktitle = {2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)},
       year = {2014},
       month = {9},
       pages = {29--38},
       doi = {10.1109/ISMAR.2014.6948406},
       url = {https://doi.org/10.1109/ISMAR.2014.6948406},
       keywords = {Mixed Reality, Augmented Reality, Mobile, Real-time Global Illumination, Distributed Rendering, Precomputed Radiance Transfer, Instant Radiosity}
    }

    List of additional material

  • tPad: Designing Transparent-Display Mobile Interactions

    tPad: Designing Transparent-Display Mobile Interactions

    Hincapié-Ramos, J.; Roscher, S.; Büschel, W.; Kister, U.; Dachselt, R.; Irani, P.

    In Proceedings of the 10th ACM Conference on Designing Interactive Systems.DIS '14, Vancouver, BC, Canada.ACM,page 161-170,2014.10.1145/2598510.2598578

    @inproceedings{DIS-2014-tPad,
       author = {Juan David Hincapi\'{e}-Ramos and Sophie Roscher and Wolfgang B\"{u}schel and Ulrike Kister and Raimund Dachselt and Pourang Irani},
       title = {tPad: Designing Transparent-Display Mobile Interactions},
       booktitle = {Proceedings of the 10th ACM Conference on Designing Interactive Systems},
       year = {2014},
       month = {6},
       location = {Vancouver, BC, Canada},
       pages = {161--170},
       numpages = {10},
       doi = {10.1145/2598510.2598578},
       url = {https://doi.org/10.1145/2598510.2598578},
       publisher = {ACM},
       keywords = {Transparent Displays, Transparent Mobile Devices, tPad, Flipping, Tap’n Flip, Surface Capture, Contact AR}
    }

    List of additional material

  • @article{fixme,
       author = {Martin Spindler and Wolfgang B\"{u}schel and Charlotte Winkler and Raimund Dachselt},
       title = {Tangible displays for the masses: spatial interaction with handheld displays by using consumer depth cameras},
       booktitle = {Personal and Ubiquitous Computing},
       volume = {18 (5)},
       year = {2014},
       month = {6},
       isbn = {1617-4909},
       pages = {1213--1225},
       numpages = {13},
       doi = {10.1007/s00779-013-0730-7},
       url = {http://dx.doi.org/10.1007/s00779-013-0730-7},
       publisher = {Springer London},
       keywords = {Tangible magic lenses, PaperLens, Tangible display ecosystem, Spatial interaction, Multi-display environment, Interaction above the tabletop, Kinect}
    }

    List of additional material

  • cAR: Contact Augmented Reality with Transparent-Display Mobile Devices

    cAR: Contact Augmented Reality with Transparent-Display Mobile Devices

    Hincapié-Ramos, J.; Roscher, S.; Büschel, W.; Kister, U.; Dachselt, R.; Irani, P.

    In Proceedings of the 3rd International Symposium on Pervasive Displays.PerDis '14, Copenhagen, Denmark.page 80-85,2014.10.1145/2611009.2611014

    @inproceedings{PerDis-2014-cAR,
       author = {Juan David Hincapi\'{e}-Ramos and Sophie Roscher and Wolfgang B\"{u}schel and Ulrike Kister and Raimund Dachselt and Pourang Irani},
       title = {cAR: Contact Augmented Reality with Transparent-Display Mobile Devices},
       booktitle = {Proceedings of the 3rd International Symposium on Pervasive Displays},
       year = {2014},
       month = {6},
       location = {Copenhagen, Denmark},
       pages = {80--85},
       numpages = {6},
       doi = {10.1145/2611009.2611014},
       url = {https://doi.org/10.1145/2611009.2611014},
       keywords = {Contact Augmented Reality, Transparent Devices}
    }

    List of additional material

  • Towards Interaction with Transparent and Flexible Displays

    Towards Interaction with Transparent and Flexible Displays

    Büschel, W.; Viergutz, A.; Dachselt, R.

    In CHI 2013 Workshop on Displays Take New Shape: An Agenda for Future Interactive Surfaces.CHI '132013.

    @article{Büschel-2013-CHI,
       author = {Wolfgang B\"{u}schel and Andr\'{e} Viergutz and Raimund Dachselt},
       title = {Towards Interaction with Transparent and Flexible Displays},
       booktitle = {CHI 2013 Workshop on Displays Take New Shape: An Agenda for Future Interactive Surfaces},
       year = {2013},
       month = {4},
       numpages = {4},
       keywords = {mobile devices, transparent and flexible interfaces, interaction techniques}
    }

    List of additional material

Studentische Arbeiten

  • Denny Schöppe

    Einsatz von 3D-Scannern in mobilen Augmented-Reality-Anwendungen

    Denny Schöppe April 1st, 2015 until Oktober 1st, 2015

    Supervision: Raimund Dachselt, Wolfgang Büschel