IPAR Projekt-LogoEine Benutzerin ändert mittels einer Mobile-Augmented-Reality-Anwendung die Farbe von Gardinen auf einem Tablet.

Die Erweiterte Realität (Augmented Reality) hat dank mobiler Endgeräte das Potenzial, künftig auch jenseits industrieller Anwendungen verstärkt zum Einsatz zu kommen. Zum Beispiel können im Bereich Architektur und Innenarchitektur virtuelle Möbel oder Fenster in realen Räumen platziert werden.

Für die Manipulation einer möglichst überzeugend augmentierten, realen Welt werden sowohl in Echtzeit generierte, photorealistische Darstellungen als auch natürliche, nahtlose Interaktionsformen mit den virtuellen Objekten benötigt. Dies sind zwei wesentliche Erfolgsaspekte für Augmented Reality-Anwendungen, die im Projekt IPAR erforscht werden.

Grundlage ist zunächst die Vermessung der komplexen, realen Lichtverhältnisse, die als Eingabe für die Echtzeit-Beleuchtung der virtuellen Objekte verwendet werden. Neben der Veränderung der real wirkenden virtuellen Objekte wird damit auch eine virtuelle Manipulation realer Objekte bei konsistenter Beleuchtung möglich. Für die Interaktionen werden einerseits indirekte Techniken untersucht, bei denen in der Hand gehaltene moderne Tablets als sogenannte „Magische Linsen“ zum Einsatz kommen. Analog zu einem Kameradisplay stellen sie ein Fenster in die virtuell angereicherte Realität dar, durch das Anwender Gegenstände manipulieren können. Andererseits sollen auch direkte gestische Interaktionstechniken in Kombination mit einer mobilen Projektion auf reale Objekte entwickelt und evaluiert werden.

Neben Forschungsfragen zur Vermessung und Modellierung zeitlich und räumlich variierender Beleuchtung in Innenräumen wird im Forschungsprojekt untersucht, welche Herausforderungen sich aus der nahtlosen Integration bezüglich der Nutzerinteraktion und Akzeptanz ergeben.

Videos

https://vimeo.com/118124659

Thumbnail für das begleitende Video zur IPAR-Publikation 'Interactive Near-field Illumination for Photorealistic Augmented Reality on Mobile Devices'

https://youtu.be/wpZH8rkdEoo

Thumbnail für das begleitende Video zur IPAR-Publikation 'Smart Ubiquitous Projection'

Publikationen

  • Foldable3D: Interacting with 3D Content Using Dual-Display Devices.

    Büschel, W.; Reipschläger, P.; Dachselt, R.;

    In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces.ISS '16, Niagara Falls, ON, Canada.ACM,367-372,2016.10.1145/2992154.2996782

    @inproceedings{fixme,
       author = {Wolfgang B\"{u}schel and Patrick Reipschl\"{a}ger and Raimund Dachselt},
       title = {Foldable3D: Interacting with 3D Content Using Dual-Display Devices},
       booktitle = {Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces},
       year = {2016},
       month = {11},
       isbn = {978-1-4503-4248-3},
       location = {Niagara Falls, ON, Canada},
       pages = {367--372},
       numpages = {6},
       doi = {10.1145/2992154.2996782},
       url = {https://doi.org/10.1145/2992154.2996782},
       acmid = {2996782},
       publisher = {ACM},
       address = {New York, NY, USA},
       keywords = {3d interaction, augmented reality, dual-display device, head-coupled perspective, virtual reality}
    }

  • Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content.

    Matulic, F.; Büschel, W.; Yang, M.; Ihrke, S.; Ramraika, A.; Rother, C.; Dachselt, R.;

    In Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems.CHI EA '16, San Jose, CA, USA.ACM,2592-2600,2016.10.1145/2851581.2892545

    @inproceedings{,
       author = {Fabrice Matulic and Wolfgang B\"{u}schel and Michael Yang and Stephan Ihrke and Anmol Ramraika and Carsten Rother and Raimund Dachselt},
       title = {Smart Ubiquitous Projection: Discovering Surfaces for the Projection of Adaptive Content},
       booktitle = {Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems},
       series = {CHI EA '16},
       year = {2016},
       month = {5},
       isbn = {978-1-4503-4082-3},
       location = {San Jose, CA, USA},
       pages = {2592--2600},
       numpages = {9},
       doi = {10.1145/2851581.2892545},
       url = {http://dx.doi.org/10.1145/2851581.2892545},
       acmid = {2892545},
       publisher = {ACM},
       address = {New York, NY, USA},
       keywords = {projection everywhere, ubiquitous displays, projection surface detection, interaction with projected content}
    }

  • Interactive Near-Field Illumination for Photorealistic Augmented Reality with Varying Materials on Mobile Devices (TVCG)

    Interactive Near-Field Illumination for Photorealistic Augmented Reality with Varying Materials on Mobile Devices.

    Rohmer, K.; Büschel, W.; Dachselt, R.; Grosch, T.;

    In IEEE Transactions on Visualization and Computer Graphics.IEEE,1349-1362 ,2015.10.1109/TVCG.2015.2450717

    @article{,
       author = {Kai Rohmer and Wolfgang B\"{u}schel and Raimund Dachselt and Thorsten Grosch},
       title = {Interactive Near-Field Illumination for Photorealistic Augmented Reality with Varying Materials on Mobile Devices},
       booktitle = {IEEE Transactions on Visualization and Computer Graphics},
       volume = {21 (12)},
       year = {2015},
       month = {12},
       isbn = {1077-2626},
       pages = {1349--1362},
       numpages = {14},
       doi = {10.1109/TVCG.2015.2450717},
       url = {http://dx.doi.org/10.1109/TVCG.2015.2450717},
       publisher = {IEEE}
    }

  • SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls.

    von Zadow, U.; Büschel, W.; Langner, R.; Dachselt, R.;

    In Proceedings of the 2014 ACM International Conference on Interactive Tabletops and Surfaces.ITS '14, Dresden, Germany.ACM,129-138,2014.10.1145/2669485.2669507

    @inproceedings{Zadow-ITS-2014,
       author = {Ulrich von Zadow and Wolfgang B\"{u}schel and Ricardo Langner and Raimund Dachselt},
       title = {SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls},
       booktitle = {Proceedings of the 2014 ACM International Conference on Interactive Tabletops and Surfaces},
       year = {2014},
       month = {12},
       isbn = {978-1-4503-2587-5},
       location = {Dresden, Germany},
       pages = {129--138},
       numpages = {10},
       doi = {10.1145/2669485.2669507},
       url = {https://doi.org/10.1145/2669485.2669507},
       acmid = {2669507},
       publisher = {ACM}
    }

  • Interactive Near-field Illumination for Photorealistic Augmented Reality on Mobile Devices.

    Rohmer, K.; Büschel, W.; Dachselt, R.; Grosch, T.;

    In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).ISMAR '1429-38,2014.10.1109/ISMAR.2014.6948406

    @inproceedings{fixme,
       author = {Kai Rohmer and Wolfgang B\"{u}schel and Raimund Dachselt and Thorsten Grosch},
       title = {Interactive Near-field Illumination for Photorealistic Augmented Reality on Mobile Devices},
       booktitle = {2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)},
       year = {2014},
       month = {9},
       pages = {29--38},
       doi = {10.1109/ISMAR.2014.6948406},
       url = {https://doi.org/10.1109/ISMAR.2014.6948406},
       keywords = {Mixed Reality, Augmented Reality, Mobile, Real-time Global Illumination, Distributed Rendering, Precomputed Radiance Transfer, Instant Radiosity}
    }

  • tPad: Designing Transparent-Display Mobile Interactions.

    Hincapié-Ramos, J.; Roscher, S.; Büschel, W.; Kister, U.; Dachselt, R.; Irani, P.;

    In Proceedings of the 10th ACM Conference on Designing Interactive Systems.DIS '14, Vancouver, BC, Canada.ACM,161-170,2014.10.1145/2598510.2598578

    @inproceedings{DIS-2014-tPad,
       author = {Juan David Hincapi\'{e}-Ramos and Sophie Roscher and Wolfgang B\"{u}schel and Ulrike Kister and Raimund Dachselt and Pourang Irani},
       title = {tPad: Designing Transparent-Display Mobile Interactions},
       booktitle = {Proceedings of the 10th ACM Conference on Designing Interactive Systems},
       year = {2014},
       month = {6},
       location = {Vancouver, BC, Canada},
       pages = {161--170},
       numpages = {10},
       doi = {10.1145/2598510.2598578},
       url = {https://doi.org/10.1145/2598510.2598578},
       publisher = {ACM},
       keywords = {Transparent Displays, Transparent Mobile Devices, tPad, Flipping, Tap’n Flip, Surface Capture, Contact AR}
    }

  • Tangible displays for the masses: spatial interaction with handheld displays by using consumer depth cameras.

    Spindler, M.; Büschel, W.; Winkler, C.; Dachselt, R.;

    In Personal and Ubiquitous Computing.Springer London,1213-1225,2014.10.1007/s00779-013-0730-7

    @article{,
       author = {Martin Spindler and Wolfgang B\"{u}schel and Charlotte Winkler and Raimund Dachselt},
       title = {Tangible displays for the masses: spatial interaction with handheld displays by using consumer depth cameras},
       booktitle = {Personal and Ubiquitous Computing},
       volume = {18 (5)},
       year = {2014},
       month = {6},
       isbn = {1617-4909},
       pages = {1213--1225},
       numpages = {13},
       doi = {10.1007/s00779-013-0730-7},
       url = {http://dx.doi.org/10.1007/s00779-013-0730-7},
       publisher = {Springer London},
       keywords = {Tangible magic lenses, PaperLens, Tangible display ecosystem, Spatial interaction, Multi-display environment, Interaction above the tabletop, Kinect}
    }

  • cAR: Contact Augmented Reality with Transparent-Display Mobile Devices.

    Hincapié-Ramos, J.; Roscher, S.; Büschel, W.; Kister, U.; Dachselt, R.; Irani, P.;

    In Proceedings of the 3rd International Symposium on Pervasive Displays.PerDis '14, Copenhagen, Denmark.80-85,2014.10.1145/2611009.2611014

    @inproceedings{PerDis-2014-cAR,
       author = {Juan David Hincapi\'{e}-Ramos and Sophie Roscher and Wolfgang B\"{u}schel and Ulrike Kister and Raimund Dachselt and Pourang Irani},
       title = {cAR: Contact Augmented Reality with Transparent-Display Mobile Devices},
       booktitle = {Proceedings of the 3rd International Symposium on Pervasive Displays},
       year = {2014},
       month = {6},
       location = {Copenhagen, Denmark},
       pages = {80--85},
       numpages = {6},
       doi = {10.1145/2611009.2611014},
       url = {https://doi.org/10.1145/2611009.2611014},
       keywords = {Contact Augmented Reality, Transparent Devices}
    }

  • Towards Interaction with Transparent and Flexible Displays.

    Büschel, W.; Viergutz, A.; Dachselt, R.;

    In CHI 2013 Workshop on Displays Take New Shape: An Agenda for Future Interactive Surfaces.CHI '132013.

    @article{Büschel-2013-CHI,
       author = {Wolfgang B\"{u}schel and Andr\'{e} Viergutz and Raimund Dachselt},
       title = {Towards Interaction with Transparent and Flexible Displays},
       booktitle = {CHI 2013 Workshop on Displays Take New Shape: An Agenda for Future Interactive Surfaces},
       year = {2013},
       month = {4},
       numpages = {4},
       keywords = {mobile devices, transparent and flexible interfaces, interaction techniques}
    }

Studentische Arbeiten