DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays

We present DesignAR, an augmented design workstation for creating 3D models. Our approach seamlessly integrates an interactive surface displaying 2D views with head-mounted, stereoscopic Augmented Reality (AR). This creates a combined output space that expands the screen estate and enables placing 3D objects beyond display borders. For the effective combination of 2D and 3D views, we define different levels of proximity and alignment. Regarding input, multi-touch and pen mitigate issues of precision and ergonomics commonly found in mid-air VR/AR interaction. For creating and refining 3D models, we propose a set of pen and touch techniques with immediate AR feedback, including sketching of rotational
solids or tracing physical objects on the surface. To further support a designer’s modeling process, we additionally propose orthographic model views and UI offloading in AR as well as freely placeable model instances with real-world reference. Based on our DesignAR prototype, we report on challenges and insights regarding this novel type of display augmentation. The combination of high-resolution, high-precision interactive surfaces with carefully aligned AR views opens up exciting possibilities for future work and design environments, a vision we call Augmented Displays.

Video

Publications

  • Augmented Displays: Seamlessly Extending Interactive Surfaces with Head-Mounted Augmented Reality.

    Reipschläger, P.; Engert, S.; Dachselt, R.;

    In Proceedings of the 2020 CHI Conference Extended Abstracts on Human Factors in Computing Systems.CHI '20, Honolulu, Hawaii, USA.ACM,2020.10.1145/3334480.3383138

    @inproceedings{Reipschlaeger2020,
       author = {Patrick Reipschl\"{a}ger and Severin Engert and Raimund Dachselt},
       title = {Augmented Displays: Seamlessly Extending Interactive Surfaces with Head-Mounted Augmented Reality},
       booktitle = {Proceedings of the 2020 CHI Conference Extended Abstracts on Human Factors in Computing Systems},
       year = {2020},
       month = {4},
       isbn = {978-1-4503-6819-3/20/04},
       location = {Honolulu, Hawaii, USA},
       numpages = {4},
       doi = {10.1145/3334480.3383138},
       publisher = {ACM},
       address = {New York},
       keywords = {Augmented Reality, Interactive Surfaces, Augmented Displays, Touch+Pen Interaction, Design, 3D Modeling, Architecture, DesignAR}
    }

  • DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays.

    Reipschläger, P.; Dachselt, R.;

    In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces.ISS '19, Daejeon, Republic of Korea.ACM,29-42,2019.10.1145/3343055.3359718

    @inproceedings{Reipschlaeger2019,
       author = {Patrick Reipschl\"{a}ger and Raimund Dachselt},
       title = {DesignAR: Immersive 3D-Modeling Combining Augmented Reality with Interactive Displays},
       booktitle = {Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces},
       series = {ISS '19},
       year = {2019},
       month = {11},
       isbn = {978-1-4503-6891-9},
       location = {Daejeon, Republic of Korea},
       pages = {29--42},
       numpages = {13},
       doi = {10.1145/3343055.3359718},
       url = { https://doi.org/10.1145/3343055.3359718},
       acmid = {3359718},
       publisher = {ACM},
       address = {New York, NY, USA},
       keywords = {Augmented Reality, Interactive Surfaces, Augmented Displays, Touch+Pen Interaction, Design, 3D Modeling}
    }