Markus Funk
Thomas Kosch
Albrecht Schmidt
ABSTRACT
Due to increasing complexity of products and the demographic change at manual assembly workplaces, interactive and context-aware instructions for assembling products are becoming more and more important. Over the last years, many systems using head-mounted displays (HMDs) and in-situ projection have been proposed. We are observing a trend in assistive systems using in-situ projection for supporting workers during work tasks. Recent advances in technology enable robust detection of almost every work step, which is done at workplaces. With this improvement in robustness, a continuous usage of assistive systems at the workplace becomes possible. In this work, we provide results of a long-term study in an industrial workplace with an overall runtime of 11 full workdays. In our study, each participant assembled at least three full workdays using in-situ projected instructions. We separately considered two different user groups comprising expert and untrained workers. Our results show a decrease in performance for expert workers and a learning success for untrained workers.
- A Bannat, F Wallhoff, G Rigoll, F Friesdorf, H Bubb, S Stork, HJ Müller, A Schubö, M Wiesbeck, and MF Zäh. 2008. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proc. Cotesys'08.Google Scholar
- Mark Billinghurst, Mika Hakkarainen, and Charles Woodward. 2008. Augmented assembly using a mobile phone. In Proc. MUM'08. ACM, 84--87. Google ScholarDigital Library
- Frank Biocca, Arthur Tang, Charles Owen, and Fan Xiao. 2006. Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms. In Proc CHI'06. ACM, 1115--1122. Google ScholarDigital Library
- AC Boud, David J Haniff, Chris Baber, and SJ Steiner. 1999. Virtual reality and augmented reality as a training tool for assembly tasks. In Proc. IV'99. IEEE, 32--36. Google ScholarDigital Library
- Sebastian Büttner, Markus Funk, Oliver Sand, and Carsten Röcker. 2016. Using Head-Mounted Displays and In-Situ Projection for Assistive Systems A Comparison. In Proc. PETRA'16. ACM, 8. Google ScholarDigital Library
- Thomas P Caudell and David W Mizell. 1992. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proc HICSS'92, Vol. 2. IEEE, 659--669.Google ScholarCross Ref
- Florian Echtler, Fabian Sturm, Kay Kindermann, Gudrun Klinker, Joachim Stilla, Joern Trilk, and Hesam Najafi. 2004. The intelligent welding gun: Augmented reality for experimental vehicle construction. In Virtual and augmented reality applications in manufacturing. Springer, 333--360.Google Scholar
- Pierre Fite-Georgel. 2011. Is there a reality in Industrial Augmented Reality?. In Proc. ISMAR'11. IEEE, 201--210. Google ScholarDigital Library
- Wolfgang Friedrich, D Jahn, and L Schmidt. 2002. ARVIKA-Augmented Reality for Development, Production and Service.. In ISMAR'02, Vol. 2002. 3--4. Google ScholarDigital Library
- Markus Funk, Andreas Bächler, Liane Bächler, Oliver Korn, Christoph Krieger, Thomas Heidenreich, and Albrecht Schmidt. 2015. Comparing projected in-situ feedback at the manual assembly workplace with impaired workers. In Proc. PETRA'15. Google ScholarDigital Library
- Markus Funk, Thomas Kosch, Scott W. Greenwald, and Albrecht Schmidt. 2015. A Benchmark for Interactive Augmented Reality Instructions for Assembly Tasks. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia. ACM. Google ScholarDigital Library
- Markus Funk, Thomas Kosch, Romina Kettner, Oliver Korn, and Albrecht Schmidt. 2016. motionEAP: An Overview of 4 Years of Combining Industrial Assembly with Augmented Reality for Industry 4.0. In i-KNOW '16. ACM, 4.Google Scholar
- Markus Funk, Thomas Kosch, and Albrecht Schmidt. 2016. Interactive Worker Assistance: Comparing the Effects of Head-Mounted Displays, In-Situ Projection, Tablet, and Paper Instructions. In Proc.UbiComp'16. Google ScholarDigital Library
- Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015. Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace. In Proc. ASSETS'15. ACM. Google ScholarDigital Library
- Markus Funk and Albrecht Schmidt. 2015. Cognitive Assistance in the Workplace. Pervasive Computing, IEEE 14, 3 (2015), 53--55.Google ScholarDigital Library
- Nirit Gavish, Teresa Gutiérrez, Sabine Webel, Jorge Rodríguez, Matteo Peveri, Uli Bockholt, and Franco Tecchia. 2013. Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interactive Learning Environments ahead-of-print (2013), 1--21.Google Scholar
- Jens Grubert, Daniel Hamacher, Rüdiger Mecke, Irina Böckelmann, Lutz Schega, Anke Huckauf, Mario Urbina, Michael Schenk, Fabian Doil, and Johannes Tumler. 2010. Extended investigations of user-related issues in mobile industrial ar. In ISMAR'10. IEEE, 229--230.Google ScholarCross Ref
- Thomas Haipeter and Christine Slomka. 2014. Industriebeschäftigung im Wandel: Arbeiter, Angestellte und ihre Arbeitsbedingungen. Technical Report. SOEP.Google Scholar
- Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology 52 (1988), 139--183.Google Scholar
- Steven J Henderson and Steven Feiner. 2009. Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In ISMAR'09. IEEE, 135--144. Google ScholarDigital Library
- Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013. The potentials of in-situ-projection for augmented workplaces in production: a study with impaired persons. In CHI'13 EA. ACM, 979--984. Google ScholarDigital Library
- Thomas Kosch, Romina Kettner, Markus Funk, and Albrecht Schmidt. 2016. Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments. In Proc. ASSETS'16. ACM, 8. Google ScholarDigital Library
- Michael R Marner, Andrew Irlitti, and Bruce H Thomas. 2013. Improving procedural task performance with Augmented Reality annotations. In ISMAR'13. IEEE, 39--48.Google ScholarCross Ref
- Nassir Navab. 2004. Developing killer apps for industrial augmented reality. IEEE CGA 24, 3 (2004), 16--20. Google ScholarDigital Library
- AYC Nee, SK Ong, G Chryssolouris, and D Mourtzis. 2012. Augmented reality applications in design and manufacturing. CIRP 61, 2 (2012), 657--679.Google ScholarCross Ref
- Holger Regenbrecht, Gregory Baratoff, and Wilhelm Wilke. 2005. Augmented reality projects in the automotive and aerospace industries. CGA 25, 6 (2005), 48--56. Google ScholarDigital Library
- Juha Sääski, Tapio Salonen, Mika Hakkarainen, Sanni Siltanen, Charles Woodward, and Juhani Lempiäinen. 2008. Integration of design and assembly using augmented reality. In Micro-Assembly Technologies and Applications. Springer, 395--404.Google Scholar
- Nobuchika Sakata, Takeshi Kurata, Takekazu Kato, Masakatsu Kourogi, and Hideaki Kuzuoka. 2003. WACL: Supporting Telecommunications Using Wearable Active Camera with Laser Pointer. In ISWC'03. IEEE. Google ScholarDigital Library
- Nobuchika Sakata, Takeshi Kurata, and Hideaki Kuzuoka. 2006. Visual assist with a laser pointer and wearable display for remote collaboration. (2006).Google Scholar
- Björn Schwerdtfeger, Rupert Reif, Willibald Günthner, Gudrun Klinker, Daniel Hamacher, Lutz Schega, Irina Böckelmann, Fabian Doil, Johannes Tümler, and others. 2009. Pick-by-Vision: A first stress test. In Proc. ISMAR'09. IEEE, 115--124. Google ScholarDigital Library
- Arthur Tang, Charles Owen, Frank Biocca, and Weimin Mou. 2003. Comparative effectiveness of augmented reality in object assembly. In Proc. CHI'03. ACM, 73--80. Google ScholarDigital Library
- Johannes Tumler, Fabian Doil, Rudiger Mecke, Georg Paul, Michael Schenk, Eberhard A Pfister, Anke Huckauf, Irina Bockelmann, and Anja Roggentin. 2008. Mobile Augmented Reality in industrial applications: Approaches for solution of user-related issues. In ISMAR'08. IEEE, 87--90. Google ScholarDigital Library
- Xianjun Sam Zheng, Cedric Foucault, Patrik Matos da Silva, Siddharth Dasari, Tao Yang, and Stuart Goose. 2015. Eye-wearable technology for machine maintenance: Effects of display position and hands-free operation. In Proc. CHI'15. ACM, 2125--2134. Google ScholarDigital Library
Index Terms
- Working with Augmented Reality?: A Long-Term Analysis of In-Situ Instructions at the Assembly Workplace
Recommendations
Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions
UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous ComputingWith increasing complexity of assembly tasks and an increasing number of product variants, instruction systems providing cognitive support at the workplace are becoming more important. Different instruction systems for the workplace provide instructions ...
Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace
ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & AccessibilityToday's working society tries to integrate more and more impaired workers into everyday working processes. One major scenario for integrating impaired workers is in the assembly of products. However, the tasks that are being assigned to cognitively ...
Haptics in Augmented Reality
ICMCS '99: Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2An augmented reality system merges synthetic sensory information into a user's perception of a three-dimensional environment. An important performance goal for an augmented reality system is that the user perceives a single seamless environment. In most ...
Comments