Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (2024)

Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (2)

Advanced Search

vrst

abstract

  • Authors:
  • Elena Dzardanova Department of Product & Systems Design Engineering, University of the Aegean, Greece

    Department of Product & Systems Design Engineering, University of the Aegean, Greece

    View Profile

    ,
  • Vlasios Kasapakis Department of Cultural Technology and Communication, University of the Aegean, Greece

    Department of Cultural Technology and Communication, University of the Aegean, Greece

    View Profile

    ,
  • Spyros Vosinakis Product & Systems Design Engineering, University of the Aegean, Greece

    Product & Systems Design Engineering, University of the Aegean, Greece

    View Profile

    ,
  • Konstantina Psarrou Dept. of Cultural Technology and Communication, University of the Aegean, Greece

    Dept. of Cultural Technology and Communication, University of the Aegean, Greece

    View Profile

VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and TechnologyNovember 2022Article No.: 72Pages 1–2https://doi.org/10.1145/3562939.3565676

Published:29 November 2022Publication HistorySign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (3)

  • 0citation
  • 114
  • Downloads

Metrics

Total Citations0Total Downloads114

Last 12 Months64

Last 6 weeks5

  • Get Access

VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype

Pages 1–2

PreviousChapterNextChapter

Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (5)

ABSTRACT

Immersive Virtual Reality (IVR) systems support several modalities such as body, finger, eye, and facial expressions tracking, thus they can support sign-language-based communication. The combined utilization of tracking technologies requires careful evaluation to ensure high-fidelity transference of body posture, gestures, and facial expressions in real-time. This paper presents the design, development and evaluation of an IVR system utilizing state-of-the-art tracking options. The system is evaluated by certified sign language teachers to detect usability issues and examine appropriate methodology for large-scale follow-up evaluation by users fluent in sign language.

References

  1. Markowicz, H., Myths About American Sign Language 1, in Recent perspectives on American Sign language. 2017, Psychology Press. p. 1-6.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (6)Cross Ref
  2. Parton, B.S., Sign language recognition and translation: A multidisciplined approach from the field of artificial intelligence. Journal of deaf studies and deaf education, 2006. 11(1): p. 94-101.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (8)
  3. Adamo-Villani, N., E. Carpenter, and L. Arns, 3D sign language mathematics in immersive environment. Proc. of ASM, 2006: p. 2006-2015.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (9)
  4. [1] Kasapakis, V., E. Dzardanova, V. Nikolakopoulou, S. Vosinakis, I. Xenakis, and D. Gavalas. Social Virtual Reality: Implementing Non-verbal Cues in Remote Synchronous Communication. in International Conference on Virtual Reality and Mixed Reality. 2021. Springer.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (10)
  5. [2] Dzardanova, E., V. Kasapakis, and D. Gavalas, Social Virtual Reality, in Encyclopedia of Computer Graphics and Games, N. Lee, Editor. 2018, Springer International Publishing: Cham. p. 1-3.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (11)Cross Ref
  6. [3] Maloney, D., G. Freeman, and D.Y. Wohn, " Talking without a Voice" Understanding Non-verbal Communication in Social Virtual Reality. Proceedings of the ACM on Human-Computer Interaction, 2020. 4(CSCW2): p. 1-25.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (13)
  7. [4] Zirzow, N.K., Signing avatars: Using virtual reality to support students with hearing loss. Rural Special Education Quarterly, 2015. 34(3): p. 33-36.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (14)
  8. [5] Dagnes, N., F. Marcolin, E. Vezzetti, F.-R. Sarhan, S. Dakpé, F. Marin, F. Nonis, and K.B. Mansour, Optimal marker set assessment for motion capture of 3D mimic facial movements. Journal of biomechanics, 2019. 93: p. 86-93.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (15)
  9. [6] Yu, J. and J. Park, Real-time facial tracking in virtual reality, in SIGGRAPH ASIA 2016 VR Showcase. 2016. p. 1-1.Google ScholarSign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (16)Digital Library

Cited By

View all

Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (18)

    Index Terms

    1. Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype
      1. Computer systems organization

        1. Dependable and fault-tolerant systems and networks

        2. Computing methodologies

          1. Modeling and simulation

            1. Simulation types and techniques

              1. Massively parallel and high-performance simulations

          2. General and reference

            1. Cross-computing tools and techniques

              1. Performance

            2. Information systems

              1. Data management systems

                1. Database management system engines

              2. Networks

                1. Network performance evaluation

                2. Software and its engineering

                  1. Software notations and tools

                    1. General programming languages

                      1. Language features

                        1. Inheritance

                    2. Software organization and properties

                      1. Software system structures

                        1. Software system models

                  Recommendations

                  • Future Standards for Immersive VR: Report on the IEEE Virtual Reality 2007 Workshop

                    The Future Standards for Immersive VR Workshop at the IEEE Virtual Reality 2007 Conference aimed to foster an understanding between the VR and Web3D communities. Through multiple tool and application examples, contributors looked at the challenges and ...

                    Read More

                  • Sign Language Recognition: Learning American Sign Language in a Virtual Environment

                    CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

                    In this paper, we propose an approach, for sign language recognition, that makes use of a virtual reality headset to create an immersive environment. We show how features from data acquired by the Leap Motion controller, using an egocentric view, can be ...

                    Read More

                  • VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools

                    UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

                    Haptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...

                    Read More

                  Login options

                  Check if you have access through your login credentials or your institution to get full access on this article.

                  Sign in

                  Full Access

                  Get this Publication

                  • Information
                  • Contributors
                  • Published in

                    Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (19)

                    VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

                    November 2022

                    466 pages

                    ISBN:9781450398893

                    DOI:10.1145/3562939

                    • Editors:
                    • Takafumi Koike

                      Hosei University, Japan

                      ,
                    • Naoya Koizumi

                      The University of Electro-Communications, Japan

                      ,
                    • Gerd Bruder

                      University of Central Florida, USA

                      ,
                    • Daniel Roth

                      Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany

                      ,
                    • Kazuki Takashima

                      Tohoku University, Japan

                      ,
                    • Takefumi Hiraki

                      University of Tsukuba, Japan

                      ,
                    • Yuki Ban

                      The University of Tokyo, Japan

                      ,
                    • Michal Piovarci

                      Institute of Science and Technology Austria, Austria

                    Copyright © 2022 Owner/Author

                    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

                    Sponsors

                      In-Cooperation

                        Publisher

                        Association for Computing Machinery

                        New York, NY, United States

                        Publication History

                        • Published: 29 November 2022

                        Check for updates

                        Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (28)

                        Qualifiers

                        • abstract
                        • Research
                        • Refereed limited

                        Conference

                        Acceptance Rates

                        Overall Acceptance Rate66of254submissions,26%

                        Funding Sources

                        • Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (29)

                          Other Metrics

                          View Article Metrics

                        • Bibliometrics
                        • Citations0
                        • Article Metrics

                          • Total Citations

                            View Citations
                          • 114

                            Total Downloads

                          • Downloads (Last 12 months)64
                          • Downloads (Last 6 weeks)5

                          Other Metrics

                          View Author Metrics

                        • Cited By

                          This publication has not been cited yet

                        PDF Format

                        View or Download as a PDF file.

                        PDF

                        eReader

                        View online with eReader.

                        eReader

                        Digital Edition

                        View this article in digital edition.

                        View Digital Edition

                        HTML Format

                        View this article in HTML Format .

                        View HTML Format

                        • Figures
                        • Other

                          Close Figure Viewer

                          Browse AllReturn

                          Caption

                          View Table of Contents

                          Export Citations

                            Your Search Results Download Request

                            We are preparing your search results for download ...

                            We will inform you here when the file is ready.

                            Download now!

                            Your Search Results Download Request

                            Your file of search results citations is now ready.

                            Download now!

                            Your Search Results Download Request

                            Your search export query has expired. Please try again.

                            Sign Language in Immersive VR: Design, Development, and Evaluation of a Testbed Prototype | Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (2024)

                            References

                            Top Articles
                            Latest Posts
                            Article information

                            Author: Ms. Lucile Johns

                            Last Updated:

                            Views: 5941

                            Rating: 4 / 5 (61 voted)

                            Reviews: 84% of readers found this page helpful

                            Author information

                            Name: Ms. Lucile Johns

                            Birthday: 1999-11-16

                            Address: Suite 237 56046 Walsh Coves, West Enid, VT 46557

                            Phone: +59115435987187

                            Job: Education Supervisor

                            Hobby: Genealogy, Stone skipping, Skydiving, Nordic skating, Couponing, Coloring, Gardening

                            Introduction: My name is Ms. Lucile Johns, I am a successful, friendly, friendly, homely, adventurous, handsome, delightful person who loves writing and wants to share my knowledge and understanding with you.