Innovative USC haptic technology introduces the sensation of touch to virtual reality

Touch is fundamental to how humans connect and relate. From infancy to adulthood, physical interaction helps cultivate emotional ties, establish trust, and manage stress. Nevertheless, in the ever-expanding digital landscape, where screens dominate many of our interactions, it is frequently absent.

To address this void, USC Viterbi School of Engineering researchers have developed a haptic wearable system that enables users to transmit physical gestures in virtual reality and experience them instantaneously, even when they are considerably apart.

The system features gloves and sleeves equipped with miniature motors that replicate sensations like pressure and movement. This allows users to execute and perceive gestures such as pats, handshakes, and squeezes within a collaborative virtual atmosphere. Users can also engage with virtual items and receive tangible feedback through vibrations.

Results from a user study evaluating the technology, launched in association with the IEEE World Haptics Conference, revealed that participants regarded virtual interactions as more engaging, enjoyable, and lifelike when they could sense gestures.

“Despite individuals spending equal, if not more, time socializing online, we’re witnessing escalating levels of depression, anxiety, and what is frequently termed ‘touch starvation,’” stated Heather Culbertson, associate professor of computer science and biomedical engineering at USC Viterbi and the study’s lead author.

“Individuals will persist in connecting virtually — it’s an integral part of contemporary life. However, how can we enhance online interactions to better mirror the social advantages of real-world experiences?”

Operating Mechanism

The system accommodates up to 16 users simultaneously, each represented by a complete 3D avatar that reflects their actual movements within a cohesive virtual environment. In contrast to standard video conferences, users can navigate freely around one another and engage with virtual objects — such as passing a cup or accomplishing team tasks.

“This initiative emerged from a fundamental, profoundly human wish: to feel closer to those we cherish,” remarked Premankur Banerjee, a doctoral candidate in Culbertson’s Haptics Robotics and Virtual Interaction Lab and primary author of the research.

“After spending over five years away from my own family, this research transcended academic interest — it was deeply personal,” he added. “This is about leveraging technology

“““html

not merely to replicate presence, but to revive a feeling of physical intimacy that is frequently diminished in long-distance interactions.”

To incorporate the sensation of touch, users don gloves and armbands that are fitted with vibration motors. These gadgets deliver tactile responses that mimic pressure and movement, enabling users to genuinely perceive gestures and interactions with objects within the VR environment.

Laboratory experiments revealed that participants experienced an enhanced sensation of presence and social connection when tactile feedback was integrated. The study also examined how various elements, such as gesture velocity and vibration characteristics, affected emotional and sensory perceptions, offering valuable guidance for designing more captivating virtual touch experiences.

“Creating this technology necessitates knowledge from numerous disciplines,” Culbertson stated. “Our group merges computer science, engineering, neuroscience, psychology, and social sciences to develop hardware and software that not only operates technically but also fosters natural, emotionally significant social interactions.” (View a video from the researchers.)

Reestablishing connections through touch

The worldwide transition to online communication — expedited by the COVID-19 pandemic — has introduced clear advantages but also unforeseen ramifications. Individuals are more interconnected than ever digitally, yet feelings of loneliness, anxiety, and depression continue to be prevalent, particularly among the youth of the nation.

“Although platforms such as Zoom and FaceTime have enabled families, friends, and coworkers to sustain visual and verbal connections, these formats lack the physical presence that humans inherently desire,” Culbertson remarked.

“While this technology will not substitute for the experience of face-to-face interaction, it can serve as a potent tool to enhance social engagement when physical presence is unattainable,” she noted.

In medical facilities and long-term care settings, the researchers’ system could enable patients and family members to share a reassuring touch across distances. In remote and hybrid workplaces and classrooms, it provides more immersive methods for collaboration and participation. For loved ones separated by travel, deployment, or other circumstances, it offers a deeper sense of connection.

“Human touch is essential for our well-being, and while technology cannot fully replace it, incorporating the sensation of touch into virtual environments is a vital advancement toward more meaningful connections in today’s digital landscape,” she stated.