This technology enables wearable cyber-physical interactive performances by detecting the performer＇s body motions with the on-body detection device and generating signals to control the avatars in the display.

Wearable devices and digital content have gradually been implemented in interactive performance in recent years and become the new niche for the cultural and creative industry. There are many technologies that focus on the processing and analyses of sensing signals as well as the related implementations in the fitness and medical industries. As this system processes different types and modes of the data, it integrates cloud-based real-time interactions and content computing with performing arts. As a result, "interactive digital performances", a new form of performing arts, is created.

The existing cyber-physical digital performances require a finished script and an operator to control the corresponding virtual backgrounds, the music and the motions of the virtual characters so they that interact seamlessly with the real performers. If the performer makes any mistake, the performance may fail to meet the ideal standard. The system includes a "cyber-physical interaction mechanism for wearable devices" and a "script editing and executing mechanism". In other words, the actors, who wear the wearable sensors with this system installed, may interact and perform with the animated characters in a real-time manner during the performance. The system is also built-in with a graphical user interface for "digital script" editing and executing. The users are allowed to set up "interaction rules", "music", "characters" and "scenes" as they wish. The design of cyber-physical interactive performance is thus simplified.

Currently, there is no interactive performance system that is both user-friendly and flexibly adjustable. The system resolves the issue of the real-time corresponding delay between the performer and the virtual images. Also, it helps promote the interactive performances for the accessible graphical interface for script editing does not require much of the advanced knowledge. If applied in an educational site, the system can also enhance the students’ logic and creativity. The system has created infinite possibilities for the digital content industry since the wearable devices can be integrated with many media interfaces such as 3D animations, smart mobile devices, VR and so on.

教育、電玩遊戲、影視展演、娛樂應用