Wearable multifunctional organohydrogel-based electronic skin for sign language recognition under complex environments.

• Bayberry tannin was used as the cross-linking agent of acrylic conductive organhydrogel, which reduced the requirement for polymerization. • Organhydrogel possessed excellent physical, adhesive, self-healing, anti-freezing and conductive properties. • The electronic skin based on organhydrogel showed excellent specific recognition of the movement of the human. • E-skin smart glove could seamlessly detect multi-angle free movement of the hand. • With the help of deep learning, e-skin smart gloves could accurately extract hand motion features and translate them in real time. Language barrier is the main cause of disagreement. Sign language, which is a common language in all the worldwide language families, is difficult to be entirely popularized due to the high cost of learning as well as the technical barrier in real-time translation. To solve these problems, here, we constructed a wearable organohydrogel-based electronic skin (e-skin) with fast self-healing, strong adhesion, extraordinary anti-freezing and moisturizing properties for sign language recognition under complex environments. The e-skin was obtained by using an acrylic network as the main body, aluminum (III) and bayberry tannin as the crosslinking agent, water/ethylene glycol as the solvent system, and a polyvinyl alcohol network to optimize the network performance. Using this e-skin, a smart glove was further built, which could carry out the large-scale data collection of common gestures and sign languages. With the help of the deep learning method, specific recognition and translation for various gestures and sign languages could be achieved. The accuracy was 93.5%, showing the ultra-high classification accuracy of a sign language interpreter. In short, by integrating multiple characteristics and combining deep learning technology with hydrogel materials, the e-skin achieved an important breakthrough in human-computer interaction and artificial intelligence, and provided a feasible strategy for solving the dilemma of mutual exclusion between flexible electronic devices and human bodies. A new type of PAA/PVA-based conductive organhydrogel e-skin was prepared using green, natural, cheap and environmentally friendly bayberry tannin as a crosslinking agent, and exhibited excellent physical, self-healing, adhesion and anti-freezing properties, and applied to design and fabricate a smart wearable translation glove for sign language recognition. [Display omitted] [ABSTRACT FROM AUTHOR]

Copyright of Journal of Materials Science & Technology is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)