Posted in | News | Biosensors

Multimodal Bracelet Enhances Robotic Hand Control

In a recent article published in the journal Sensors, researchers presented a novel multimodal bracelet designed to enhance the detection of user intent by integrating various biosensors. The device combines surface electromyography (sEMG) sensors, mechanomyography (MMG), and inertial measurement units (IMUs) to capture muscular activity and motion data.

The primary goal of the research is to improve control of robotic and prosthetic hands by decoding complex finger movements, moving beyond reliance on predefined gestures.

Multimodal Bracelet Enhances Robotic Hand Control
Study: Multimodal Bracelet to Acquire Muscular Activity and Gyroscopic Data to Study Sensor Fusion for Intent Detection. Image Credit: valiantsin suprunovich/Shutterstock.com

Background

The increasing demand for advanced control systems in robotic and prosthetic devices has highlighted the limitations of traditional methods that rely on single-sensor technologies. These conventional approaches often struggle to accurately interpret user intent, which is essential for creating responsive and intuitive interactions between humans and machines.

Previous research has shown that combining different types of sensors, such as surface electromyography (sEMG) and inertial measurement units (IMUs), can provide complementary data that improves the overall understanding of user movements.

This is particularly important in applications where precise control is necessary, such as in robotic hands and prosthetic limbs. However, many existing devices utilize custom-designed sensors, which can be expensive and less accessible for widespread use.

The Current Study

The study involved the development and testing of a multimodal bracelet designed to capture muscular activity and motion data for intent detection. The bracelet integrates six commercial surface electromyography (sEMG) sensors, each equipped with a six-axis inertial measurement unit (IMU), alongside a 24-channel force myography (FMG) system. This configuration allows for comprehensive data acquisition from multiple physiological signals.

The study included five male volunteers, each of whom performed a series of five distinct hand gestures in a randomized order. The gestures were selected to represent a range of common movements that individuals might use in daily activities.

The data collection process involved the participants wearing the bracelet on their forearms, where the sensors recorded electrical muscle activity, force exerted, and motion dynamics during the execution of the gestures.

Data acquisition was conducted in a controlled environment, ensuring consistent conditions for all trials. The collected signals were processed and analyzed using a random forest classification model, which was chosen for its effectiveness in handling high-dimensional data and its ability to manage the complexities associated with sensor fusion. The model was trained on the acquired data to classify the gestures based on the combined input from the sEMG, FMG, and IMU sensors.

To evaluate the bracelet's performance, classification accuracy was calculated by comparing the predicted gestures against the actual gestures performed by the participants. The results were statistically analyzed to determine the effectiveness of the sensor fusion approach, with a focus on improvements in accuracy and reductions in misclassification rates compared to using individual sensor modalities. 

Results and Discussion

The study results demonstrated the effectiveness of the multimodal bracelet in classifying hand gestures through sensor fusion. The classification accuracy achieved by combining data from all six sEMG sensors, the FMG system, and the IMUs reached an average of 92.3 ± 2.6% across all participants.

This marked a significant improvement in performance compared to using individual sensor modalities, with misclassification rates reduced by 37% when compared to sEMG alone and by 22% relative to FMG data.

The random forest model effectively distinguished between the five gestures, showcasing the advantages of integrating multiple sensing technologies. The analysis revealed that the combination of muscular activity data from sEMG and force data from FMG provided complementary information, enhancing the model's ability to interpret user intent accurately.

Additionally, the study highlighted the importance of participant variability, as individual differences in muscle activation patterns influenced classification outcomes. The results indicated that the bracelet's design and sensor arrangement were conducive to capturing a wide range of motion dynamics, which contributed to the high classification accuracy.

Conclusion

In conclusion, the study presents a promising advancement in intent detection through the development of a multimodal bracelet that effectively combines multiple sensing modalities.

The findings indicate that sensor fusion can significantly enhance classification accuracy, paving the way for more advanced control of robotic and prosthetic hands. The authors emphasize the need for continued research to explore the full potential of this technology, including the integration of additional sensor types and the application of more complex machine learning algorithms.

By making the design and plans for the bracelet publicly available, the authors aim to encourage further exploration and innovation in the field, ultimately contributing to the development of more effective and user-friendly assistive devices.

The research not only highlights the technical advancements in sensor technology but also addresses the broader implications for improving the quality of life for individuals relying on robotic and prosthetic solutions.

Journal Reference

Andreas D., Hou Z., et al. (2024). Multimodal Bracelet to Acquire Muscular Activity and Gyroscopic Data to Study Sensor Fusion for Intent Detection. Sensors 24(19):6214. DOI: 10.3390/s24196214https://www.mdpi.com/1424-8220/24/19/6214

Dr. Noopur Jain

Written by

Dr. Noopur Jain

Dr. Noopur Jain is an accomplished Scientific Writer based in the city of New Delhi, India. With a Ph.D. in Materials Science, she brings a depth of knowledge and experience in electron microscopy, catalysis, and soft materials. Her scientific publishing record is a testament to her dedication and expertise in the field. Additionally, she has hands-on experience in the field of chemical formulations, microscopy technique development and statistical analysis.    

Citations

Please use one of the following formats to cite this article in your essay, paper or report:

  • APA

    Jain, Noopur. (2024, October 01). Multimodal Bracelet Enhances Robotic Hand Control. AZoSensors. Retrieved on October 12, 2024 from https://www.azosensors.com/news.aspx?newsID=16017.

  • MLA

    Jain, Noopur. "Multimodal Bracelet Enhances Robotic Hand Control". AZoSensors. 12 October 2024. <https://www.azosensors.com/news.aspx?newsID=16017>.

  • Chicago

    Jain, Noopur. "Multimodal Bracelet Enhances Robotic Hand Control". AZoSensors. https://www.azosensors.com/news.aspx?newsID=16017. (accessed October 12, 2024).

  • Harvard

    Jain, Noopur. 2024. Multimodal Bracelet Enhances Robotic Hand Control. AZoSensors, viewed 12 October 2024, https://www.azosensors.com/news.aspx?newsID=16017.

Tell Us What You Think

Do you have a review, update or anything you would like to add to this news story?

Leave your feedback
Your comment type
Submit

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.