From lab to field with machine learning – Bridging the gap for movement analysis in real-world environments: A commentary

Abstract

Biomechanical data collection was largely confined to controlled laboratory setups, relying on marker-based systems or force platforms. However, the emergence of wearable sensors and markerless motion capture has revolutionized this field, enabling data collection in real-world scenarios. This shift has also sparked interest in integrating machine learning (ML) into biomechanical workflows, promising to revolutionize data acquisition in field settings and refine data analysis (Halilaj et al., 2018). Figure 1 provides an overview of corresponding ML applications for key tasks in the biomechanical workflow. This commentary explores the transformative potential of ML in biomechanics, focusing on enhancing data collection and analysis in real-world environments.

Pose estimation (a) is the process of automatically tracking and determining the body’s anatomical landmarks, body segments, or joint centre locations in video images using ML, enabling the quantification of human movement without marker and sensor attachments to the human body. Feature estimation (b) employs ML to predict complex biomechanical data, e.g. joint moments from more accessible data sources, including IMUs, pressure insoles, and RGB video cameras. Event detection (c) in time series data is the annotation of certain events that are used to extract useful and vital information or to remove unwanted and unnecessary data for further analysis. Clustering (d) involves grouping instances or individuals with similar biomechanical characteristics using unsupervised ML, thereby revealing underlying structures and subgroups within complex biomechanical data. Finally, automated classification (e) refers to the process of developing a predictive model that assigns input features of data samples to predefined categories or classes using supervised ML.

Despite the advancements of ML in biomechanics, central challenges are faced. Estimation errors remain critically high depending on the task and application field, necessitating a careful reflection on data acquisition potentials. Furthermore, especially complex Deep Learning models, while showing promising performances, exhibit a lack of transparency in understanding their decision-making processes and the underlying patterns and rules learned from the data. This phenomenon, often termed as the black-box nature of these models, poses a considerable obstacle. In response, Explainable Artificial Intelligence (XAI), a field that encompasses different explainability approaches to shed light on the inner workings of complex, non-linear ML models, has gained increasing attention in recent years (Slijepcevic et al., 2023). A further central challenge is the availability of data and annotations, which describes the limited availability or insufficiency of relevant and comprehensive datasets, as well as task-specific annotations, for conducting thorough analyses and research in biomechanics. The lack of large-scale benchmark datasets available restricts the widespread adoption of ML-based approaches in biomechanics. Privacy concerns present significant ethical and legal issues, e.g. with identifiable video data. Additionally, model validation remains a critical problem, as many studies fail to validate their models on diverse datasets, often relying on limited data from a single laboratory. Furthermore, there is a risk that the fundamental mechanical understanding of biomechanical processes might be overshadowed by an over-reliance on ML techniques.

In conclusion, the integration of ML into biomechanics presents a transformative opportunity for understanding human movement by enabling and improving data collection and analysis in real-world settings. Challenges in data accessibility and methodological transparency necessitate collaborative efforts for future advancements.

References

Halilaj, E., Rajagopal, A., Fiterau, M., Hicks, J. L., Hastie, T. J., & Delp, S. L. (2018). Machine learning in human movement biomechanics: Best practices, common pitfalls, and new opportunities. Journal of Biomechanics, 81, 1-11. https://doi.org/10.1016/j.jbiomech.2018.09.009

Slijepcevic, D., Zeppelzauer, M., Unglaube, F., Kranzl, A., Breiteneder, C., & Horsak, B. (2023). Explainable machine learning in human gait analysis: A study on children with cerebral palsy. IEEE Access, 11, 65906-65923 https://doi.org/10.1109/ACCESS.2023.3289986