Joint Video-MRI Analysis to Relate Movement with Alterations in the Central Nervous System

cns-deficits cns-deficits

Neurodegenerative, such as Parkinson’s Disease (PD) & Alzheimer’s Disease (AD), and neuropsychiatric, e.g., Alcohol Use Disorder (AUD), disorders affect both the central nervous system and how humans move or perform actions in everyday life. Relating motor symptoms recorded through video to neural systems quantified by T1 structural and resting-state functional MRIs can identify novel markers for each disease. They can also determine different disease progression trajectories and help treatment tracking. To understand the neurodegeneration of brain motor systems and take advantage of the information available in video and brain MRI, we develop a multi-modal data-driven analysis using novel deep learning methods. We automatically reduce videos to informative markers, which are then related to disease-characteristic patterns determined from brain structure and function from MRI.

References

[1] Lu et al.: Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson’s Disease Motor Severity, Medical Image Computing and Computer-Assisted Intervention, 2020
[2] Lu et al.: Quantifying Parkinson’s Disease Motor Severity Under Uncertainty Using MDS-UPDRS Videos, Medical Image Analysis, Volume 73, October 2021, 102179
[3] Lemos et al.: Is Frailty Associated with Adverse Outcomes After Orthopaedic Surgery? A Systematic Review and Assessment of Definitions, The Journal of Bone and Joint Surgery (JBJS) Reviews, 2021.
[4] Endo et al.: GaitForeMer: Self-Supervised Pre-Training of Transformers via Human Motion Forecasting for Few-Shot Gait Impairment Severity Estimation, Medical Image Computing and Computer Assisted Intervention, 2022