Fetal MRI is a critical tool for monitoring brain development, but it requires the fetus to remain still for extended periods. When the baby moves, the series of 2D image slices taken during the scan can become misaligned, creating coverage gaps that obscure fine anatomical details needed to detect abnormal development.
E(3)-Pose tackles this by incorporating the physical principle of equivariance — in this case, left-right symmetry of the fetal head — directly into the neural network architecture. This allows the model to more accurately estimate the brain's orientation as it shifts, even when the motion is complex.
"There are very fine details that you need a very good volumetric picture of the brain to see," said first author Ramya Muthukrishnan, an MIT PhD student in the lab of Professor Polina Golland. "If you have coverage gaps, you can't see critical regions, and you need to be able to see well to detect abnormal development."
The project began after Muthukrishnan shadowed a radiologist at Boston Children's Hospital and observed the frustration shared by pregnant patients and clinicians. Patients often had to spend an hour in the MRI scanner only to abort the scan midway, while radiologists were left without a complete, high-quality image.
Co-author Borjan Gagoski, an assistant professor of radiology at Harvard Medical School and researcher at Boston Children's, developed a supplemental MRI sequence to help train the model. Aryn Lee, a research assistant at Boston Children's, recruited pregnant volunteers and helped acquire the scans.
"Ramya's work elegantly combines geometric concepts like equivariance and symmetry with the power of deep learning to change how MRI scanners acquire the images," said senior author Polina Golland, who is a principal investigator at the MIT Abdul Latif Jameel Clinic for Machine Learning in Health and CSAIL. Ellen Grant, director of the Fetal Neonatal Neuroimaging and Developmental Science Center at Boston Children's, added that the work "will automate fetal brain MRI, replacing today's slow, manual process with faster and more comfortable scans for mothers, while also providing higher-quality images for radiologists to interpret."
E(3)-Pose is currently trained primarily on third-trimester fetuses. Muthukrishnan hopes to extend it to second-trimester scans, where the fetuses are smaller and move more, making them both harder to image and more important for early intervention.
The research was supported by the MIT Jameel Clinic, the MIT Takeda Program, the Chou Family Transformative Research Fund, the National Institute of Biomedical Imaging and Bioengineering, and the Eunice Kennedy Shriver National Institute of Child Health and Human Development.
