Diffusion tensor imaging (DTI) can reveal detailed white matter anatomy and has the potential to detect abnormalities in specific white matter structures. Such detection and quantification are, however, not straightforward. The voxel-based analysis after image normalization is one of the most widely used methods for quantitative image analyses. To apply this approach to DTI, it is important to examine if structures in the white matter are well registered among subjects, which would be highly dependent on employed algorithms for normalization. In this paper, we evaluate the accuracy of normalization of DTI data using a highly elastic transformation algorithm, called large deformation diffeomorphic metric mapping. After simulation-based validation of the algorithm, DTI data from normal subjects were used to measure the registration accuracy. To examine the impact of morphological abnormalities on the accuracy, the algorithm was also tested using data from Alzheimer's disease (AD) patients with severe brain atrophy. The accuracy level was measured by using manual landmark-based white matter matching and surface-based brain and ventricle matching as gold standard. To improve the accuracy level, cascading and multi-contrast approaches were developed. The accuracy level for the white matter was 1.88+/-0.55 and 2.19+/-0.84 mm for the measured locations in the controls and patients, respectively.

This paper describes the application of the alternating Kernel mixture (AKM) segmentation algorithm to high resolution MRI subvolumes acquired from a 1.5T scanner (hippocampus, n = 10 and prefrontal cortex, n = 9) and a 3T scanner (hippocampus, n = 10 and occipital lobe, n = 10). Segmentation of the subvolumes into cerebrospinal fluid, gray matter, and white matter tissue is validated by comparison with manual segmentation. When compared with other segmentation methods that use traditional Bayesian segmentation, AKM yields smaller errors (P < .005, exact Wilcoxon signed rank test) demonstrating the robustness and wide applicability of AKM across different structures. By generating multiple mixtures for each tissue compartment, AKM mimics the increased variation of manual segmentation in partial volumes due to the highly folded tissues. AKM's superior performance makes it useful for tissue segmentation of subcortical and cortical structures in large-scale neuroimaging studies.

MRI is a sensitive method for detecting subtle anatomic abnormalities in the neonatal brain. To optimize the usefulness for neonatal and pediatric care, systematic research, based on quantitative image analysis and functional correlation, is required. Normalization-based image analysis is one of the most effective methods for image quantification and statistical comparison. However, the application of this methodology to neonatal brain MRI scans is rare. Some of the difficulties are the rapid changes in T1 and T2 contrasts and the lack of contrast between brain structures, which prohibits accurate cross-subject image registration. Diffusion tensor imaging (DTI), which provides rich and quantitative anatomical contrast in neonate brains, is an ideal technology for normalization-based neonatal brain analysis. In this paper, we report the development of neonatal brain atlases with detailed anatomic information derived from DTI and co-registered anatomical MRI. Combined with a diffeomorphic transformation, we were able to normalize neonatal brain images to the atlas space and three-dimensionally parcellate images into 122 regions. The accuracy of the normalization was comparable to the reliability of human raters. This method was then applied to babies of 37-53 post-conceptional weeks to characterize developmental changes of the white matter, which indicated a posterior-to-anterior and a central-to-peripheral direction of maturation. We expect that future applications of this atlas will include investigations of the effect of prenatal events and the effects of preterm birth or low birth weights, as well as clinical applications, such as determining imaging biomarkers for various neurological disorders.

The schizophrenia research community has invested substantial resources on collecting, managing and sharing large neuroimaging datasets. As part of this effort, our group has collected high resolution magnetic resonance (MR) datasets from individuals with schizophrenia, their non-psychotic siblings, healthy controls and their siblings. This effort has resulted in a growing resource, the Northwestern University Schizophrenia Data and Software Tool (NUSDAST), an NIH-funded data sharing project to stimulate new research. This resource resides on XNAT Central, and it contains neuroimaging (MR scans, landmarks and surface maps for deep subcortical structures, and FreeSurfer cortical parcellation and measurement data), cognitive (cognitive domain scores for crystallized intelligence, working memory, episodic memory, and executive function), clinical (demographic, sibling relationship, SAPS and SANS psychopathology), and genetic (20 polymorphisms) data, collected from more than 450 subjects, most with 2-year longitudinal follow-up. A neuroimaging mapping, analysis and visualization software tool, CAWorks, is also part of this resource. Moreover, in making our existing neuroimaging data along with the associated meta-data and computational tools publically accessible, we have established a web-based information retrieval portal that allows the user to efficiently search the collection. This research-ready dataset meaningfully combines neuroimaging data with other relevant information, and it can be used to help facilitate advancing neuroimaging research. It is our hope that this effort will help to overcome some of the commonly recognized technical barriers in advancing neuroimaging research such as lack of local organization and standard descriptions.

MRI brain atlases are widely used for automated image segmentation, and in particular, recent developments in multi-atlas techniques have shown highly accurate segmentation results. In this study, we extended the role of the atlas library from mere anatomical reference to a comprehensive knowledge database with various patient attributes, such as demographic, functional, and diagnostic information. In addition to using the selected (heavily-weighted) atlases to achieve high segmentation accuracy, we tested whether the non-anatomical attributes of the selected atlases could be used to estimate patient attributes. This can be considered a context-based image retrieval (CBIR) approach, embedded in the multi-atlas framework. We first developed an image similarity measurement to weigh the atlases on a structure-by-structure basis, and then, the attributes of the multiple atlases were weighted to estimate the patient attributes. We tested this concept first by estimating age in a normal population; we then performed functional and diagnostic estimations in Alzheimer's disease patients. The accuracy of the estimated patient attributes was measured against the actual clinical data, and the performance was compared to conventional volumetric analysis. The proposed CBIR framework by multi-atlas voting would be the first step toward a knowledge-based support system for quantitative radiological image reading and diagnosis.

This paper examines the multiple atlas random diffeomorphic orbit model in Computational Anatomy (CA) for parameter estimation and segmentation of subcortical and ventricular neuroanatomy in magnetic resonance imagery. We assume that there exist multiple magnetic resonance image (MRI) atlases, each atlas containing a collection of locally-defined charts in the brain generated via manual delineation of the structures of interest. We focus on maximum a posteriori estimation of high dimensional segmentations of MR within the class of generative models representing the observed MRI as a conditionally Gaussian random field, conditioned on the atlas charts and the diffeomorphic change of coordinates of each chart that generates it. The charts and their diffeomorphic correspondences are unknown and viewed as latent or hidden variables. We demonstrate that the expectation-maximization (EM) algorithm arises naturally, yielding the likelihood-fusion equation which the a posteriori estimator of the segmentation labels maximizes. The likelihoods being fused are modeled as conditionally Gaussian random fields with mean fields a function of each atlas chart under its diffeomorphic change of coordinates onto the target. The conditional-mean in the EM algorithm specifies the convex weights with which the chart-specific likelihoods are fused. The multiple atlases with the associated convex weights imply that the posterior distribution is a multi-modal representation of the measured MRI. Segmentation results for subcortical and ventricular structures of subjects, within populations of demented subjects, are demonstrated, including the use of multiple atlases across multiple diseased groups.

This paper describes neuroinformatics technologies at 1 mm anatomical scale based on high-throughput 3D functional and structural imaging technologies of the human brain. The core is an abstract pipeline for converting functional and structural imagery into their high-dimensional neuroinformatic representation index containing O(1000-10,000) discriminating dimensions. The pipeline is based on advanced image analysis coupled to digital knowledge representations in the form of dense atlases of the human brain at gross anatomical scale. We demonstrate the integration of these high-dimensional representations with machine learning methods, which have become the mainstay of other fields of science including genomics as well as social networks. Such high-throughput facilities have the potential to alter the way medical images are stored and utilized in radiological workflows. The neuroinformatics pipeline is used to examine cross-sectional and personalized analyses of neuropsychiatric illnesses in clinical applications as well as longitudinal studies. We demonstrate the use of high-throughput machine learning methods for supporting (i) cross-sectional image analysis to evaluate the health status of individual subjects with respect to the population data, (ii) integration of image and personal medical record non-image information for diagnosis and prognosis.

The extent and spatial location of white matter hyperintensities (WMH) on brain MRI may be relevant to the development of cognitive decline in older persons. Here, we introduce a new method, known as the Multi-atlas based Detection and Localization (MADL), to evaluate WMH on fluid-attenuated inversion recovery (FLAIR) data. This method simultaneously parcellates the whole brain into 143 structures and labels hyperintense areas within each WM structure. First, a multi-atlas library was established with FLAIR data of normal elderly brains; and then a multi-atlas fusion algorithm was developed by which voxels with locally abnormal intensities were detected as WMH. At the same time, brain segmentation maps were generated from the multi-atlas fusion process to determine the anatomical location of WMH. Areas identified using the MADL method agreed well with manual delineation, with an interclass correlation of 0.97 and similarity index (SI) between 0.55 and 0.72, depending on the total WMH load. Performance was compared to other state-of-the-art WMH detection methods, such as BIANCA and LST. MADL-based analyses of WMH in an older population revealed a significant association between age and WMH load in deep WM but not subcortical WM. The findings also suggested increased WMH load in selective brain regions in subjects with mild cognitive impairment compared to controls, including the inferior deep WM and occipital subcortical WM. The proposed MADL approach may facilitate location-dependent characterization of WMH in older individuals with memory impairment.

In this work we devise a strategy for discrete coding of anatomical form as described by a Bayesian prior model, quantifying the entropy of this representation as a function of code rate (number of bits), and its relationship geometric accuracy at clinically relevant scales. We study the shape of subcortical gray matter structures in the human brain through diffeomorphic transformations that relate them to a template, using data from the Alzheimer's Disease Neuroimaging Initiative to train a multivariate Gaussian prior model. We find that the at 1 mm accuracy all subcortical structures can be described with less than 35 bits, and at 1.5 mm error all structures can be described with less than 12 bits. This work represents a first step towards quantifying the amount of information ordering a neuroimaging study can provide about disease status.

This study examines the atrophy patterns in the entorhinal and transentorhinal cortices of subjects that converted from normal cognition to mild cognitive impairment. The regions were manually segmented from 3T MRI, then corrected for variability in boundary definition over time using an automated approach called longitudinal diffeomorphometry. Cortical thickness was calculated by deforming the gray matter-white matter boundary surface to the pial surface using an approach called normal geodesic flow. The surface was parcellated based on four atlases using large deformation diffeomorphic metric mapping. Average cortical thickness was calculated for (1) manually-defined entorhinal cortex, and (2) manually-defined transentorhinal cortex. Group-wise difference analysis was applied to determine where atrophy occurred, and change point analysis was applied to determine when atrophy started to occur. The results showed that by the time a diagnosis of mild cognitive impairment is made, the transentorhinal cortex and entorhinal cortex was up to 0.6 mm thinner than a control with normal cognition. A change point in atrophy rate was detected in the transentorhinal cortex 9-14 years prior to a diagnosis of mild cognitive impairment, and in the entorhinal cortex 8-11 years prior. The findings are consistent with autopsy findings that demonstrate neuronal changes in the transentorhinal cortex before the entorhinal cortex.

We examined whether cognitive reserve (CR) impacts level of, or rate of change in, biomarkers of Alzheimer's disease (AD) and small-vessel cerebrovascular disease in >250 individuals who were cognitively normal and middle-aged and older at the baseline. The four primary biomarker categories commonly examined in studies of AD were measured longitudinally: cerebrospinal fluid measures of amyloid (A) and tau (T); cerebrospinal fluid and neuroimaging measures of neuronal injury (N); and neuroimaging measures of white matter hyperintensities (WMHs) to assess cerebrovascular pathology (V). CR was indexed by a composite score including years of education, reading, and vocabulary test performance. Higher CR was associated with lower levels of WMHs, particularly among those who subsequently progressed from normal cognition to MCI. CR was not associated with WMH trajectories. In addition, CR was not associated with either levels of, or rate of change in, A/T/N biomarkers. This may suggest that higher CR is associated with lifestyle factors that reduce levels of cerebrovascular disease, allowing individuals with higher CR to better tolerate other types of pathology.

Elucidating how synaptic molecules such as AMPA receptors mediate neuronal communication and tracking their dynamic expression during behavior is crucial to understand cognition and disease, but current technological barriers preclude large-scale exploration of molecular dynamics in vivo. We have developed a suite of innovative methodologies that break through these barriers: a new knockin mouse line with fluorescently tagged endogenous AMPA receptors, two-photon imaging of hundreds of thousands of labeled synapses in behaving mice, and computer vision-based automatic synapse detection. Using these tools, we can longitudinally track how the strength of populations of synapses changes during behavior. We used this approach to generate an unprecedentedly detailed spatiotemporal map of synapses undergoing changes in strength following sensory experience. More generally, these tools can be used as an optical probe capable of measuring functional synapse strength across entire brain areas during any behavioral paradigm, describing complex system-wide changes with molecular precision.

Spatial transcriptomics (ST) technologies enable high throughput gene expression characterization within thin tissue sections. However, comparing spatial observations across sections, samples, and technologies remains challenging. To address this challenge, we developed STalign to align ST datasets in a manner that accounts for partially matched tissue sections and other local non-linear distortions using diffeomorphic metric mapping. We apply STalign to align ST datasets within and across technologies as well as to align ST datasets to a 3D common coordinate framework. We show that STalign achieves high gene expression and cell-type correspondence across matched spatial locations that is significantly improved over manual and landmark-based affine alignments. Applying STalign to align ST datasets of the mouse brain to the 3D common coordinate framework from the Allen Brain Atlas, we highlight how STalign can enable the interrogation of compositional heterogeneity across anatomical structures. STalign is available as an open-source Python toolkit at https://github.com/JEFworks-Lab/STalign and as supplementary software with additional documentation and tutorials available at https://jef.works/STalign .

Although artificial intelligence systems that diagnosis among different conditions from medical images are long term aims, specific goals for automation of human-labor, time-consuming tasks are not only feasible but equally important. Acute conditions that require quantitative metrics, such as acute ischemic strokes, can greatly benefit by the consistency, objectiveness, and accessibility of automated radiological reports.

Prenatal exposure of the brain to environmental insult causes different neurological symptoms and behavioral outcomes depending on the time of exposure. To examine the cellular bases for these differences, we exposed rhesus macaque fetuses to x-rays during early gestation (embryonic day [E]30-E42), i.e., before the onset of corticogenesis, or in midgestation (E70-E81), when superficial cortical layers are generated. Animals were delivered at term (~E165), and the size and cellular composition of prefrontal association cortex (area 46) examined in adults using magnetic resonance imaging (MRI) and stereologic analysis. Both early and midgestational radiation exposure diminished the surface area and volume of area 46. However, early exposure spared cortical thickness and did not alter laminar composition, and due to higher cell density, neuron number was within the normal range. In contrast, exposure to x-rays at midgestation reduced cortical thickness, mainly due to elimination of neurons destined for the superficial layers. A cell-sparse gap, observed within layer III, was not filled by the later-generated neurons destined for layer II, indicating that there is no subsequent replacement of the lost neurons. The distinct areal and laminar pathology consequent to temporally segregated irradiation is consistent with basic postulates of the radial unit hypothesis of cortical development. In addition, we show that an environmental disturbance inflicted in early gestation can induce subtle cytoarchitectonic alterations without loss of neurons, such as those observed in schizophrenia, whereas midgestational exposure causes selective elimination of neurons and cortical thinning as observed in some forms of mental retardation and fetal alcohol syndrome.

We aimed to develop a new method to convert T1-weighted brain MRIs to feature vectors, which could be used for content-based image retrieval (CBIR). To overcome the wide range of anatomical variability in clinical cases and the inconsistency of imaging protocols, we introduced the Gross feature recognition of Anatomical Images based on Atlas grid (GAIA), in which the local intensity alteration, caused by pathological (e.g., ischemia) or physiological (development and aging) intensity changes, as well as by atlas-image misregistration, is used to capture the anatomical features of target images. As a proof-of-concept, the GAIA was applied for pattern recognition of the neuroanatomical features of multiple stages of Alzheimer's disease, Huntington's disease, spinocerebellar ataxia type 6, and four subtypes of primary progressive aphasia. For each of these diseases, feature vectors based on a training dataset were applied to a test dataset to evaluate the accuracy of pattern recognition. The feature vectors extracted from the training dataset agreed well with the known pathological hallmarks of the selected neurodegenerative diseases. Overall, discriminant scores of the test images accurately categorized these test images to the correct disease categories. Images without typical disease-related anatomical features were misclassified. The proposed method is a promising method for image feature extraction based on disease-related anatomical features, which should enable users to submit a patient image and search past clinical cases with similar anatomical phenotypes.

MRI-based human brain atlases, which serve as a common coordinate system for image analysis, play an increasingly important role in our understanding of brain anatomy, image registration, and segmentation. Study-specific brain atlases are often obtained from one of the subjects in a study or by averaging the images of all participants after linear or non-linear registration. The latter approach has the advantage of providing an unbiased anatomical representation of the study population. But, the image contrast is influenced by both inherent MR contrasts and residual anatomical variability after the registration; in addition, the topology of the brain structures cannot reliably be preserved. In this study, we demonstrated a population-based template-creation approach, which is based on Bayesian template estimation on a diffeomorphic random orbit model. This approach attempts to define a population-representative template without the cross-subject intensity averaging; thus, the topology of the brain structures is preserved. It has been tested for segmented brain structures, such as the hippocampus, but its validity on whole-brain MR images has not been examined. This paper validates and evaluates this atlas generation approach, i.e., Volume-based Template Estimation (VTE). Using datasets from normal subjects and Alzheimer's patients, quantitative measurements of sub-cortical structural volumes, metric distance, displacement vector, and Jacobian were examined to validate the group-averaged shape features of the VTE. In addition to the volume-based quantitative analysis, the preserved brain topology of the VTE allows surface-based analysis within the same atlas framework. This property was demonstrated by analyzing the registration accuracy of the pre- and post-central gyri. The proposed method achieved registration accuracy within 1mm for these population-preserved cortical structures in an elderly population.

This paper examines morphometry of MRI biomarkers derived from the network of temporal lobe structures including the amygdala, entorhinal cortex and hippocampus in subjects with preclinical Alzheimer's disease (AD). Based on template-centered population analysis, it is demonstrated that the structural markers of the amygdala, hippocampus and entorhinal cortex are statistically significantly different between controls and those with preclinical AD. Entorhinal cortex is the most strongly significant based on the linear effects model (p < .0001) for the high-dimensional vertex- and Laplacian-based markers corresponding to localized atrophy. The hippocampus also shows significant localized high-dimensional change (p < .0025) and the amygdala demonstrates more global change signaled by the strength of the low-dimensional volume markers. The analysis of the three structures also demonstrates that the volume measures are only weakly discriminating between preclinical and control groups, with the average atrophy rates of the volume of the entorhinal cortex higher than amygdala and hippocampus. The entorhinal cortex thickness also exhibits an atrophy rate nearly a factor of two higher in the ApoE4 positive group relative to the ApoE4 negative group providing weak discrimination between the two groups.

This paper presents recent advances in the use of diffeomorphic active shapes which incorporate the conservation laws of large deformation diffeomorphic metric mapping. The equations of evolution satisfying the conservation law are geodesics under the diffeomorphism metric and therefore termed geodesically controlled diffeomorphic active shapes (GDAS). Our principal application in this paper is on robust diffeomorphic mapping methods based on parameterized surface representations of subcortical template structures. Our parametrization of the GDAS evolution is via the initial momentum representation in the tangent space of the template surface. The dimension of this representation is constrained using principal component analysis generated from training samples. In this work, we seek to use template surfaces to generate segmentations of the hippocampus with three data attachment terms: surface matching, landmark matching, and inside-outside modeling from grayscale T1 MR imaging data. This is formulated as an energy minimization problem, where energy describes shape variability and data attachment accuracy, and we derive a variational solution. A gradient descent strategy is employed in the numerical optimization. For the landmark matching case, we demonstrate the robustness of this algorithm as applied to the workflow of a large neuroanatomical study by comparing to an existing diffeomorphic landmark matching algorithm.

White matter disruption has been suggested as one of anatomical features associated with Alzheimer's disease (AD). Diffusion tensor imaging (DTI), which has been widely used in AD studies, obtains new insights into the white matter structure.