Multisite reliability and repeatability of an advanced brain MRI protocol.

Multisite reliability and repeatability of an advanced brain MRI protocol.

Publication date: Jan 16, 2019

MRI is the imaging modality of choice for diagnosis and intervention assessment in neurological disease. Its full potential has not been realized due in part to challenges in harmonizing advanced techniques across multiple sites.

To develop a method for the assessment of reliability and repeatability of advanced multisite-multisession neuroimaging studies and specifically to assess the reliability of an advanced MRI protocol, including multiband fMRI and diffusion tensor MRI, in a multisite setting.


Twice repeated measurement of a single subject with stable relapsing-remitting multiple sclerosis (MS) at seven institutions.

A 3 T MRI protocol included higher spatial resolution anatomical scans, a variable flip-angle longitudinal relaxation rate constant (R ≡ 1/T ) measurement, quantitative magnetization transfer imaging, diffusion tensor imaging, and a resting-state fMRI (rsFMRI) series.

Multiple methods of assessing intrasite repeatability and intersite reliability were evaluated for imaging metrics derived from each sequence.

Student’s t-test, Pearson’s r, and intraclass correlation coefficient (ICC) (2,1) were employed to assess repeatability and reliability. Two new statistical metrics are introduced that frame reliability and repeatability in the respective units of the measurements themselves.

Intrasite repeatability was excellent for quantitative R , magnetization transfer ratio (MTR), and diffusion-weighted imaging (DWI) based metrics (r > 0.95). rsFMRI metrics were less repeatable (r = 0.8). Intersite reliability was excellent for R , MTR, and DWI (ICC >0.9), and moderate for rsFMRI metrics (ICC∼0.4).

From most reliable to least, using a new reliability metric introduced here, MTR > R > DWI > rsFMRI; for repeatability, MTR > DWI > R > rsFMRI. A graphical method for at-a-glance assessment of reliability and repeatability, effect sizes, and outlier identification in multisite-multisession neuroimaging studies is introduced.

1 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2019.

Schwartz, D.L., , Tagge, Powers, K., Ahn, S., Bakshi, R., Calabresi, P.A., Todd Constable, R., Grinstead, J., Henry, R.G., Nair, G., Papinutto, N., Pelletier, D., Shinohara, R., Oh, J., Reich, D.S., Sicotte, N.L., Rooney, W.D., and Cooperative, NAIMS. Multisite reliability and repeatability of an advanced brain MRI protocol. 17171. 2019 J Magn Reson Imaging.

Please signin to view all article content and metadata.

Leave a Comment

Your email address will not be published. Required fields are marked *