{"id":3485,"date":"2023-11-10T16:36:34","date_gmt":"2023-11-10T21:36:34","guid":{"rendered":"https:\/\/my.vanderbilt.edu\/masi\/?p=3485"},"modified":"2023-11-10T16:44:20","modified_gmt":"2023-11-10T21:44:20","slug":"reproducibility-evaluation-of-the-effects-of-mri-defacing-on-brain-segmentation","status":"publish","type":"post","link":"https:\/\/my.vanderbilt.edu\/masi\/2023\/11\/reproducibility-evaluation-of-the-effects-of-mri-defacing-on-brain-segmentation\/","title":{"rendered":"Reproducibility evaluation of the effects of MRI defacing on brain segmentation"},"content":{"rendered":"<p>Chenyu Gao, Bennett A. Landman, Jerry L. Prince, Aaron Carass. \u201cReproducibility evaluation of the effects of MRI defacing on brain segmentation\u201d. <em>J. Med. Imag.<\/em> 10(6), 064001 (2023), <a href=\"https:\/\/doi.org\/10.1117\/1.JMI.10.6.064001\">https:\/\/doi.org\/10.1117\/1.JMI.10.6.064001<\/a>, <a href=\"https:\/\/chenyugoal.github.io\/assets\/publications\/JMI-23120GR_online.pdf\">[PDF]<\/a><\/p>\n<h2>Abstract<\/h2>\n<h3>Purpose<\/h3>\n<p>Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing algorithms to protect patient privacy. As a result, there are a number of MR defacing algorithms available to the neuroimaging community, with several appearing in just the last 5 years. While some qualities of these defacing algorithms, such as patient identifiability, have been explored in the previous works, the potential impact of defacing on neuroimage processing has yet to be explored.<\/p>\n<figure id=\"attachment_3486\" aria-describedby=\"caption-attachment-3486\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3486\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f001-650x548.png\" alt=\"A sagittal slice of an MRI is displayed over the reconstruction of the whole head MRI. Top set of images from left to right is the acquired MRI and then defacing using Defacer, QuickShear, Pydeface, and MRI_Deface. The bottom set of images from left to right is defacing using FSL_Deface, Face_Masking, AnonyMI, mri_reface_0.2, and mri_reface_0.3.\" width=\"650\" height=\"548\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f001-650x548.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f001-300x253.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f001-768x648.png 768w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f001.png 1565w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3486\" class=\"wp-caption-text\">Fig. 1 A sagittal slice of an MRI is displayed over the reconstruction of the whole head MRI. Top set of images from left to right is the acquired MRI and then defacing using Defacer, QuickShear, Pydeface, and MRI_Deface. The bottom set of images from left to right is defacing using FSL_Deface, Face_Masking, AnonyMI, mri_reface_0.2, and mri_reface_0.3.<\/figcaption><\/figure>\n<h3>Approach<\/h3>\n<p id=\"ID0EK\">We qualitatively evaluate eight MR defacing algorithms on 179 subjects from the OASIS-3 cohort and 21 subjects from the Kirby-21 dataset. We also evaluate the effects of defacing on two neuroimaging pipelines\u2014SLANT and FreeSurfer\u2014by comparing the segmentation consistency between the original and defaced images.<\/p>\n<h3 class=\"main-title\">Results<\/h3>\n<p>Defacing can alter brain segmentation and even lead to catastrophic failures, which are more frequent with some algorithms, such as Quickshear, MRI_Deface, and FSL_deface. Compared to FreeSurfer, SLANT is less affected by defacing. On outputs that pass the quality check, the effects of defacing are less pronounced than those of rescanning, as measured by the Dice similarity coefficient.<\/p>\n<figure id=\"attachment_3487\" aria-describedby=\"caption-attachment-3487\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3487\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f002-650x505.png\" alt=\"DSC between the segmentations of the unaltered images and the defaced images in the OASIS-3 cohort: In each column, we present the results for a specific defacing algorithm with two \u201craincloud\u201d plots. The raincloud plots with the \u201ccloud\u201d on the left correspond to the SLANT comparison, whereas the plots with the \u201ccloud\u201d on the right correspond to FreeSurfer. The individual \u201craindrops\u201d correspond to the mean DSC of the labels (by SLANT or FreeSurfer) of a specific subject from the OASIS-3 cohort.\" width=\"650\" height=\"505\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f002-650x505.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f002-300x233.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f002-768x596.png 768w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3487\" class=\"wp-caption-text\">Fig. 2 DSC between the segmentations of the unaltered images and the defaced images in the OASIS-3 cohort: In each column, we present the results for a specific defacing algorithm with two \u201craincloud\u201d plots. The raincloud plots with the \u201ccloud\u201d on the left correspond to the SLANT comparison, whereas the plots with the \u201ccloud\u201d on the right correspond to FreeSurfer. The individual \u201craindrops\u201d correspond to the mean DSC of the labels (by SLANT or FreeSurfer) of a specific subject from the OASIS-3 cohort.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3488\" aria-describedby=\"caption-attachment-3488\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3488\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f003-650x578.png\" alt=\"DSC for the segmentation (of SLANT or FreeSurfer) between unaltered and defaced images for seven ROIs for subjects from the OASIS-3 cohort. The top collection of images shows SLANT labels on a particular subject from the OASIS-3 cohort. Surrounding the MRI are seven raincloud plots that correspond to specific ROIs. The bottom collection of images shows the FreeSurfer labels for the same OASIS-3 subject and raincloud plots for anatomically comparable ROIs.\" width=\"650\" height=\"578\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f003-650x578.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f003-300x267.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f003-768x683.png 768w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3488\" class=\"wp-caption-text\">Fig. 3 DSC for the segmentation (of SLANT or FreeSurfer) between unaltered and defaced images for seven ROIs for subjects from the OASIS-3 cohort. The top collection of images shows SLANT labels on a particular subject from the OASIS-3 cohort. Surrounding the MRI are seven raincloud plots that correspond to specific ROIs. The bottom collection of images shows the FreeSurfer labels for the same OASIS-3 subject and raincloud plots for anatomically comparable ROIs.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3489\" aria-describedby=\"caption-attachment-3489\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3489\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f004-650x391.png\" alt=\"DSC between segmentations of the unaltered first scan, the defaced first scan, and aligned rescan on the Kirby-21 dataset. In each column, we present the results for the segmentation comparison between the unaltered first scan and either a defaced first scan or the unaltered rescan aligned to the first scan. The raindcloud plots are explained in Fig. 2. Key: \u201c rescan + rigid \u201d\u2014rescan registered with rigid registration; \u201c rescan + affine \u201d\u2014rescan registered with affine registration; \u201c rescan + syn \u201d\u2014rescan registered with SyN based deformable registration.\" width=\"650\" height=\"391\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f004-650x391.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f004-300x180.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f004-768x462.png 768w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3489\" class=\"wp-caption-text\">Fig.4 DSC between segmentations of the unaltered first scan, the defaced first scan, and aligned rescan on the Kirby-21 dataset. In each column, we present the results for the segmentation comparison between the unaltered first scan and either a defaced first scan or the unaltered rescan aligned to the first scan. The raindcloud plots are explained in Fig. 2. Key: \u201crescan+rigid\u201d\u2014rescan registered with rigid registration; \u201crescan+affine\u201d\u2014rescan registered with affine registration; \u201crescan+syn\u201d\u2014rescan registered with SyN based deformable registration.<\/figcaption><\/figure>\n<h3 class=\"main-title\">Conclusions<\/h3>\n<p id=\"ID0EQ\">The effects of defacing are noticeable and should not be disregarded. Extra attention, in particular, should be paid to the possibility of catastrophic failures. It is crucial to adopt a robust defacing algorithm and perform a thorough quality check before releasing defaced datasets. To improve the reliability of analysis in scenarios involving defaced MRIs, it is encouraged to include multiple brain segmentation pipelines.<\/p>\n<figure id=\"attachment_3490\" aria-describedby=\"caption-attachment-3490\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3490\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f005-650x622.png\" alt=\"Example of type II failure cases. The columns from left to right show the unaltered (original) data and the results of FSL_deface, MRI_Deface, and Quickshear. The rows from top to bottom show 3D renderings of the head before and after defacing by the three algorithms, then sagittal, coronal, and axial slices with their corresponding SLANT segmentation overlaid. The red cross marks the same position in each image and shows where brain voxels are removed by defacing.\" width=\"650\" height=\"622\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f005-650x622.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f005-300x287.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f005-768x735.png 768w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f005.png 1548w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3490\" class=\"wp-caption-text\">Fig. 5 Example of type II failure cases. The columns from left to right show the unaltered (original) data and the results of FSL_deface, MRI_Deface, and Quickshear. The rows from top to bottom show 3D renderings of the head before and after defacing by the three algorithms, then sagittal, coronal, and axial slices with their corresponding SLANT segmentation overlaid. The red cross marks the same position in each image and shows where brain voxels are removed by defacing.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3491\" aria-describedby=\"caption-attachment-3491\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3491\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f006-650x570.png\" alt=\"Fig. 6 FreeSurfer outlier comparison. MRIs overlaid with their corresponding FreeSurfer segmentations. The arrows point to a location where the label given by FreeSurfer segmentation changed dramatically after processing either by a defacing algorithm or the registration of the rescan image. We repeat the original FreeSurfer results on both the top and bottom left column for easier comparison across the rows.\" width=\"650\" height=\"570\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f006-650x570.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f006-300x263.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f006-768x674.png 768w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f006.png 1553w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3491\" class=\"wp-caption-text\">Fig. 6 FreeSurfer outlier comparison. MRIs overlaid with their corresponding FreeSurfer segmentations. The arrows point to a location where the label given by FreeSurfer segmentation changed dramatically after processing either by a defacing algorithm or the registration of the rescan image. We repeat the original FreeSurfer results on both the top and bottom left column for easier comparison across the rows.<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n<figure id=\"attachment_3492\" aria-describedby=\"caption-attachment-3492\" style=\"width: 650px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-3492\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2023\/11\/Chenyu_JMI_10_6_064001_f007-650x492.png\" alt=\"Fig. 7 Two FreeSurfer outliers. MRIs overlaid with their corresponding FreeSurfer segmentations. The left two columns are results from unaltered (original) MRI and defaced by Face_Masking for one subject, and the right two columns are from another subject. These are the worst two subjects in our comparison with mean DSC below 0.7. Key: \u201cL\u201d denotes left and \u201cR\u201d denotes right.\" width=\"650\" height=\"492\" srcset=\"https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f007-650x492.png 650w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f007-300x227.png 300w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f007-768x581.png 768w, https:\/\/cdn.vanderbilt.edu\/t2-my\/my-prd\/wp-content\/uploads\/sites\/2304\/2023\/11\/Chenyu_JMI_10_6_064001_f007.png 1558w\" sizes=\"auto, (max-width: 650px) 100vw, 650px\" \/><figcaption id=\"caption-attachment-3492\" class=\"wp-caption-text\">Fig. 7 Two FreeSurfer outliers. MRIs overlaid with their corresponding FreeSurfer segmentations. The left two columns are results from unaltered (original) MRI and defaced by Face_Masking for one subject, and the right two columns are from another subject. These are the worst two subjects in our comparison with mean DSC below 0.7. Key: \u201cL\u201d denotes left and \u201cR\u201d denotes right.<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Chenyu Gao, Bennett A. Landman, Jerry L. Prince, Aaron Carass. \u201cReproducibility evaluation of the effects of MRI defacing on brain segmentation\u201d. J. Med. Imag. 10(6), 064001 (2023), https:\/\/doi.org\/10.1117\/1.JMI.10.6.064001, [PDF] Abstract Purpose Recent advances in magnetic resonance (MR) scanner quality and the rapidly improving nature of facial recognition software have necessitated the introduction of MR defacing&#8230;<\/p>\n","protected":false},"author":9582,"featured_media":3504,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[27,116,82,40,194],"tags":[],"class_list":["post-3485","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-big-data","category-image-processing","category-magnetic-resonance-imaging","category-reproducibility","category-segmentation"],"_links":{"self":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/3485","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/users\/9582"}],"replies":[{"embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/comments?post=3485"}],"version-history":[{"count":11,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/3485\/revisions"}],"predecessor-version":[{"id":3503,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/3485\/revisions\/3503"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/media\/3504"}],"wp:attachment":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/media?parent=3485"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/categories?post=3485"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/tags?post=3485"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}