{"id":574,"date":"2016-11-01T00:08:15","date_gmt":"2016-11-01T05:08:15","guid":{"rendered":"https:\/\/my.vanderbilt.edu\/masi\/?p=574"},"modified":"2017-02-08T14:02:04","modified_gmt":"2017-02-08T19:02:04","slug":"dax-the-next-generation-towards-one-million-processes-on-commodity-hardware","status":"publish","type":"post","link":"https:\/\/my.vanderbilt.edu\/masi\/2016\/11\/dax-the-next-generation-towards-one-million-processes-on-commodity-hardware\/","title":{"rendered":"DAX \u2013 The Next Generation: Towards One Million Processes on Commodity Hardware"},"content":{"rendered":"<p>Stephen M. Damon, Brian D. Boyd, Andrew J. Plassard, Warren Taylor, Bennett A. Landman. \u201cDAX \u2013 The Next Generation: Towards One Million Processes on Commodity Hardware\u201d In Proceedings of the SPIE Medical Imaging Conference. Orlando, Florida, February 2017. Oral presentation.<\/p>\n<p><strong>Full Text:\u00a0<\/strong><\/p>\n<h2>Abstract<\/h2>\n<p>Large-scale image processing demands a standardized way of storage and distribution. The eXtensible Neuroimaging Archive Toolkit (XNAT) is one such platform. Distribution Automation for XNAT (DAX) is a job distribution manager. Recent projects have revealed bottlenecks for projects with 37,000 pipelines. We have developed an API using a direct connection to the database. We have optimized DAX to keep track of processing status on disk, rather than on XNAT. Finally, we have integrated DAX into a Docker. Using our new API, we reduced the time to create assessors 270 fold. DISKQ, using pyXnat, decreased time to launch jobs 200 fold.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-1077\" src=\"https:\/\/my.vanderbilt.edu\/masi\/wp-content\/uploads\/sites\/2304\n2661\/2016\/11\/Screen-Shot-2017-02-08-at-1.01.11-PM.png\" alt=\"Screen Shot 2017-02-08 at 1.01.11 PM\" width=\"300\" height=\"294\" \/><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Stephen M. Damon, Brian D. Boyd, Andrew J. Plassard, Warren Taylor, Bennett A. Landman. \u201cDAX \u2013 The Next Generation: Towards One Million Processes on Commodity Hardware\u201d In Proceedings of the SPIE Medical Imaging Conference. Orlando, Florida, February 2017. Oral presentation. Full Text:\u00a0 Abstract Large-scale image processing demands a standardized way of storage and distribution. The&#8230;<\/p>\n","protected":false},"author":6322,"featured_media":1077,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[69],"tags":[],"class_list":["post-574","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cloud-computing"],"_links":{"self":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/574","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/users\/6322"}],"replies":[{"embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/comments?post=574"}],"version-history":[{"count":4,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/574\/revisions"}],"predecessor-version":[{"id":1079,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/posts\/574\/revisions\/1079"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/media\/1077"}],"wp:attachment":[{"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/media?parent=574"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/categories?post=574"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/my.vanderbilt.edu\/masi\/wp-json\/wp\/v2\/tags?post=574"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}