Distributed computing in image analysis using open source frameworks and application to image sharpness assessment of histological whole slide images
© Zerbe et al; licensee BioMed Central Ltd. 2011
Published: 30 March 2011
Automated image analysis on virtual slides is evolving rapidly and will play an important role in the future of digital pathology. Due to the image size, the computational cost of processing whole slide images (WSIs) in full resolution is immense. Moreover, image analysis requires well focused images in high magnification.
We present a system that merges virtual microscopy techniques, open source image analysis software, and distributed parallel processing. We have integrated the parallel processing framework JPPF, so batch processing can be performed distributed and in parallel. All resulting meta data and image data are collected and merged. As an example the system is applied to the specific task of image sharpness assessment. ImageJ is an open source image editing and processing framework developed at the NIH having a large user community that contributes image processing algorithms wrapped as plug-ins in a wide field of life science applications. We developed an ImageJ plug-in that supports both basic interactive virtual microscope and batch processing functionality. For the application of sharpness inspection we employ an approach with non-overlapping tiles. Compute nodes retrieve image tiles of moderate size from the streaming server and compute the focus measure. Each tile is divided into small sub images to calculate an edge based sharpness criterion which is used for classification. The results are aggregated in a sharpness map.
Based on the system we calculate a sharpness measure and classify virtual slides into one of the following categories - excellent, okay, review and defective. Generating a scaled sharpness map enables the user to evaluate sharpness of WSIs and shows overall quality at a glance thus reducing tedious assessment work.
Using sharpness assessment as an example, the introduced system can be used to process, analyze and parallelize analysis of whole slide images based on open source software.
Automated analysis of whole slide images (WSIs) is a growing challenge in scientific research in digital pathology. Image processing software usually works on standard-size images whereas virtual slides are very large. Due to the image size the computational cost of processing whole slide images in high resolution is immense. We present a system that combines virtual microscopy and public domain image analysis software running within a distributed parallel processing framework available in open source.
In terms of image analysis slide preparation, illumination, focus, and stitching are crucial factors for high quality scans. Image acquisition process for whole slide images has been considerably improved over the last years. Nevertheless, manual inspection of image sharpness is often still required after scanning. It is a tedious and time consuming task with a high inter and intra observer variability. We choose automatic sharpness assessment on histological WSIs as an exemplary application of distributed image analysis. It demonstrates how the new system can be used for standardized image quality assessment in high throughput scenarios.
With the availability of public domain image processing libraries and free open source parallelization frameworks, we have combined these with recent virtual microscopy technologies such as WSI streaming servers [1, 2] to provide a free processing environment for rapid prototyping of image analysis algorithms for WSIs.
NIH ImageJ [3, 4] is an interactive open source image processing software and library developed at the National Institutes of Health. Its large user community contributes extensions (plug-ins) in a wide field of life science applications. Several plug-in bundles for microscopic images are available that are based on ImageJ [5, 6]. We have developed a plug-in to add capabilities for handling WSIs.
Algorithms with large processing power requirements, such as most image analysis tasks on WSIs, can often be split into smaller parts and executed simultaneously on different computers. In this work the Java Parallel Processing Framework (JPPF) was used to process WSIs on standard PCs as compute nodes . We employed an approach with non-overlapping tiles in a predefined resolution, where compute nodes retrieve image tiles of moderate size from a WSI streaming server. Each node processes the same set of ImageJ plug-ins independently. All resulting data are collected and merged within the JPPF environment using domain specific merger implementations.
Many different criteria exist to measure sharpness in an image [8–12]. Sun et al. compared 18 focus algorithms where sum-modified-Laplacian (SML) showed the best overall results . Wei et al. confirmed its quality . Besides, the well known Tenenbaum gradient has been found to be a reasonable focus measure when execution time is taken into account. Most publications deal with autofocus applications, where the sharpest image in a stack of focus images has to be found during image acquisition. In non z-stack WSIs sharpness has to be evaluated on a single focus plane after slide scanning. Analysis has to be done in full resolution, since sub sampling of images results in sharper images. We used a modified Tenenbaum gradient for sharpness assessment application and applied it to non-overlapping tiles. Compute nodes simultaneously determine the focus measure for distinct image tiles in full resolution. Each tile is divided into small sub images to calculate the sharpness measure. The results are aggregated in a sharpness map.
Automatic sharpness assessment of whole slide images is an exemplary application of the proposed framework. It could be shown that the chosen sharpness measure reproduces results of manual sharpness inspection.
JPPF offers functions to integrate standard PCs into a parallelization grid by running a worker node service with low priority. Standard office PCs can be employed for parallel processing purposes without interfering with regular work. Moreover, no additional costs for infrastructure or maintenance are generated.
So far limiting factors for scalability of the introduced system are 1) speed of delivering source images by the image provider and 2) amount of result data to be merged after processing. To improve image provider speed we are currently adding load balancing capabilities for multiple WSI streaming servers. Merging result data inside a relational database management system can resolve limitations of memory based merging.
The most prominent toolkit in open source medical image analysis, ImageJ with its wide range of available algorithms, has been made applicable to virtual microscopy. Hence, based on the presented components it is possible to interactively as well as automatically process and analyze WSIs within ImageJ. Furthermore, distributed batch processing of WSIs using an open source parallel processing framework (JPPF) is seamlessly integrated with the plug-in concept of ImageJ.
The introduced open system architecture can be adapted within various application contexts and proves flexibility and scalability. Furthermore, it reduces processing time. The introduced bridging technology between ImageJ, JPPF, and virtual microscopy image streaming servers has applications in rapid prototyping of scientific image analysis software, education and is also an option for cost effective solutions in upcoming high throughput image analysis scenarios.
This work was supported by the German Federal State of Berlin in the framework of the “Zukunftsfonds Berlin” and the Technology Foundation Innovation center Berlin (TSB) within the project “Virtual Specimen Scout”. It was co-financed by the European Union within the European Regional Development Fund (EFRE).
This article has been published as part of Diagnostic Pathology Volume 6 Supplement 1, 2011: Proceedings of the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy. The full contents of the supplement are available online at http://www.diagnosticpathology.org/supplements/6/S1
- Saeger K, Schlüns K, Schrader T, Hufnagl P: The virtual microscope for routine pathology based on a PACS system for 6 Gb images. Proceedings of the 17th International Congress and Exhibition CARS 2003: 25-28 June 2003; London. Edited by: Lemke HU. 2003, Amsterdam: Elsevier, 299-304.Google Scholar
- Zwönitzer R, Kalinski T, Hofmann H, Roessner A, Bernarding J: Digital pathology: DICOM-conform draft, testbed, and first results. Comput Methods Programs Biomed. 2007, 87: 181-188. 10.1016/j.cmpb.2007.05.010.View ArticlePubMedGoogle Scholar
- NIH ImageJ: [http://rsb.info.nih.gov/ij]
- Abramoff MD, Magelhaes PJ, Ram SJ: Image Processing with ImageJ. Biophotonics International. 2004, 11: 36-42.Google Scholar
- Schindelin J: Fiji is just ImageJ - Batteries included. Proceedings of the ImageJ User and Developer Conference: 6-7 November 2008. 2008, LuxembourgGoogle Scholar
- Collins TJ: ImageJ for microscopy. Biotechniques. 2007, 43: 25-30. 10.2144/000112517.View ArticlePubMedGoogle Scholar
- Java Parallel Processing Framework: [http://www.jppf.org]
- Sun Y, Duthaler S, Nelson BJ: Autofocusing in computer microscopy: selecting the optimal focus algorithm. Microsc Res Tech. 2004, 65: 139-149. 10.1002/jemt.20118.View ArticlePubMedGoogle Scholar
- Huang W, Jing Z: Evaluation of focus measures in multi-focus image fusion. Pattern Recognit Lett. 2007, 28: 493-500. 10.1016/j.patrec.2006.09.005.View ArticleGoogle Scholar
- Kayser K, Görtler J, Metze K, Goldmann T, Vollmer E, Mireskandari M, Kosjerina Z, Kayser G: How to measure image quality in tissue-based diagnosis (diagnostic surgical pathology). Diagn Pathol. 2008, 3 (Suppl 1): 11-10.1186/1746-1596-3-S1-S11.View ArticleGoogle Scholar
- Yeo T, Ong S, Jayasooriah SR: Autofocusing for tissue microscopy. Image Vis Comput. 1993, 11: 629-639. 10.1016/0262-8856(93)90059-P.View ArticleGoogle Scholar
- Subbarao M, Choi T, Nikzad A: Focusing Techniques. Machine Vision Applications Architectures, and Systems Integration (Proceedings of SPIE): 17-18 November 1992; Boston. Edited by: Batchelor BG. 1992, SPIE, 163-174.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.