Volume 8 Supplement 1
An oriented service multilayer architecture for virtual microscopy in mobile devices
© Martínez et al; licensee BioMed Central Ltd. 2013
Published: 30 September 2013
The Virtual Slide (VS) is the constructed tool for interaction with a large amount of visual information, using for doing so devices designed to display and interact with the VS, i.e., search of Regions of Interest (RoIs), labeling specific RoIs in the VS, automatic VS or retrieval of certain RoIs . Two main VS advantages, over a glass slide, are the information access and the data maintenance. Disadvantages are related with the computational cost . Overall, slide storing and interaction is carried out from the same device used for display. Mobile devices are of course an extreme case of poor resources  and therefore clever navigation strategies are necessary to optimally interact with the VS.
Related to interaction with VS from mobile devices, there are two main issues to be addressed. The former is related to the storage and access to a large quantity of data, the latter concerns the reconstruction and display of the visual information. Several works have used the JPEG2000 compression standard to address the storage needs [5, 6]. JPEG2000 is an image compression standard designed by the Joint Photographic Expert Group, based on the Discrete Wavelet Transform and the EBCOT encoder . This standard provides several advantages, among others, compression efficiency, lossy and lossless compression and multidimensional data access, i.e., random and multiple resolution data representation and data organization in several quality layers . Likewise, the granularity provided by the standard allows the retrieval of individual packets, guaranteeing transmission of just the number of bytes required to reconstruct particular regions of an image, instead of the whole slide .
As it was mentioned, a reconstruction task can be achieved by taking advantage of the granularity in the JPEG2000 standard. However, the data syntax described in the standard rules out the interactive construction of a valid data stream from arbitrarily ordered packets . Moreover, reconstruction and display of the VS is still an open problem because of the high consumption of computational resource when decompressing the bitstream. A well designed architecture must therefore address the reconstruction task under the perspective of an optimal adaptation of the process policies to the problem.
Material and methods
The proposed architecture was evaluated with a virtual slide of 36000x9200 pixels, each pixel corresponding to 0.67 µm2. The original Virtual Slide had a size of 995 MB, and after JPEG2000 compression, of 226 MB. To run the storage layer, a distributed file system was deployed using 5 Linux nodes. The machines that form the network have limited processing capacity and low speed hard disks (1 GB of memory, processor of 2.2 GHz and disk of 7200 rpm). To run the data access and the proxy layers, two servers were selected; each with operating system OpenSUSE 11.4, 2.8 GHz 4-core processor and 5 GB RAM. Likewise, to run the Samsung Galaxy Tab 10.1 client, under an operating Android system 3.2, it was selected a device with a 1280×800 display size, 1 GB RAM memory and 1 GHz dual-core Nvidia Tegra 2 processor.
The data storage layer is charged of managing the compressed images. A JPEG2000 compressed image typically contains numerous embedded subsets, each standing for any of a large number of different spatial resolutions, image quality layers and spatial regions. This multidimensional access to data is defined in the JPEG2000 standard as spatially adjacent code-blocks, known as precincts. Each precinct is represented as a collection of packets, with one packet per quality layer, resolution level and component . The logical structure of this compressed file is stored in an index file, along with the compressed image, and is herein used to navigate through the compressed file. The second, the data access layer, provides the required services to interact with the information stored in the previous layer. A loosely coupled architecture is maintained by providing the required services to interact with the minimal unit of information, i.e. services to retrieve specific image packets and services to retrieve the compressed image header. The services provided by this layer handle each request independently, thereby guaranteeing a simultaneous information access.
The proxy layer is the backbone of the interaction with the data stored in the first layer. This layer is responsible for two important tasks. The first task is to facilitate interaction with data retrieved by the data access layer, and the second one consists in providing efficient access to the previously requested packets. Provided that the present architecture is service oriented, this third layer receives and sends messages, from which the raw data must be extracted. For doing so, this layer has a decompression module, containing the functions to manage and to map the incoming messages from the data access layer. In addition, this layer implements a simple cache module, charged of checking and/or requesting the required packets to fulfill a requested region. Also, a communication API was designed for mobile devices because of the communication problems presented when using conventional web services since they are difficult to process in such limited devices.
Finally, the client layer is a standalone prototype, whose main function is to map the requested regions to list of packets, and reconstruct Virtual Slides, using information provided by the previous layers. The client uses the communication API and retrieves the required information for reconstruction. The client layer uses also a transformation module that allows the final display of inverse transformed wavelet coefficients.
Results and discussion
Requests with different region size
Transmission time (ms)
Reconstruction time (ms)
Requests with refinement process
Transmission time (ms)
Reconstruction time (ms)
In this article, it was presented a distributed multi-layer architecture that supports interaction between its layers through a service-oriented scheme. It was shown that retrieval and reconstruction times are relatively slow using a refinement process by quality layers.
List of abbreviations
Application Programming Interface
Region of Interest
- Treanor D: Virtual slides: an introduction. Diagnostic Histopathology. 2009, 15 (2): 99-103. 10.1016/j.mpdhp.2009.01.006.View ArticleGoogle Scholar
- Glatz-Krieger K, Glatz D, Mihatsch M: Virtual slides: high-quality demand, physical limitations, and affordability. Human Pathology. 2003, 34 (10): 968-974. 10.1053/S0046-8177(03)00348-4.View ArticlePubMedGoogle Scholar
- Agu E, Banerjee K, Nilekar S, Rekutin O, Kramer D: A middleware architecture for mobile 3D graphics. 25th IEEE International Conference. Distributed Computing Systems Workshops. 2005, 617-623.View ArticleGoogle Scholar
- Taubman D, Rosenbaum R: Rate-distortion optimized interactive browsing of JPEG2000 images. Proceedings. International Conference on Image Processing. 2003, 3: III- 765-768.Google Scholar
- Descampe A, De Vleeschouwer C, Iregui M, Macq B, Marqués F: Prefetching and caching strategies for remote and interactive browsing of JPEG2000 images. IEEE Trans Image Process. 2007, 16 (5): 1339-1354.View ArticlePubMedGoogle Scholar
- Iregui M, Gómez F, Romero E: Strategies for efficient virtual microscopy in pathological samples using JPEG2000. Micron. 2007, 38 (7): 700-713. 10.1016/j.micron.2007.04.008.View ArticlePubMedGoogle Scholar
- ISO/IEC 15444-1, 2000: Information technology JPEG2000 image coding system – Part 1: Core coding system. International Organization for Standardization. 2000Google Scholar
- Rabbani M, Joshi R: An overview of the JPEG 2000 still image compression standard, signal processing. Image Communication. 2002, 17 (1): 3-48.Google Scholar
- Iregui M, Meessen J, Chevalier P, Macq B: Flexible access to JPEG2000 codestreams. 23rd Symposium on Information Theory in the Benelux. 2002Google Scholar
- Taubman D: Remote browsing of JPEG2000 images. Proceedings. International Conference on Image Processing. 2002, 1: I-229-I-232.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.