An oriented service multilayer architecture for virtual microscopy in mobile devices
Diagnostic Pathology volume 8, Article number: S31 (2013)
The Virtual Slide (VS) is the constructed tool for interaction with a large amount of visual information, using for doing so devices designed to display and interact with the VS, i.e., search of Regions of Interest (RoIs), labeling specific RoIs in the VS, automatic VS or retrieval of certain RoIs . Two main VS advantages, over a glass slide, are the information access and the data maintenance. Disadvantages are related with the computational cost . Overall, slide storing and interaction is carried out from the same device used for display. Mobile devices are of course an extreme case of poor resources  and therefore clever navigation strategies are necessary to optimally interact with the VS.
Related to interaction with VS from mobile devices, there are two main issues to be addressed. The former is related to the storage and access to a large quantity of data, the latter concerns the reconstruction and display of the visual information. Several works have used the JPEG2000 compression standard to address the storage needs [5, 6]. JPEG2000 is an image compression standard designed by the Joint Photographic Expert Group, based on the Discrete Wavelet Transform and the EBCOT encoder . This standard provides several advantages, among others, compression efficiency, lossy and lossless compression and multidimensional data access, i.e., random and multiple resolution data representation and data organization in several quality layers . Likewise, the granularity provided by the standard allows the retrieval of individual packets, guaranteeing transmission of just the number of bytes required to reconstruct particular regions of an image, instead of the whole slide .
As it was mentioned, a reconstruction task can be achieved by taking advantage of the granularity in the JPEG2000 standard. However, the data syntax described in the standard rules out the interactive construction of a valid data stream from arbitrarily ordered packets . Moreover, reconstruction and display of the VS is still an open problem because of the high consumption of computational resource when decompressing the bitstream. A well designed architecture must therefore address the reconstruction task under the perspective of an optimal adaptation of the process policies to the problem.
Material and methods
The proposed architecture was evaluated with a virtual slide of 36000x9200 pixels, each pixel corresponding to 0.67 µm2. The original Virtual Slide had a size of 995 MB, and after JPEG2000 compression, of 226 MB. To run the storage layer, a distributed file system was deployed using 5 Linux nodes. The machines that form the network have limited processing capacity and low speed hard disks (1 GB of memory, processor of 2.2 GHz and disk of 7200 rpm). To run the data access and the proxy layers, two servers were selected; each with operating system OpenSUSE 11.4, 2.8 GHz 4-core processor and 5 GB RAM. Likewise, to run the Samsung Galaxy Tab 10.1 client, under an operating Android system 3.2, it was selected a device with a 1280×800 display size, 1 GB RAM memory and 1 GHz dual-core Nvidia Tegra 2 processor.
The proposed architecture exploits the JPEG2000 granularity by dividing the main tasks of the data processing into four layers. The architecture and their main components are shown in Figure 1.
The data storage layer is charged of managing the compressed images. A JPEG2000 compressed image typically contains numerous embedded subsets, each standing for any of a large number of different spatial resolutions, image quality layers and spatial regions. This multidimensional access to data is defined in the JPEG2000 standard as spatially adjacent code-blocks, known as precincts. Each precinct is represented as a collection of packets, with one packet per quality layer, resolution level and component . The logical structure of this compressed file is stored in an index file, along with the compressed image, and is herein used to navigate through the compressed file. The second, the data access layer, provides the required services to interact with the information stored in the previous layer. A loosely coupled architecture is maintained by providing the required services to interact with the minimal unit of information, i.e. services to retrieve specific image packets and services to retrieve the compressed image header. The services provided by this layer handle each request independently, thereby guaranteeing a simultaneous information access.
The proxy layer is the backbone of the interaction with the data stored in the first layer. This layer is responsible for two important tasks. The first task is to facilitate interaction with data retrieved by the data access layer, and the second one consists in providing efficient access to the previously requested packets. Provided that the present architecture is service oriented, this third layer receives and sends messages, from which the raw data must be extracted. For doing so, this layer has a decompression module, containing the functions to manage and to map the incoming messages from the data access layer. In addition, this layer implements a simple cache module, charged of checking and/or requesting the required packets to fulfill a requested region. Also, a communication API was designed for mobile devices because of the communication problems presented when using conventional web services since they are difficult to process in such limited devices.
Finally, the client layer is a standalone prototype, whose main function is to map the requested regions to list of packets, and reconstruct Virtual Slides, using information provided by the previous layers. The client uses the communication API and retrieves the required information for reconstruction. The client layer uses also a transformation module that allows the final display of inverse transformed wavelet coefficients.
Results and discussion
The proposed architecture was twice tested. Firstly, it was requested a variable region size, with constant resolution and quality values. Secondly, the requested regions were refined by requesting higher quality layers. Results show the advantage of retrieving and decompressing (decoding) a particular image region instead of the whole slide. In the first test, the time for resolving a requested region is proportional to the number of required packets to reconstruct it. These results are presented in the Table 1.
In the second test, the time between the requested layers is relatively small, probably because most of the relevant information is mainly compressed in the first layers, leaving small refinement details for the last ones. These results are presented in the Table 2.
In this article, it was presented a distributed multi-layer architecture that supports interaction between its layers through a service-oriented scheme. It was shown that retrieval and reconstruction times are relatively slow using a refinement process by quality layers.
Application Programming Interface
Region of Interest
Treanor D: Virtual slides: an introduction. Diagnostic Histopathology. 2009, 15 (2): 99-103. 10.1016/j.mpdhp.2009.01.006.
Glatz-Krieger K, Glatz D, Mihatsch M: Virtual slides: high-quality demand, physical limitations, and affordability. Human Pathology. 2003, 34 (10): 968-974. 10.1053/S0046-8177(03)00348-4.
Agu E, Banerjee K, Nilekar S, Rekutin O, Kramer D: A middleware architecture for mobile 3D graphics. 25th IEEE International Conference. Distributed Computing Systems Workshops. 2005, 617-623.
Taubman D, Rosenbaum R: Rate-distortion optimized interactive browsing of JPEG2000 images. Proceedings. International Conference on Image Processing. 2003, 3: III- 765-768.
Descampe A, De Vleeschouwer C, Iregui M, Macq B, Marqués F: Prefetching and caching strategies for remote and interactive browsing of JPEG2000 images. IEEE Trans Image Process. 2007, 16 (5): 1339-1354.
Iregui M, Gómez F, Romero E: Strategies for efficient virtual microscopy in pathological samples using JPEG2000. Micron. 2007, 38 (7): 700-713. 10.1016/j.micron.2007.04.008.
ISO/IEC 15444-1, 2000: Information technology JPEG2000 image coding system – Part 1: Core coding system. International Organization for Standardization. 2000
Rabbani M, Joshi R: An overview of the JPEG 2000 still image compression standard, signal processing. Image Communication. 2002, 17 (1): 3-48.
Iregui M, Meessen J, Chevalier P, Macq B: Flexible access to JPEG2000 codestreams. 23rd Symposium on Information Theory in the Benelux. 2002
Taubman D: Remote browsing of JPEG2000 images. Proceedings. International Conference on Image Processing. 2002, 1: I-229-I-232.
The authors declare that they have no competing interests.
LM implemented, deployed, and evaluated the web services for each layer and the results obtained in the reconstruction process. GC implemented and tested the client prototype, the communication API and the codestream transmission for Android Operating System. MI proposed, implemented and tested the index design, construction and parsing, and developed the fundamental ideas underlying this architecture. ER conceived the study, developed the fundamental ideas underlying this architecture, participated in the experimental design and was the director of the whole project. All authors read and approved the final manuscript.
About this article
Cite this article
Martínez, L., Corredor, G., Iregui, M. et al. An oriented service multilayer architecture for virtual microscopy in mobile devices. Diagn Pathol 8 (Suppl 1), S31 (2013). https://doi.org/10.1186/1746-1596-8-S1-S31
- Mobile Device
- Discrete Wavelet Transform
- JPEG2000 Compression
- Virtual Slide
- Joint Photographic Expert Group