- Open Access
Three-dimensional histopathological reconstruction of bladder tumours
Diagnostic Pathologyvolume 14, Article number: 25 (2019)
Histopathological analysis is the cornerstone in bladder cancer (BCa) diagnosis. These analysis suffer from a moderate observer agreement in the staging of bladder cancer. Three-dimensional reconstructions have the potential to support the pathologists in visualizing spatial arrangements of structures, which may improve the interpretation of specimen. The aim of this study is to present three-dimensional (3D) reconstructions of histology images.
En-bloc specimens of transurethral bladder tumour resections were formalin fixed and paraffin embedded. Specimens were cut into sections of 4 μm and stained with Hematoxylin and Eosin (H&E). With a Phillips IntelliSite UltraFast scanner, glass slides were digitized at 20x magnification. The digital images were aligned by performing rigid and affine image alignment. The tumour and the muscularis propria (MP) were manually delineated to create 3D segmentations. In conjunction with a 3D display, the results were visualized with the Vesalius3D interactive visualization application for a 3D workstation.
En-bloc resection was performed in 21 BCa patients. Per case, 26–30 sections were included for the reconstruction into a 3D volume. Five cases were excluded due to export problems, size of the dataset or condition of the tissue block. Qualitative evaluation suggested an accurate registration for 13 out of 16 cases. The segmentations allowed full 3D visualization and evaluation of the spatial relationship of the BCa tumour and the MP.
Digital scanning of en-bloc resected specimens allows a full-fledged 3D reconstruction and analysis and has a potential role to support pathologists in the staging of BCa.
Histopathological analysis is the cornerstone in bladder cancer (BCa) diagnosis. The histological grade and stage of BCa are important prognostic parameters for therapeutic decision-making [1, 2]. Patients with muscle-invasive bladder cancer have a higher risk of cancer-specific mortality compared to patients without muscle invasion . Initial treatment is generally performed by transurethral resection of the bladder tumour (TURB), allowing tissue removal regardless the location or size. Histopathologic analysis of TURB specimens is limited since it is difficult to determine the degree of invasion . Important landmarks for staging, such as the lamina propria or the muscularis propria (MP), are often difficult to recognize in the small TURB fragments. Moreover, these fragments are often subject to thermal artifacts or tangential sectioning . Both factors result in a poor interobserver agreement of BCa staging . Furthermore, BCa is often understaged at the initial resection because of the absence of MP in the resection specimen . As a result, upstaging to a muscle-invasive tumour after a second TURB occurs in 10–20%  of BCa. To improve staging, en-bloc resections, in which the bladder tumour is resected as a whole are increasingly performed . Previous studies including en-bloc resections have reported to contain MP in 96–100% of cases [3, 7, 8]. In en-bloc resections, a better impression of the spatial arrangement of the tissue can be obtained, assisting the pathologists with the orientation . In general, pathologists examine an average number of 1–2 slides per tissue block, depending on the type of tissue . These sections are only a small fraction of a the three-dimensional (3D) resected specimen. As only a fraction of heterogeneous tissue is examined, undersampling of the BCa specimen is likely to occur. To enable a pathologist to study a complete tissue sample comprehensively, it is necessary to cut and stain multiple consecutive tissue slides. However, it is impractical and time consuming to visualize and analyze a large number of tissue slides per sample by conventional microscopy.
Whole slide image (WSI) systems provide pathologists histopathologic glass slides as digital high resolution images with magnifications similar to conventional microscopy. WSI offers the possibility to create a digital 3D reconstruction based on stacks of two-dimensional (2D) WSIs. 3D reconstructed histology images hold the potential to assist pathologists in visualizing the 3D spatial arrangements of structures. One of the major problems encountered in 3D image reconstruction of histology slides is tissue deformation due to fixation, cutting, and mounting of the specimen during sample preparation [10,11,12,13,14]. Several methods have been proposed to align multiple 2D WSIs to create a 3D image [10,11,12,13,14,15,16]. To our knowledge, the 3D digital reconstruction of BCa tumours from histological slides has not been described before.
In this study, we present a method of preparing, reconstructing and visualizing 3D images reconstructed from multiple consecutive 2D WSIs of BCa en-bloc specimens. Moreover, we introduce a technology that enables interactive manipulation of 3D histological volumes. Additionally, we describe a method to visualize the tumour and MP, without the submucosal layer, allowing to review the spatial relationship of these structures.
Formalin fixed, paraffin-embedded tissue blocks from en-bloc TURB specimens were retrieved from the archive of the Amsterdam UMC, location Academic Medical Center (AMC), the Netherlands. The study was approved by Institutional Review Board of the AMC, Amsterdam (W16_088 # 16.108). Fifty-one sequential sections of 4–5 μm were cut using a microtome. Every second slide was mounted onto a glass slide, leaving the possibility to use the adjacent section for different stains or other imaging modalities.
The mounting protocol, as extension on the protocol created by Soufan et al. was aimed to minimize folding and deformation of the tissue . In short, the tissue section was kept horizontal by placing the section on a drop of water on a glass slide. The glass slides were placed on a hot plate of 42 °C for 2 min, allowing the section to stretch. Using a vacuum pump, water was gently removed. The glass slide was placed on a hot plate of 32 °C for 30 min to let the remaining water evaporate. The slides were dried for at least 2 h at 37 °C and stained with Hematoxylin and Eosin (H&E). Smoothelin (Biocare medical, 1:200 dilution, clone R4A) was used on an additional slide to visualize the smooth muscle bundles of the MP . The slides were stained using an automated slide preparation system (Benchmark Ultra, Ventana). The signal detection was performed with a biotin-free OptiView DAB IHC detection kit (Ventana Medical Systems).
If present, the BCa was staged according to the TNM classification system and the World Health Organization (WHO) 1997 and 2004 grading system .
The glass slides were digitized using the Phillips IntelliSite UltraFast Scanner (Philips Digital Pathology Solutions, Best, the Netherlands) and were exported as a TIFF file at 20x magnification, resulting in images with a resolution of 0.5 μm/pixel. WSIs with tissue folds or out-of-focus areas were excluded. When slides were excluded, a neighboring slide was doubled to have a good representation of the distance between slides.
A pair-wise reconstruction of the bladder tumour was performed by aligning the 2D WSIs, starting the alignment with the center slide. The datasets were aligned using the Elastix toolbox , by performing coarse-to-fine multi-resolution rigid Euler transformation followed by an affine transformation and a subsequent multi-scale b-spline transformation. To speed up the registration, the alignment was performed on 10x downsampled grayscale images. The resulting transformations were applied on the high-resolution images. The normalized correlation coefficient metric was used for the similarity measure. Deformation during the b-spline transformation was restricted by not only taking into account the similarity into the cost-function, but also limit the amount of bending by introducing a bending energy penalty term. Via this term, the sum of the second order spatial derivatives of the transformation, sharp deviations of the transformation are penalized.
Segmentation and visualization
The BCa and the MP were manually delineated by an experienced observer (IJ) using in-house developed software  (Fig. 1) operated on a computer with 28 in. touchscreen (Microsoft Surface Studio, Microsoft, Redmond, USA). These delineations were subsequently checked and corrected by a specialized urinary tract pathologist (CDSH). The segmentations of different structures allow the user to highlight the structures of interest (e.g. tumour), and to see the 3D distribution.
The aligned dataset was imported into a 3D workstation (C-Station, PS-Medtech, Amsterdam, NL) (Fig. 2) and visualized using an interactive application (Vesalius3D, PS-Medtech, Amsterdam, NL). Using optical tracking, footswitches and live 3D rendering, users interact with their data as if they are holding the data in their hands. Thus 3D data volumes can be rotated, zoomed, and virtually sectioned through multiple planes of the data volume.
Qualitative assessment of the registration performance
The accuracy of the alignment of 2D slices to create a 3D volume was qualitatively assessed by two expert observers (IJ, ML) by viewing the 3D renderings. Special attention has been devoted to tissue borders and the course of larger structures (e.g. the lumen of a blood vessel). Misalignment errors were seen as discontinuities between slides.
Figure 3 shows the flow diagram of the included and excluded cases. A total of sixteen en-bloc resection specimens were reconstructed into a 3D volume. The most common reason of slide exclusion was slide loss due to export problems from the Philips server. The size of the datasets varied from 1.5 GB to 66 GB. The number of slides per case varied from 26 to 30. In two patients, slides were doubled due to tissue folds or out-of-focus areas. No difference between the initial staging and staging of the whole 3D reconstructions was observed.
Qualitative assessment showed good alignment in 13 out of 16 cases. 3D reconstruction results of the full rendering, sagittal and detailed view of two datasets are shown in Figs. 4 and 5. Figure 4a-c demonstrates tissue of a papillary low grade (grade 2) Ta BCa with presence of the MP. The zoomed-in images are showing the high quality of the registration. Figure 5a-c shows tissue of a high grade (grade 3) T1 BCa without presence of the MP.
Segmentation and visualization
After importing the aligned datasets into the visualization application Vesalius3D, the datasets were visualized on a 3D monitor. Through the 3D interaction on the C-Station the data could be rotated and virtually scrolled through. This way the multiple slides could be easily evaluated.
Figure 6 shows a tumour in relation to the MP using the segmentations. By using the segmentations, the distance of the BCa and the MP is clearly visible in the Ta tumour. The blurred area might give the pathologist the possibility to clearly view the areas that deviate, and where a more invasive aspect is seen.
We have demonstrated the work-up of high quality 3D reconstructions of en-bloc TURB specimen from sequential 2D WSIs. With the provided segmentations of BCa tumour and MP, the spatial relationship between these structures could be visualized in 3D. By providing better insight in the growth pattern of a tumour, this method has the potential to assist the pathologist in accurate staging of BCa.
To our knowledge, this is the first study focusing on 3D reconstructing BCa tumours out of multiple 2D histological slides. By evaluating a 3D volume instead of the conventional 2D images, we assume that more information can be visualized. We created segmentations of the tumour and the MP and faded out the area in between, to emphasize the distance between these two layers and clarify the changes that occur throughout the different slides. Booth et al. used 3D segmentations to visualize the mammarian lobule in relation to ductal carcinoma in situ and noticed a complexity that was of higher order than was apparent from the 2D slides . A small number of previous studies have created 3D reconstructions out of histological slides, using multiple sections [10,11,12,13,14,15]. Booth et al. discussed the depth of the stack for the 3D reconstruction of breast cancer and found 30 slides, with a thickness of 4 μm, to be an insufficient number for a spatial reconstruction . In future, we aim to increase our reconstructions to determine the optimal number of sections to create a 3D volume. Moreover, we would like to investigate if it is necessary to use consecutive slides. Due to the anisotropic voxel (volumetric pixel) size of the 3D image, important information could be missed.
We have shown good qualitative results in the registration of multiple WSIs. In previous studies that focused on the 3D reconstruction of histological slides, various registration methods have been used [10,11,12,13,14,15]. In our study, we have only used existing open-source tools, being easily accessible. Registration of the WSIs is a challenging task since the volume of the slides within a specimen can differ enormously due to deformation of the tissue. Deformation occurs as a result of the fixation with formalin, cutting and mounting of the specimen. In our protocol, we tried to minimize deformation by adjusting the protocol and keeping the slides as horizontal as possible. Some groups used artificial fiducial markers as a reference point for the registration [14, 22]. These fiducial markers are placed alongside the specimen during embedding. However, during cutting and mounting of the specimen, non-linear deformation occurs throughout the whole specimen, and therefore external fiducial markers cannot predict this deformation for the whole tissue [15, 22]. Other groups have used structures that are visible through several planes as a reference point [10, 13]. However, especially in tumourous tissue, it is difficult to use this method for the basis of alignment because of the heterogeneity of the tumour. Another obstacle for the visualization is the staining inconsistency, which can even be noted within sections, several groups have tried to make up for the staining differences by colour normalization .
In our study, we only mentioned a qualitative measure for the accuracy of registration. Quantitative measures for registration are difficult to determine. Some groups have used Hausdorff evaluation based on manual delineations and concluded only minor registration errors [12, 14]. However, in our study we did not use Hausdorff evaluation due to the lack of anatomic markers in the tissue, in specific within the tumour. Thereby are these anatomic markers mostly based on manual segmentation of the marker, thereby introducing a dependency.
During the sample workup the major reason of slide loss were exportation problems from the Philips server due to the size of the images. Therefore, local storage solutions as well as network speed and infrastructures must be adapted. The FDA recently gave approval for the use of digital slides scanners in diagnostics . We expect that this recent development may give a boost to the use and therefore the evolution of digital slide scanners and subsequently data storage more reliable.
A drawback of the presented methodology is the time consuming process of tissue preparation, as also reported in other studies [12, 13, 25, 26]. Sectioning and mounting of the tissue requires human labour. Onozato et al. have showed a method for automated sectioning with positive results [16, 26]. As for now, this is not common practice in pathology laboratories, since these machines still take more time than manual sectioning . Furthermore, the manually delineation of the tissue structures was a time consuming process. Eventually, automatic tissue segmentation can be implemented . Furthermore, we have used only a small portion of the tumors to create a 3D reconstruction since were not allowed to section entire tumor blocks. In future work we would like to use tumor specimen that we can section completely.
3D pathology has the potential to improve insight in the growth pattern of BCa and thus refine the staging. Although pathologist are trained in visualizing the spatial arrangement of a tumour based on the 2D representation of a single slide, 3D reconstructions could support when orientation of specimen is difficult to determine. Moreover, 3D reconstructions could give better insight in the suggested sub-staging of non-muscle invasive T1 BCa. In T1 BCa the 5-year progression rates vary between 21 and 50% . The two most studied systems, stratification of the muscularis mucosa invasion (T1a versus T1b) and assessing the amount of invasion into the lamina propria (T1e and m), show an increased prognostic value compared to normal T1 staging . The main objection of not implementing the T1a/b sub-staging system in clinical practice is the discontinuous nature of the muscularis mucosae and interobserver variability . The T1e/m staging system however, proved to be a more consistent method [29, 30]. We believe by implementing the 3D reconstructions of en-bloc bladder resection specimen into clinical practice, the visualization of the possible tumour ingrowth can be simplified. In the future, we will focus on the clinical relevance of creating 3D reconstructions for routine diagnosis. Eventually, we need to assess the added value of 3D reconstructions, together with optimizing visualization techniques. Moreover, this could be of use in other fields, such as follicular thyroid neoplasms, to determine invasion depth.
In conclusion, we have created a 3D reconstruction of a BCa tumour out of multiple 2D WSIs. 3D reconstructions show added value of tumour configurations and may improve insight into the architectural changes and refine the classification of BCa by providing detailed spatial and structural information to the assessment by light microscopy.
Carcinoma in situ
Hematoxylin & Eosin
Transurethral resection of bladder tumour
Whole slide imaging
Babjuk M, Böhle A, Burger M, Capoun O, Cohen D, Compérat EM, et al. EAU guidelines on non–muscle-invasive urothelial carcinoma of the bladder: update 2016. Eur Urol 2016;1–15. Available from: http://linkinghub.elsevier.com/retrieve/pii/S0302283816302494
Witjes JA, Compérat E, Cowan NC, De Santis M, Gakis G, James N, et al. Muscle-invasive and metastatic bladder cancer. Eur Urol Guidel. 2015. ISBN:9789079754656 https://uroweb.org/guideline/bladder-cancer-muscle-invasive-and-metastatic/.
Muto G, Collura D, Giacobbe A, D’Urso L, Muto GL, Demarchi A, et al. Thulium:yttrium-aluminum-garnet laser for en bloc resection of bladder cancer: clinical and histopathologic advantages. Urology; 2014;83(4):851–855. Elsevier Inc. Available from: https://doi.org/10.1016/j.urology.2013.12.022
Cheng L, Montironi R, Davidson DD, Lopez-Beltran A. Staging and reporting of urothelial carcinoma of the urinary bladder. Mod Pathol Nat Publ Group. 2009;22:s70–95 Available from: https://doi.org/10.1038/modpathol.2009.1.
Compérat E, Egevad L, Lopez-Beltran A, Camparo P, Algaba F, Amin M, et al. An interobserver reproducibility study on invasiveness of bladder cancer using virtual microscopy and heatmaps. Histopathology. 2013;63:756–66 Available from: https://onlinelibrary.wiley.com/doi/full/10.1111/his.12214.
Gendy R, Delprado W, Brenner P, Brooks A, Coombes G, Cozzi P, et al. Repeat transurethral resection for non-muscle-invasive bladder cancer: a contemporary series. BJU Int. 2016;117:54–9.
Naselli A, Puppo P. En bloc transurethral resection of bladder tumors: a new standard? J Endourol. 2017;31(April):S20–4 Available from: http://online.liebertpub.com/doi/10.1089/end.2016.0534.
Kramer MW, Rassweiler JJ, Klein J, Martov A, Baykov N, Lusuardi L, et al. En bloc resection of urothelium carcinoma of the bladder (EBRUC): a European multicenter study to compare safety, efficacy, and outcome of laser and electrical en bloc transurethral resection of bladder tumor. World J Urol. 2015;33(12):1937–43 Springer Berlin Heidelberg.
Buesa RJ. Productivity standards for histology laboratories. Ann Diagn Pathol; 2010;14(2):107–124. Elsevier Inc.. Available from: https://doi.org/10.1016/j.anndiagpath.2009.12.005
Norton KA, Namazi S, Barnard N, Fujibayashi M, Bhanot G, Ganesan S, et al. Automated reconstruction algorithm for identification of 3D architectures of cribriform ductal carcinoma in situ. PLoS One. 2012;7(9):1–11.
Magee D, Song Y, Gilbert S, Roberts N, Wijayathunga N, Wilcox R, et al. Histopathology in 3D: from three-dimensional reconstruction to multi-stain and multi-modal analysis. J Pathol Inf. 2015;6 Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC4355830/.
Roberts N, Magee D, Song Y, Brabazon K, Shires M, Crellin D, et al. Toward Routine Use of 3D Histopathology as a Research Tool. Am J Pathol. 2012;180(5):1835–42 Elsevier Inc.. Available from: http://linkinghub.elsevier.com/retrieve/pii/S000294401200168X.
Booth ME, Treanor D, Roberts N, Magee DR, Speirs V, Hanby AM. Three-dimensional reconstruction of ductal carcinoma in situ with virtual slides. Histopathology. 2015;66(7):966–73.
Song Y, Treanor D, Bulpitt AJ, Magee DR. 3D reconstruction of multiple stained histology images. J Pathol Inf. 2013;4 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=3678754&tool=pmcentrez&rendertype=abstract.
Marchiò C, Sapino A, Arisio R, Bussolati G. A new vision of tubular and tubulo-lobular carcinomas of the breast, as revealed by 3-D modelling. Histopathology. 2006;48(5):556–62.
Onozato ML, Klepeis VE, Yagi Y, Mino-Kenudson M. A role of three-dimensional (3D)-reconstruction in the classification of lung adenocarcinoma. Anal Cell Pathol. 2012;35(2):79–84.
Soufan AT, Ruijter JM, van den Hoff MJB, de Boer PAJ, Hagoort J, Moorman AFM. Three-dimensional reconstruction of gene expression patterns during cardiac development. Physiol Genomics. 2003;13(3):187–95.
Maake C, Landman M, Wang X, Schmid DM, Ziegler U, John H. Expression of smoothelin in the normal and the overactive human bladder. J Urol. 2006;175(3):1152–7.
Moch H, Humphrey P, Ulbright T, Reuter V.E. (Eds): WHO Classification of Tumours of the Urinary System and Male Genital Organs (4th edition). IARC: Lyon 2016. ISBN: 978-92-832-2437-2.
Klein S, Staring M, Murphy K, Viergever MA, Pluim J. Elastix: a toolbox for intensity-based medical image registration. IEEE Trans Med Imaging. 2010;29(1):196–205.
Kamphuis G, de Bruien D, Brandt M, Knoll T, Conort P, Lapini A, et al. Comparing image perception of bladder Tumours in four different Storz professional image enhancement system ( SPIES ) modalities using the íSPIES app. J Endourol. 2016;30(5):1–20.
Boag AH, Kennedy LA, Miller MJ. Three-dimensional microscopic image reconstruction of prostatic adenocarcinoma. Arch Pathol Lab Med. 2001;125:562–6.
Clarke EL, Treanor D. Colour in digital pathology: a review. Histopathology. 2016:153–63.
Evans AJ, Salama ME, Henricks WH, Pantanowitz L. Implementation of whole slide imaging for clinical purposes issues to consider from the perspective of early adopters. Arch Pathol Lab Med. 2017;141(7):944–59.
Clarke GM, Eidt S, Sun L, Mawdsley G, Zubovits JT, Yaffe MJ. Whole-specimen histopathology: a method to produce whole-mount breast serial sections for 3-D digital histopathology imaging. Histopathology. 2007;50(2):232–42.
Onozato ML, Hammond S, Merren M, Yagi Y. Evaluation of a completely automated tissue-sectioning machine for paraffin blocks. J Clin Pathol. 2013;66:151–4.
van de Fransen Putte EE, Behrendt MA, Pigot GLS, van der Kwast TH, van Rhijn BWG. Prognostic significance of substage and WHO classification systems in T1 urothelial carcinoma of the bladder. Curr Opin Urol. 2015;1 Available from: https://insights.ovid.com/pubmed?pmid=26125511.
Ro JY, Ayala AG, El-Naggar A. Muscularis mucosa of urinary bladder. Am J Surg Pathol. 1987;11(9):668–73.
Van Rhijn BWG, Van Der Kwast TH, Alkhateeb SS, Fleshner NE, Van Leenders GJLH, Bostrom PJ, et al. A new and highly prognostic system to discern T1 bladder cancer substage. Eur Urol. 2012;61(2):378–84.
Bertz S, Denzinger S, Otto W, Wieland WF, Stoehr R, Hofstaedter F, et al. Substaging by estimating the size of invasive tumour can improve risk stratification in pT1 urothelial bladder cancer-evaluation of a large hospital-based single-Centre series. Histopathology. 2011;59(4):722–32.
We would like X.R. Westra and Hanneke Ploegmakers for their work during the project and PS-Medtech for their collaboration.
I Jansen and M Lucas are paid by ITEA3, HA Marquering is founder and shareholder of Nico-lab, DM de Bruin is founder and shareholder of Offroad Medical.
Availability of data and materials
The datasets generated during the current study are not publicly available due to the size of the data but are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
This project did not involve any human participants or animals. The study was approved by Institutional Review Board of the Amsterdam UMC, location AMC (W16_088 # 16.108).
Consent for publication
Not applicable, data used in this manuscript is unidentifiable and no details on individuals are reported.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.