Volume 8 Supplement 1
Fifth generation telepathology systems. Workflow analysis of the robotic dynamic telepathology Component
© Braunhut et al; licensee BioMed Central Ltd. 2013
Published: 30 September 2013
Fifth generation telepathology systems are dual-modality systems (i.e., digital pathology systems) that combine whole slide imaging (WSI) and real-time dynamic robotic telepathology. Hybrid robotic dynamic/static image telepathology systems were the precursors of fifth generation telepathology systems and can be used as surrogates for fifth generation systems in workflow studies [1–4].
Variability in human performance was identified as a pathology issue in the first scientific paper on telepathology, published in 1987 . In a study performed under highly controlled conditions, it was shown that individual pathologists had a range of thresholds for diagnosing breast cancer on frozen sections. The use of the “equivocal for malignancy” diagnostic category varied significantly among the six pathologists enrolled in an Receiver Operating Characteristic (ROC) video microscopy human performance study. Surprisingly, use of this category was essentially the same for both conventional light microscopy and video microscopy for each pathologist . In another early study, Dunn et al., using a hybrid dynamic robotic/static image telepathology system, documented patterns of telepathology primary diagnoses case deferrals for seven telepathologists over a 12-year period of time. These seven telepathologists rendered provisional primary surgical pathology diagnoses on over 11,000 surgical pathology cases. Case deferral rates among the telepathologists varied from 2.5% to 32.7% [6, 7].
In this workflow study, we compared the QA case deferral rates of general pathologists and subspecialty surgical pathologists staffing a telepathology-based QA program. Fifth generation telepathology systems are an extension of the hybrid dynamic robotic/static image system concept, replacing the gallery of individual static images with a single large whole slide imaging (WSI) file.
Materials and methods
Telepathology-based quality assurance service
UMC initiated a QA telepathology consultation service between Lake Havasu City, Arizona and Tucson, Arizona (approximately 300 miles away) in July 2005. The Arizona Telemedicine Program (ATP) provided the broadband telecommunications infrastructure for the service as well as a telepathology case coordinator. These QA services continued uninterrupted until October 2009 when HRMC changed direction and decided to outsource all of its laboratory services to a commercial reference laboratory for cost savings.
During this study, the HRMC pathology laboratory handled 3,000-4,000 surgical pathology cases per year and was locally staffed by a single pathologist. Surgical cases at HRMC were accessioned, grossed, embedded in paraffin and glass slides were produced in the HRMC laboratory. All new cancer cases and any other challenging surgical pathology cases were identified by the HRMC pathologist for telepathology QA review.
QA cases reviewed via telepathology had been diagnosed with a written report generated by the HRMC pathologist prior to telepathology. A remotely controllable hybrid robotic-dynamic telepathology system (Apollo PACS ®, Falls Church, VA) was used to transmit a stream of digital images, via the ATP network, from Lake Havasu City, Arizona to Tucson, Arizona. The case video images were reviewed in real-time and remotely navigated by the on-service triage telepathologist at UMC, in Tucson. The telepathologist, linked to the HRMC pathologist in Lake Havasu City, was able to collaborate face-to-face via real-time videoconferencing, a feature built into the Apollo system. At the time of each telepathology review, the HRMC pathology report and accompanying patient medical history/demographic data were made available to the telepathologist in Tucson.
Study cases and data analysis
Between July 2005 and October 2009, 1862 cases were transmitted from HRMC to UMC.
After completion of case accruals, data analysis commenced. The provisional surgical pathology reports (HRMC) and the final telepathology case reports (UMC) were compiled. Data compiled included date of telepathology review, name of telepathologist, specimen organ system, preliminary diagnosis, and final telepathology diagnosis. These data were uploaded into a Microsoft Excel spreadsheet and tallied for case load per telepathologist, number of cases per organ system, and deferral rates. The HRMC and UMC diagnoses were compared and classified by a senior pathologist as being either concordant or discordant. Discordant diagnoses were further sub-classified by the staff pathologist as a major discrepancy (one that would alter clinical management) or a minor discrepancy (one that would not change clinical management).
Cases were further evaluated with regards to the telepathologist’s area of subspecialty surgical pathology expertise. A t-test for paired observations was used to determine if there was a statistically significant difference in deferral rates and a Chi-square test was done to determine if the distributions of deferral rates differed across readers (null hypotheses=deferral rate expected to be the same).
Results and discussion
Of the 1815 analytical cases, 1650 cases (90.91%) were signed out directly by the triage telepathologist. The remaining 165 cases (9.09%) were deferred for further analysis by a subspecialty surgical pathologist or for special studies such as immunohistochemistry.
Levels of concordance
Concordance of HRMC and UMC diagnoses. Table 1 includes 42 cases that were initially viewed by two telepathologists.
Total cases excluding pathologists subspecialty
Total deferred cases excluding pathologists subspecialty
Deferral rate overall
Deferral rate of cases within pathologists subspecialty
Deferral rate excluding pathologists subspecialty
This study evaluated a real-time telepathology QA program using the CTP case workflow model. The overall concordance rate between primary (HRMC) and final (UMC) diagnosis was 94.27%. Of the discordant diagnoses, 2.90% represented major discrepancies and 2.83% represented minor discrepancies. In clinical practice, this discordance rate could be of concern [9, 10].
Overall discordance rates were minimally changed with exclusion of cases within each telepathologist’s subspecialty area. Conversely, UMC subspecialty surgical pathologists performed well in the role of general triage pathologist (Figure 1). This supports the use of subspecialty surgical pathologists as the general triage pathologist in a telepathology-based QA program.
This CTP workflow telepathology model, blending the services of university-based subspecialty surgical pathologists and a community-based general pathologist, provided a means for improving the quality of community-based laboratory services, presented opportunities for UMC-based community outreach, and increased the efficiency of a second opinion QA program. Service provider and user satisfaction were high.
Based on these data and observations, we suggest that the likelihood of a reviewing telepathologist agreeing or disagreeing with a diagnosis rendered at an outside hospital is not a function of the reviewers’ expertise alone, but rather may be related to other human factors, even possibly the personality type of the telepathologist. For individual pathologists, there was a strong relationship between rates of case deferrals for cases within their own area of subspecialty expertise as compared with cases they handled that were outside of their area of subspecialty expertise. Low, intermediate, and high level users of the “case deferral” option could be identified. It would be of interest to conduct Myers-Briggs personality assessments on pathologists and to correlate personality assessment results with other quantifiable pathologist performance measures such as surgical pathology case deferral rates, rates of equivocation on malignant diagnoses, and others.
List of abbreviations
Arizona Telemedicine Program
Case Triage Practice
Havasu Regional Medical Center
subspecialty pathology practice
University Medical Center
whole slide imaging.
We thank Fangru Lian, MD, Raymond Nagle, MD-PhD, and Judith Pugh, MD for their pathology expertise and contributions to the review of data sets for this study.
- Weinstein RS, Graham AR, Lian F, Braunhut BL, Barker GR, Krupinski EA, Bhattacharyya AK: Reconciliation of diverse telepathology system designs. Historical issues and implications for emerging markets and new applications. APMIS. 2012, 120 (4): 256-275. 10.1111/j.1600-0463.2011.02866.x.View ArticlePubMed
- Kaplan KJ, Weinstein RS, Pantanowitz L: Telepathology. Pathology informatics: modern practice & theory for clinical laboratory computing. Edited by: Pantanowitz L, Balis U, Tuthill M. 2012, american society for clinical pathology press, 257-272.
- Della Mea V, Cataldi P, Pertoldi B, Beltrami CA: Combining dynamic- and static-robotic techniques for real-time telepathology. Telepathology. Edited by: Kumar S, Dunn BE. 2009, Berlin, Springer, 79-89.
- Weinstein RS, Descour MR, Liang C: Telepathology overview: from concept to implementation. Hum Pathol. 2012, 32 (12): 1283-99.View Article
- Weinstein RS, Bloom KJ, Rozek LS: Telepathology and the networking of pathology diagnostic services. Arch Pathol Lab Med. 1987, 111 (7): 646-52.PubMed
- Dunn BE, Choi H, Almagro UA, Recla DL, Krupinski EA, Weinstein RS: Routine surgical pathology in the Department of Veterans Affairs: experience-related improvements in pathologist performance in 2200 cases. Telemedicine J. 1999, 5 (4): 323-337. 10.1089/107830299311899.View Article
- Dunn BE, Choi H, Recla DL, Kerr SE, Wagenman BL: Robotic surgical telepathology between the Iron Mountain and Milwaukee Department of Veterans Affairs Medical Centers: a 12-year experience. Hum Pathol. 2009, 40 (8): 1092-1099. 10.1016/j.humpath.2009.04.007.View ArticlePubMed
- Bhattacharyya AK, Davis JR, Halliday BE, Graham AR, Leavitt SA, Martinez R, Rivas R, Weinstein RS: Case triage model for the practice of telepathology. Telemedicine J. 1995, 1 (1): 9-17. 10.1089/tmj.1.1995.1.9.View Article
- Weinstein RS, Graham AM, Richter LC, Barker GP, Krupinski EA, Lopez AM, Erps KA, Yagi Y, Gilbertson JR, Bhattacharyya AK: Overview of telepathology, virtual microscopy and whole slide imagining: Prospects for the future. Hum Pathol. 2009, 40 (8): 1057-1069. 10.1016/j.humpath.2009.04.006.View ArticlePubMed
- Kayser K, Szymas J, Weinstein RS: Telepathology and Telemedicine: Communication, Electronic Education and Publication in e-Health. 2005, VSV Interdisciplinary Medical Publishing, Berlin, 1-257.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.