Cervicovaginal cytology in patients undergoing pelvic radiotherapy using the Focalpoint system: results from the RODEO study
© Stein et al.; licensee BioMed Central. 2015
Received: 13 June 2014
Accepted: 15 December 2014
Published: 16 January 2015
Evaluate the performance of the Focalpoint system in identifying and classifying cervical cytology alterations from samples collected from patients treated with Radiotherapy (RT).
The reproducibility of manual and automated screening by cytotechnologists using the BD Focalpoint GS Imaging System was examined. Samples were collected from May 2010 to August 2011.
A total of 378 treated with RT and 8,967 cytology samples from patients without previous RT, were evaluated. The kappa values for cytological diagnoses read manually and automated in cases without previous RT were as follows: < ASC-H vs. ≥ ASC-H = 0.71; < LSIL vs. ≥ LSIL = 0.66; and < HSIL vs. ≥ HSIL = 0.67. The kappa for cytological diagnoses in post-RT women have showed: < ASC-H vs. ≥ ASC-H = 0.71; < LSIL vs. ≥ LSIL = 0.65; < HSIL vs. ≥ HSIL = 0.57.
There was no significant difference among the kappa values we found. Post-RT cytology showed small diagnostic agreement between manual and automated examination.
The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/13000_2014_231
KeywordsPap test Radiotherapy Automation Focalpoint SurePath
Radiotherapy (RT) is commonly used to treat invasive cervical cancer and other gynaecological malignancies and has high treatment efficacy . RT, however, can induce important changes in cellular morphology that can generate bizarre cell shapes that persist for several years . Despite some controversies, cervicovaginal cytology remains an auxiliary tool for diagnosing gynaecological tumour recurrence after radiotherapy . Nevertheless, most abnormalities related to radiation exposure should be carefully evaluated to avoid misinterpretation . Atypical mitosis, dyskaryosis, severe keratinisation, vacuoles mimicking Chlamydia infection, and koilocytosis-like structures mimicking human papillomavirus (HPV) infection are frequently observed after radiotherapy and represent sources of cytological misdiagnosis [3-5].
The difficulties in interpreting post-RT cervical samples, usually obtained from conventional Pap test smears, were also observed in liquid-based cytology (LBC) preparations. However, patients’ cells are generally well-preserved in LBC samples. Wright and colleagues  reported an index of satisfactory samples similar to that of non-irradiated samples (approximately 97%), and associated benign alterations after radiation were found in approximately 50% of cases. Despite the well-known limitations of cytology in precisely categorising cytological findings after RT, the frequency of positive Pap tests for HSIL or squamous cell carcinoma (SCC) after RT is generally low, which minimises the potential errors .
Currently, automated screening has been suggested as a useful tool with which to safely accelerate an accurate cytological screening. Although there is limited evidence, the sensitivity of automated screening seems similar to that of manual screening . The available data, however, are conflicting. Nevertheless, to achieve acceptable performance in relation to automated screening, manual screening must be restricted to very low workloads (≤41 slides/day) . The efficacy of the Pap test in revealing cytological abnormalities largely depends on the time spent on the screening in addition to the professional skill of the cytotechnologists . Regardless, automated screening is an important option for an internal quality control system, as the number of cytotechnologists has recently been decreasing, and the HPV vaccine is likely to reduce the accuracy of cytological examination due to the associated decreasing number of cervical abnormalities [9,10]. Consequently, automation seems to be a promising tool to assure the quality of a cytology laboratory and avoid errors. Moreover, positive effects of automation on productivity have been reported . All together, these findings seem realistic for ordinary samples but not necessarily for those from post-RT patients. Preneoplastic changes in women undergoing radiotherapy due to genital cancers were proven to be HPV-related lesions, demonstrating that the candidate HPV assay is a powerful ancillary test for cytology .
This study aimed to compare the cytological interpretation of samples collected from women who did or did not undergo previous pelvic RT analysed manually versus samples analysed under Focalpoint (FPGS) guidance.
The cytological samples were prepared and examined at the Barretos Cancer Hospital between May 2010 and August 2011. A total of 9,345 cervicovaginal cytologies preserved in SurePath™ solution were analysed. The samples were prepared in the BD PrepStain™ System (Burlington, NC, USA) according to the manufacturer’s instructions.
The manual screening of the slides was routinely performed using light optical microscopes by well-trained cytotechnologists. These slides were re-analysed under guidance of the Focalpoint system (Burlington, NC, USA) and randomly and blindly re-evaluated after 12 months by the same group of cytotechnologists using the automated screening Guided Screening Review Station (GS) of the BD Focalpoint GS Imaging System (FPGS). No additional training was applied for the cytotechnologists between the first and the second round of slides’ review.
Cytology classification followed the Bethesda system . Prevalence ratios were calculated and compared based on their 95% confidence intervals. The kappa coefficients and the respective 95% confidence intervals were calculated to evaluate the diagnostic agreement among the cytotechnologists for both manual and computer-guided screenings.
We also evaluated the frequency and prevalence ratio of cytological results and compare with biopsy CIN 2 +.
All women enrolled in this study signed informed consent forms to participate in the study, which was approved by the Ethics committee of the Barretos Cancer Hospital (id number 244/2009).
Number and percentage of cases according to cytology result and previous radiotherapy status read manually
No previous radiotherapy
95% CI (PR)
0.87 – 0.94
0.9 – 4.5
ASC-H + AGC
2.9 – 8.1
1.3 – 4.5
HSIL or worse
2.1 – 5.7
Number and percentage of cases according to cytology result and previous radiotherapy status read under FPGS orientation
No previous radiotherapy
95% CI (PR)
0.84 – 0.92
1.95 – 6.14
ASC-H + AGC
2.40 – 6.38
0.98 – 3.27
HSIL or worse
3.00 – 7.66
Number and percentage of CIN2+ cases based on the biopsies according to cytology result and previous radiotherapy status read manually
No previous radiotherapy
95% CI (PR)
ASCUS + ASCH + AGC
0.4 – 1.7
0.1 – 3.8
HSIL or worse
0.5 – 1.2
Number and percentage of CIN2+ cases based on the biopsies according to cytology result and previous radiotherapy status read under FPGS orientation
No previous radiotherapy
95% CI (PR)
ASCUS + ASCH + AGC
0.93 – 2.55
0.16 – 2.49
HSIL or worse
0.44 – 1.36
Kappa values between manual and automated screening among cytotechnologists in women who did or did not undergo previous radiotherapy
< ASC-H vs. ≥ ASC-H
< LSIL vs. ≥ LSIL
< HSIL vs. ≥ HSIL
No previous radiotherapy N = 8,967
Previous radiotherapy N = 378
The results obtained in this study are unique and original in Brazil. The results demonstrated that previous radiotherapy could introduce important morphological changes that inhibit the specific classification of cellular alterations and favours the cytological categorisation of uncertainty.
In our laboratory, we introduced the concept of internal quality control in cytology supported by an automated method of analysis in order to improve cytological interpretation, theoretically reducing the errors of cytological classification. The subjectivity of manual screening performed by cytotechnologists was examined critically and accurately, and the results obtained in this study provide interesting data to support a significant change in the paradigm of cervical cancer prevention in our hospital, whereby automation can serve concurrently as an option for primary screening and/or as an important tool for internal quality control of cytological diagnosis. Our findings demonstrated, however, that automated screening offers diagnostic performance similar to that of the manual method, even in cases of high-grade lesions, when performed by highly well-trained professionals. These results enabled the automated system FPGS to be introduced into the routine protocol of the cytology laboratory of the Department of Pathology of Barretos Cancer Hospital.
The post-radiation cytology assessment performed in the present study offered substantial data concerning the quality and limitations of cytological examination by automated equipment. The frequencies of lesions found after radiotherapy were as follows: ASC (ASCUS, ASC-H, and AGC), 6.1%; LSIL, 2.9%; and HSIL or worse, 4.5% read manually and read under FPGS orientation were: ASC 8,2%, LSIL 2,9% and HSIL or worse 4,8%. These results are different from those obtained by Wright and colleagues , who reported lower frequencies of HSIL or worse than our study (ASCUS, 5.1%; LSIL, 1.0%; HSIL, 0.3%; and carcinoma, 0.7%). Our results are also different from an Italian study, where frequencies ranged from 9.2% for cancer to 13.8% for atypical squamous cells of undetermined significance . These large variations among studies clearly emphasise the difficulties of categorising the effects induced in cervical cells by radiation. The biopsy study of these alterations (Tables 3 and 4), however, reflects the under- and over-estimation that these ionising effects induce, as most of the cytological results are not corroborated by histopathological evaluation. In our study, numerous cases of post-radiation high-grade lesions identified by cytology were not confirmed by biopsy. This finding illustrates that cytological alterations did not correspond to tissue modifications compatible with the diagnosis of intraepithelial lesions. Accordingly, ancillary methods for diagnosis and monitoring of post-radiotherapy patients are necessary to avoid alarming patients and performing unnecessary invasive biopsies.
It is also relevant to emphasise that the manual screening in this study occurred under routine conditions, but for the automated screenings, which were executed almost one year after the initial diagnoses, the cytotechnologists read all the slides blinded of any clinical and laboratorial information of patient (including RT status), which could certainly have influenced the morphological classification. This is especially true for dubious cytological alterations that are frequently found in cases of cell atrophy alterations and post-radiotherapy cytological preparations. For this reason, the analyses of diagnostic reproducibility were performed separately for patients who had and had not undergone RT.
The agreement between the manual and automated screening techniques demonstrated that there was substantial agreement among the cytotechnologists regarding patients who had not undergone RT, but the level of agreement varied significantly for patients who had undergone RT, ranging from substantial agreement with regard to ASC-H and LSIL classifications to moderate agreement for HSIL categorisation. Not surprisingly, the results showed similar kappa values among all observers except for cases of high-grade lesions in patients who had undergone RT, which yielded lower kappa values. Lower concordance from patients’ samples after RT is expected due to the bias that radiation induces, which favours the cytological categorisation of uncertainty.
To the best of our knowledge, no study focusing on FPGS use in post-radiotherapy cervical samples has been reported. Few recent studies evaluating the reproducibility of cytological screening using liquid-based preparations have demonstrated interesting results with image digitalisation. Tsilalis and colleagues  studied the performance of a group of pathologists who analysed digital cytology images; this same group reassessed the same images after 12 and 24 months, and the agreement between the readings varied from substantial to excellent, with kappa values varying between 0.79 and 0.97. Through the quality program in Austria, the Pap tests of patients with invasive cervical carcinoma collected in the 5 years prior to disease detection were re-evaluated. The kappa values found between the original and re-assessed readings of the slides were only moderate .
A moderate reproducibility has been the most common finding in reports related to the interobserver interpretations of cervical cytological under different scenarios . Our study demonstrated interesting data regarding the performance of cytotechnologists, as most of the results showed substantial reproducibility. Additionally, the significant reproducibility with different kappa values between the two screening techniques shows that the replacement of manual screening with automated screening does not cause loss of positive cases, with high levels of agreement between the manual and automated screening.
Liquid-based cytology has also additional value introducing the molecular biology approach among different lesions from several regions with diverse types of cytological samples. Of note, the relevance of hTERC amplification are feasible to be analysed by FISH technique associated with more progressive CIN3 and carcinoma if present in HPV positive cases in cervical material . Similarly, the genomic amplification pattern of human telomerase RNA gene test was demonstrated to be highly sensitive and suitable for cervical cancer screening in samples preserved in liquid medium, but not C-MYC test because of its lower sensitivity . New options of cellular staining are currently available to improve the quality of the traditional staining protocols observations . In the near future we can speculate that these new staining tools could be also used with the ancillary assistance of computerized screening.
The potential use of automation in underserved regions is a good option to compensate for the absence of well-trained professionals for slide reading. Moreover, automated reading can improve both the primary screening and/or internal quality control of cytological diagnosis by selecting appropriate fields of observation for cytotechnologists in samples with and without RT effects.
The authors are indebted to BD Brazil, which partially supported the study by providing the SurePath™ collection kits and equipment. The study design, screening, statistical analyses, and manuscript writing were independently performed by the Center for the Researcher Support of the Barretos Cancer Hospital.
- Wagner A, Jhingran A, Gaffney D. Intensity modulated radiotherapy in gynecologic cancers: hope, hype or hyperbole? Gynecol Oncol. 2013;130:229–36.PubMedView ArticleGoogle Scholar
- Rimel BJ, Ferda A, Erwin J, Dewdney SB, Seanon L, Gao F, et al. Cervicovaginal cytology in the detection of recurrence after cervical cancer treatment. Obstet Gynecol. 2011;118:548–53.PubMedView ArticleGoogle Scholar
- Longatto Filho A, Maeda MY, Oyafuso MS, Alves VA, Kanamura CT, Bortolan J. Cytomorphologic evidence of human papillomavirus infection in smears from the irradiated uterine cervix. Acta Cytol. 1997;41:1079–84.PubMedView ArticleGoogle Scholar
- Longatto Filho A, Maeda MY, Oyafuso MS, Kanamura CT, Alves VA. Herpes simplex virus in postradiation cervical smears: a morphologic and immunocytochemical study. Acta Cytol. 1990;34:652–6.PubMedGoogle Scholar
- Wright JD, Herzog TJ, Mutch DG, Gibb RK, Rader JS, Davila RM, et al. Liquid-based cytology for the postirradiation surveillance of women with gynecologic malignancies. Gynecol Oncol. 2003;91:134–8.PubMedView ArticleGoogle Scholar
- Chien CR, Ting LL, Hsieh CY, Lai MS. Post-radiation Pap smear for Chinese patients with cervical cancer: a ten-year follow-up. Eur J Gynaecol Oncol. 2005;26:619–22.PubMedGoogle Scholar
- Stein MD, Fregnani JH, Scapulatempo C, Mafra A, Campacci N, Longatto-Filho A, et al. Performance and reproducibility of gynecologic cytology interpretation using the FocalPoin system: results of the RODEO Study Team. Am J Clin Pathol. 2013;140:567–71.PubMedView ArticleGoogle Scholar
- Renshaw AA, Elsheikh TM. Assessment of manual workload limits in gynecologic cytology: reconciling data from 3 major prospective trials of automated screening devices. Am J Clin Pathol. 2013;139:428–33.PubMedView ArticleGoogle Scholar
- Sweeney BJ, Wilbur DC. Effects on cervical cytology screening productivity associated with implementation of the BD FocalPoint™ Guided Screener Imaging System. Acta Cytol. 2013;57:147–52.PubMedView ArticleGoogle Scholar
- Franco EL, Cuzick J. Cervical cancer screening following prophylactic human papillomavirus vaccination. Vaccine. 2008;26:A16–23.PubMedView ArticleGoogle Scholar
- Barzon L, Pizzighella S, Corti L, Mengoli C, Palù G. Vaginal dysplastic lesions in women with hysterectomy and receiving radiotherapy are linked to high-risk human papillomavirus. J Med Virol. 2002;67:401–5.PubMedView ArticleGoogle Scholar
- Solomon DA, Nayar R. The Bethesda System for Reporting Cervical Cytology. 2nd ed. New York: Springer; 2004.View ArticleGoogle Scholar
- Zannoni GF, Vellone VG. Accuracy of Papanicolaou smears in cervical cancer patients treated with radiochemotherapy followed by radical surgery. Am J Clin Pathol. 2008;130:787–94.PubMedView ArticleGoogle Scholar
- Tsilalis T, Archondakis S, Meristoudis C, Margari N, Pouliakis A, Skagias L, et al. Assessment of static telecytological diagnoses’ reproducibility in cervical smears prepared by means of liquid-based cytology. Telemed J E Health. 2012;18:516–20.PubMedView ArticleGoogle Scholar
- Cibas ES. Cervical and vaginal citology. In: Cibas ES, Ducatman BS, editors. Cytology: Diagnostic Principles and Clinical Corrrelates. Edinburgh: Saunders; 2003. p. 52–4.Google Scholar
- Liu H, Liu S, Wang H, Xie X, Chen X, Zhang X, et al. Genomic amplification of the human telomerase gene (hTERC) associated with human papillomavirus is related to the progression of uterine cervical dysplasia to invasive cancer. Diagn Pathol. 2012;7:147.Google Scholar
- Chen S, Yang Z, Zhang Y, Qiao Y, Cui B, Zhang Y, et al. Genomic amplification patterns of human telomerase RNA gene and C-MYC in liquid-based cytological specimens used for the detection of high-grade cervical intraepithelial neoplasia. Diagn Pathol. 2012;7:40.Google Scholar
- Idelevich P, Elkeles A, Okon E, Kristt D, Terkieltaub D, Rivkin I, et al. Novel dual-function Cell Detect® staining technology: wedding morphology and tinctorial discrimination to detect cervical neoplasia. Diagn Pathol. 2010;5:70.Google Scholar
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.