Abstract
Objective To compare the specificity and sensitivity between self-collection and collection performed by healthcare professionals in testing High-risk oncogenic Human Papillomavirus (HrHPV) to detect high-grade uterine cervical lesions.
Methods A systematic review was conducted following PRISMA guidelines (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). Meta-analysis was conducted on STATA-14SE using random effects models for the aggregated values of sensitivity and specificity of studies that evaluated self-collection and collection by healthcare professionals. This review is registered on PROSPERO under CRD42022347731.
Results This study included 17 articles. Regarding the sensitivity of the collection method, self-collection was superior to professional collection in 2 studies, inferior in 8, equivalent in 1, and variable depending on the sample storage medium, HPV DNA analysis method, or CIN grade assessed in 3. The specificity between the methods was higher with self-collection in 5 studies, lower in 5 others, equivalent in 1, not evaluated in 1, and variable depending on the HPV DNA detection method in 2 articles. The results of the meta-analysis of studies that evaluated the sensitivity and specificity of devices used for HPV detection between self-collection and health-professionals collection showed significant differences of sensitivity favorable to the health-professionals (SMD = -0.540; 95% CI -0.595 ‒ -0.486; p < 0.001). The evaluation of the sensitivity and specificity of the type of lesion between self-collection and health professionals’ collection showed significant differences in sensitivity, favorable to the health professionals (SMD = -0.872; 95% CI -1.392 ‒ -0.351; p = 0.001).
Conclusion In conclusion, while specificity is comparable, this meta-analysis demonstrates that self-collected samples have significantly lower sensitivity for detecting HR-HPV and high-grade cervical lesions compared to clinician-collected samples. This suggests that self-sampling, in its current form, may be best utilized with complementary triage strategies or in settings where its logistical advantages outweigh the modest reduction in sensitivity for increasing screening coverage.
Keywords
Self-Collection; Human papillomavirus (HPV); Sensitivity and specificity; Diagnostic test accuracy; Meta-analysis; Cervical cancer screening; Cervical intraepithelial neoplasia
Introduction
Cervical cancer is still a significant public health issue and one of the leading causes of cancer-related mortality in adult women. According to current data, it is ranked 14th among all cancers and is the 4th most common cancer among women worldwide. Cervical cancer intervention focuses on prevention, such as HPV vaccination and early detection screening, which are both the most appropriate methods to decrease the burden of cervical cancer and mortality. However, its prevalence remains high despite the development of new screening techniques.1,2
In some developing countries, as in Brazil, where barriers to prevention and difficulties in accessing screening methods are substantial, cervical cancer is a major concern among women due to limited healthcare access and resource scarcity for diagnosis and treatment.2,3 Oncological cervical cytology using the Papanicolaou method has reduced incidence and mortality from cervical cancer, and it is directly related to the intensity of screening.3 The limited and highly variable sensitivity of cytology strongly supports the transition to the more robust and reproducible HPV-based cervical screening to ensure progress towards global cervical cancer elimination targets in Latin America.4
Molecular testing for HPV genotypes, compared to oncological cervical cytology, offers high feasibility, greater objectivity in result interpretation, high sensitivity, a high negative predictive value for virus detection, long-term risk stratification capability, less subjective results among testing centers,4,5 and attractive specificity for detecting HrHPV. Thus, molecular tests are a viable option for detecting women at high-grade lesion risk in population-based screening programs.6,7
Self-sampling improves screening uptake, particularly in low-income countries. In fact, self-sampling is more cost-effective than supplier-required visual inspection, although testing and running costs are higher for HPV self-sampling. However, comparisons between specificity and sensitivity between self-collection and healthcare professional collection principaly in detecting high-grade endocervical lesions, have not been made.5-7 The objective of this review is to compare the specificity and sensitivity between self-collection and collection performed by healthcare professionals in testing High-risk oncogenic Human Papillomavirus (HrHPV) to detect high-grade uterine cervical lesions.
Method
This is a systematic review conducted in accordance with the guidelines of PRISMA8 (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) and MOOSE (Meta-analyses Of Observational Studies in Epidemiology). The data were evaluated for comparison by the Discipline of Gynecology at the Faculty of Medicine of the University of São Paulo between 2021 and 2024. This review is registered on PROSPERO under CRD42022347731.
Databases of PubMed, Embase, and Web of Science were used to select articles. The P.I.C.O (Population, Intervention, Comparison, and Outcome) statement was designated as it follows: “In women eligible for cervical cancer screening (P), are the self-collected samples (I), compared with cervical samples taken by healthcare specialists (C), accurate in screening precancerous cervical lesions (O)?” The keywords used in the search were developed based on the P.I.C.O strategy, which included: “HPV” “self-collection”, “self-sampling”, “vagina smear”, “papanicolaou test”, “pap smear”, “pap stain”, “pap test”, “papanicolaou cytology”, “papanicolaou smear”, “papanicolaou method”, “papanicolaou stain”, “efficacy”, “sensitivity” and specificity”.
Selected articles involved sexually active women, with no age limits established (Population), who performed self-collection of vaginal samples for the detection of HrHPV (Intervention), as well as cervical samples collected by a healthcare professional (Comparison) to compare with their self-collected samples. The outcome studied was the accuracy of the diagnostic test, assessed through the analysis of specificity and sensitivity, comparing tests for HrHPV detection performed on both samples.
The selection process was conducted in three stages: title reading, abstract reading, and full study reading. To minimize potential biases and enhance the reliability of the process, another author was consulted when disagreements arose regarding the selection of articles. The flowchart illustrating the study screening process is presented in Fig. 1.
The inclusion criteria for the studies were as follows: articles in English that compared the effectiveness of genitourinary samples collected by the patient and cervical samples collected by a healthcare professional in detecting cervical intraepithelial neoplasias Grade 2 or higher, i.e., CIN2 or CIN3, using histopathological results from cervical biopsies guided by colposcopy as the gold standard.
Studies were excluded if they were in a language other than English, published as abstracts, editorials, reviews, or meta-analyses, if they lacked methodological details, failed to report sensitivity or specificity, or were not freely available in the literature. There were no limitations regarding the date of publication or the size of the sample.
The assessment of the Risk of Bias, conducted using the QUADAS-2 tool and detailed in Table 1, indicates that none of the studies were at high risk of bias. Given their nature as observational studies, they were all deemed to provide low levels of evidence. There were no identified factors that would necessitate a downgrade or upgrade in the quality of evidence. Consequently, the inclusion of women referred due to altered Pap smear results did not pose any obstacles to the overall level of evidence in the study.
Data were extracted from the studies regarding the HrHPV genetic material analysis method, the devices employed for self-collection, and the classification of cervical lesions. These data were used to compare self-collection with collection performed by healthcare professionals, utilizing these specific parameters (Table 2).
Meta-analysis was conducted using the aggregated values of sensitivity and specificity for the results of studies that evaluated self-collection and collection by healthcare professionals in outpatient settings. The aggregated results of the meta-analysis assessed the weighted mean difference between the mean values and standard deviations for each type of examination that evaluated HPV, divided by the type and severity of the assessed cervical lesion, the devices used for collection, and the methodology of each type of test. Random-effects models were used for the meta-analysis, and p-values <0.05 were considered significant, using STATA 14-SE software (Stata corp, Texas, USA) for all analyses (Fig. 2).
Meta analysis. (A) Forest-Plot of sensitivity and specificity of detection methods used for HPV detection between self-collection and healthcare professionals. (B) Forest-Plot of sensitivity and specificity of detection methods used for HPV detection by type of lesions between self-collection and health professionals. (C) Forest-Plot of sensitivity and specificity of detection methods used for HPV detection by type of device between self-collection and healthcare professionals.
Results
A total of 474 articles were selected from database searches; 335 remained after removing duplicates. Following a review of titles and abstracts, 225 studies were excluded based on inclusion and exclusion criteria. After full-text reading of 110 articles, 17 were chosen for the systematic review. The technical details of these studies are shown in Table 3.
The studies were published between 2000 and 2023 and were conducted in the following countries: Brazil, Canada, China, Denmark, Germany, Haiti, India, Italy, South Korea, Spain, Sweden, Switzerland, Tanzania, and the Netherlands. The number of participants ranged from 91 to 4658, totaling 11.014 women, aged between 16- and 76-years. The devices used for self-collection included swabs in 4 studies; brushes in 10 studies; vaginal lavage devices in 2 studies; and urine in 3 studies. Regarding the storage medium for self-collected samples, most studies used a liquid cell preservation method, except for the studies by Catarino et al. Geraets et al. and Shao-Ming Wang et al. with the latter conducting a comparison between liquid and dry mediums.
The most commonly used test for HPV DNA detection was the Hybrid Capture II (HC2) HPV assay (Qiagen Gaithersburg, Inc., USA), followed, in decreasing order of usage, by the following tests: careHPV test (Qiagen Inc., Gaithersburg, MD, USA), GP5+/6+-EIA kit (Diassay BV, Rijswijk, The Netherlands), SPF10-DEIA-LiPA25 version 1 (Diassay BV, Rijswijk, The Netherlands), COBAS 4800 (Roche Inc, Basel, Switzerland), Anyplex™ II HPV Kit (Seegene Inc, South Korea), RealTime High Risk (HR) HPV assay (Abbott Inc. Illinois, USA), HPVDNAchip (Biomedlab Co., South Korea), Xpert HPV assay (Sunnyvale, CA, USA),9 Polymerase Chain Reaction (PCR) reverse line blot assay, and the Aptima HPV mRNA test (Hologic Inc, MA, USA).
The information extracted regarding the effectiveness of the methods in detecting high-grade lesions, i.e., sensitivity and specificity of each method of HrHPV detection, is presented in Table 4.
Analyses of mean, Standard Deviation (SD), Confidence Intervals (95 % CI), and p (Mann-Whitney test for non-parametric samples) are conducted for the 17 analyzed studies, comparing the Collection Devices (A), hrHPV Detection Method (B) and Lesion Types (C) regarding Sensitivity (SE) and Specificity (SP).
Four studies showed lower effectiveness of self-collection compared to healthcare professional collection, both in terms of sensitivity and specificity of the analysis method or sampling device.10,22,24,25 The study by Labani et al.17 also showed decreased effectiveness in terms of sensitivity, although both collection methods were highly specific. Leeman et al.16 showed the same sensitivity in both collection methods, with only self-collection having higher specificity.
In the study of Sang-Soo Seo et al., sensitivity was higher in self-collection than in healthcare professional collection, but with lower specificity. In contrast, 3 studies showed higher specificity of self-collection with lower sensitivity.11,16,24
Bhatla et al.10 separated their data according to the HPV DNA detection method used; with the use of the HC2 HPV assay, both sensitivity and specificity of self-collection were lower. However, when using the PCR reverse line blot assay method, self-collection showed superior specificity.
The study by Shao-Ming Wang et al.12 separated sensitivity and specificity values based on the storage methods used; with the use of a liquid medium, both sensitivity and specificity of self-collection were higher than those of healthcare professional collection. However, with the use of a dry medium, specificity was higher with self-collection, but sensitivity was reduced.
Asciutto et al.18 evaluated the performance of the Aptima mRNA test, being the only study in this review to use mRNA for HPV testing. Their findings revealed overall lower sensitivity and specificity for self-collection.
Hyun-Woong Cho et al. (2020)24 evaluated the performance of urine and vaginal samples in two different HPV detection devices. They found that self-collected samples generally had lower sensitivity and specificity compared to clinician-collected samples. However, the urine sample analyzed with the AnyPlex II PCR Kit showed higher specificity.
Finally, 4 studies separated the efficacy data based on the severity of the lesion found in the biopsy.11,17,20,23 Boggan et al.20 conducted their analysis considering only sensitivity, which was lower for self-collection for CIN2+ lesions and higher for this method when evaluating CIN3+ lesions.
Results of meta-analysis
Sensitivity and specificity by detection method
The results of the meta-analysis of studies that evaluated the sensitivity and specificity of detection methods of HrHPV between self-collection and health-professionals collection showed significant differences of sensitivity favorable to the health-professionals (SMD = −0.711; 95 % CI −0.889 ‒ −0.533; p < 0.001), and no difference in the specificity. (Table 5A and Fig. 2A).
Meta-analysis of sensitivity and specificity of detection methods used for HPV detection between self-collection and healthcare professionals.
Sensitivity and specificity by type of lesion
The results of the meta-analysis of studies that evaluated the sensitivity and specificity of the type of lesion between self-collection and health professionals’ collection showed significant differences in sensitivity, favorable to the health professionals (SMD = −0.872; 95 % CI −1.392 ‒ −0.351; p = 0.001), and no difference in specificity (Table 5B and Fig. 2B).
Meta-analysis of sensitivity and specificity of detection methods used for HPV detection by type of lesions between self-collection and healthcare professionals.
Sensitivity and specificity by type of device
The results of the meta-analysis of studies that evaluated the sensitivity and specificity of devices used for HPV detection between self-collection and health-professionals collection showed significant differences of sensitivity favorable to the health-professionals (SMD = −0.540; 95 % CI −0.595 ‒ −0.486; p < 0.001), and no difference in the specificity (Table 5C and Fig. 2C).
Meta-analysis of sensitivity and specificity of detection methods used for HPV detection by type of device between self-collection and healthcare professionals.
Discussion
Cervical cancer remains a significant public health concern, especially in developing countries with limited access to screening. This review aimed to compare the accuracy of self-collected samples versus healthcare professional-collected samples in detecting High-risk HPV (HrHPV) for cervical precancerous lesions, offering a perspective that contributes to the decision to include self-collection in screening programs.
This review has limitations due to the inclusion of only freely available literature. Although this criterion excluded numerous studies, the meta-analysis benefits from a large sample size (n = 11,014), strengthening the evaluation of self-collection performance.
The seventeen eligible studies displayed a wide array of self-collection devices and high-risk HPV detection methods. Nonetheless, significant differences in the sensitivity of the analyzed parameters were discernible.
Brush and swab methods demonstrated minimal differences in sensitivity and specificity, with swabs exhibiting higher mean sensitivity in self-collected samples versus those collected by healthcare professionals. Studies conducted by Catarino et al.,9 Sang-Soo Seo et al.,14 and Bogan et al.19 indicated greater sensitivity in self-collected samples compared to those collected clinically, whereas Leeman et al.16 found equivalent sensitivity in both methods of collection. This could be attributed to the selection of symptomatic patients or those previously diagnosed with HPV-related precursor lesions, which may affect the concordance of the laboratory method employed.
The p-values for Heterogeneity obtained from the Meta-Analysis indicate a significant difference in sensitivity concerning the HrHPV detection method, lesion type, and device used for self-collection, favoring the cervical collection by health-care professionals, suggesting that the Papanicolaou smear is more sensitive in detecting precancerous lesions. However, there is no significant difference in specificity between the two sampling methods.
Recent studies, such as the Dutch study by Polman et al. in 2019,26 with a large number of female participants, reported recognized and substantial variation in clinical accuracy when using different brushes or devices for self-collection, as well as highlighting the bias in the accuracy of different HPV DNA detection tests. In a recent study, Lorenzi et al.21 used a clinically validated and FDA-approved HrHPV detection test and a widely used self-collection device in numerous studies, internationally validated, associated with double staining for p16/Ki-67, cytological, in self-collected samples. In both aforementioned studies, HrHPV detection in samples from both groups, self-collection and healthcare professional collection, was similar in terms of sensitivity and specificity for detecting CIN2+ lesions, with no inferior performance of the self-collection group compared to the healthcare professional group.
The performance of cytology to detect cervical precancer and cancer has been studied largely among women from Europe and North America. There is ample evidence and agreement that HPV testing is a more sensitive and reproducible test for primary screening than cytology, which allows extension of screening intervals and can be self-collected. WHO guidelines recommend HPV testing with or without triage as the preferred alternative for cervical cancer screening. The limited accuracy of cytology, which remains the main screening method in Latin American countries, together with limited coverage and inadequate follow-up of abnormalities, likely explains the persistently high burden of disease in the region.
These findings provide regional evidence that can guide evidence-based decisions by policy makers to accelerate the transition from cytology to HPV testing for primary cervical cancer screening instead of improving current cytology capacity.
The limited and highly variable sensitivity of cytology strongly supports the transition to the more robust and reproducible HPV-based cervical screening to ensure progress towards global cervical cancer elimination targets in Latin America. Therefore, although self-collection alone appears to be as sensitive as the Papanicolaou smear in several studies, its overall lower sensitivity suggests that it cannot be solely relied upon in screening programs.
The specificity, although comparable between both types of specimen collection, remains low. This highlights the importance of incorporating additional detection methods, such as immunohistochemical markers, to enhance the overall specificity in both self-collected and healthcare professional-collected samples.
Conclusions
In conclusion, these findings challenge the suitability of a self-collection-based approach for cervical cancer screening, emphasizing the potential limitations in identifying women at risk for cervical cancer. The results underscore the necessity to employ alternative methods complementary to traditional screening processes in populations where traditional cervical cancer screening may face challenges.
Ethical aspects
This study was not funded, nor is there any conflict of interest on the part of any of the authors.
Data availability
Indication that the data must be requested from the corresponding author. - All data must be requested from the corresponding author.
References
- 1 Fowler J.R., Maani E.V., Dunton C.J., Gasalberti D.P., Jack B.W. Cervical cancer. In: StatPearls. Treasure Island (FL): StatPearls Publishing; November 12, 2023.
- 2 de Melo A.C., da Silva J.L., Dos Santos A.L.S., Thuler L.C.S. Population-based trends in cervical cancer incidence and mortality in Brazil: focusing on black and indigenous Population disparities. J Racial Ethn Health Dispar. 2024;11(1):255-263.
- 3 Ramírez A.T., Valls J., Baena A., Rojas F.D., Ramírez K., Álvarez R., et al.; ESTAMPA Study Group. Performance of cervical cytology and HPV testing for primary cervical cancer screening in Latin America: an analysis within the ESTAMPA study. Lancet Reg Health Am. 2023;26:100593.
- 4 Levi J.E., Martins T.R., Longatto-Filho A., Cohen D.D., Cury L., Fuza L.M., et al. High-risk HPV testing in primary screening for cervical cancer in the public health system, São Paulo, Brazil. Cancer Prev Res. 2019;12(8):539-46.
- 5 Mekuria S.F., Timmermans S., Borgfeldt C., Jerkeman M., Johansson P., Linde D.S. HPV self-sampling versus healthcare provider collection on the effect of cervical cancer screening uptake and costs in LMIC: a systematic review and meta-analysis. Syst Rev. 2023;12(1):103.
- 6 Bruni L., Serrano B., Roura E., Alemany L., Cowan M., Herrero R., et al. Cervical cancer screening programmes and age-specific coverage estimates for 202 countries and territories worldwide: a review and synthetic analysis. Lancet Glob Health. 2022;10(8):e1115-e1127. Erratum: Lancet Glob Health. 2023;11(7):e1011.
- 7 Teixeira J.C., Vale D.B., Campos C.S., Bragança J.F., Discacciati M.G., Zeferino L.C. Organization of cervical cancer screening with DNA-HPV testing impact on early-stage cancer detection: a population-based demonstration study in a Brazilian city. Lancet Reg Health Am. 2022;5:100084.
- 8 Galvao T., Andrade Pansani T., Harrad D. Principais itens para relatar revisões sistemáticas e Meta-análises: a recomendação PRISMA. Epidemiol Serv Saude. 2015;24(2):335-42.
- 9 Catarino R., Vassilakos P., Bilancioni A., Bougel S., Boukrid M., Meyer-Hamme U., et al. Accuracy of self-collected vaginal dry swabs using the Xpert human papillomavirus assay. PLoS One. 2017;12(7):e0181905.
- 10 Bhatla N., Dar L., Patro A.R., Kumar P., Kriplani A., Gulati A., et al. Can human papillomavirus DNA testing of self-collected vaginal samples compare with physician-collected cervical samples and cytology for cervical cancer screening in developing countries? Cancer Epidemiol. 2009;33(6):446-50.
- 11 Geraets D.T., van Baars R., Alonso I., Ordi J., Torné A., Melchers W.J., et al. Clinical evaluation of high-risk HPV detection on self-samples using the indicating FTA-elute solid-carrier cartridge. J Clin Virol. 2013;57(2):125-9.
- 12 Wang S.M., Hu S.Y., Chen F., Chen W., Zhao F.H., Zhang Y.Q., et al. Clinical evaluation of human papillomavirus detection by careHPV™ test on physician-samples and self-samples using the indicating FTA Elute® card. Asian Pac J Cancer Prev. 2014;15(17):7085-9.
- 13 Sellors J.W., Lorincz A.T., Mahony J.B., Mielzynska I., Lytwyn A., Roth P., et al. Comparison of self-collected vaginal, vulvar and urine samples with physician-collected cervical samples for human papillomavirus testing to detect high-grade squamous intraepithelial lesions. CMAJ. 2000;163(5):513-8.
- 14 Seo S.S., Song Y.S., Kim J.W., Park N.H., Kang S.B., Lee H.P. Good correlation of HPV DNA test between self-collected vaginal and clinician-collected cervical samples by the oligonucleotide microarray. Gynecol Oncol. 2006;102(1):67-73.
- 15 Brink A.A., Meijer C.J., Wiegerinck M.A., Nieboer T.E., Kruitwagen R.F., van Kemenade F., et al. High concordance of results of testing for human papillomavirus in cervicovaginal samples collected by two methods, with comparison of a novel self-sampling device to a conventional endocervical brush. J Clin Microbiol. 2006;44(7):2518-23.
- 16 Leeman A., Del Pino M., Molijn A., Rodriguez A., Torné A., de Koning M., et al. HPV testing in first-void urine provides sensitivity for CIN2+ detection comparable with a smear taken by a clinician or a brush-based self-sample: cross-sectional data from a triage population. BJOG. 2017;124(9):1356-63.
- 17 Labani S., Asthana S. Human papillomavirus viral load on careHPV testing of self-collected vaginal samples vs. clinician-collected cervical samples. Eur J Obstet Gynecol Reprod Biol. 2014;181:233-9.
- 18 Asciutto K.C., Ernstson A., Forslund O., Borgfeldt C. Self-sampling with HPV mRNA analyses from vagina and urine compared with cervical samples. J Clin Virol. 2018;101:69-73.
- 19 de Melo Kuil L., Lorenzi A.T., Stein M.D., Resende J.C.P., Antoniazzi M., Longatto-Filho A., et al. The role of self-collection by vaginal lavage for the detection of HPV and high-grade intraepithelial neoplasia. Acta Cytol. 2017;61(6):425-33.
- 20 Boggan J.C., Walmer D.K., Henderson G., Chakhtoura N., McCarthy S.H., Beauvais H.J., et al. Vaginal self-sampling for Human papillomavirus infection as a primary cervical cancer screening tool in a Haitian population. Sex Transm Dis. 2015;42(11):655-9.
- 21 Lorenzi N.P.C., Termini L., Ferreira-Filho E.S., Nunes R.A.L., Silva G.A.F., Lepique A.P., et al. A positive HPV test with positive p16/ki-67 double staining in self-sampled vaginal material is an accurate tool to detect women at risk for cervical cancer. Cancer Cytopathol. 2022;130(1):41-54.
- 22 Martinelli M., Giubbi C., Di Meo M.L., Perdoni F., Musumeci R., Leone B.E., et al. Accuracy of Human papillomavirus (HPV) testing on urine and vaginal self-samples compared to clinician-collected cervical sample in women referred to colposcopy. Viruses. 2023;15(9):1889.
- 23 Ørnskov D., Jochumsen K., Steiner P.H., et al. Clinical performance and acceptability of self-collected vaginal and urine samples compared with clinician-taken cervical samples for HPV testing among women referred for colposcopy. A crosssectional study. BMJ Open. 2021;11:e041512.
- 24 Cho H.W., Hong J.H., Min K.J., et al. Performance and diagnostic accuracy of Human papillomavirus testing on self-collected urine and vaginal samples in a referral population. Cancer Res Treat. 2021;53(3):829-36.
- 25 Mremi A., Mchome B., Mlay J., et al. Performance of HPV testing, pap smear and VIA in women attending cervical cancer screening in Kilimanjaro region, Northern Tanzania: a cross-sectional study nested in a cohort. BMJ Open. 2022;12:e064321.
- 26 Polman N.J., de Haan Y., Veldhuijzen N.J., Heideman D.A.M., de Vet H.C.W., Meijer C.J.L.M., et al. Experience with HPV self-sampling and clinician-based sampling in women attending routine cervical screening in the Netherlands. Prev Med. 2019;125:5-11.
Edited by
-
Edited by Editor:
José Maria Soares Junior




