Abstract
The clinical utility of antigen test using anterior nasal samples has not been well evaluated. We conducted a prospective study in a drive-through testing site located at a PCR center to evaluate the diagnostic performance of the antigen test QuickNavi-COVID19 Ag using anterior nasal samples and to compare the degrees of coughs or sneezes induction and the severity of pain between anterior nasal collection and nasopharyngeal collection. The study included a total of 862 participants, of which 91.6% were symptomatic. The median duration from symptom onset to sample collection was 2.0 days. Fifty-one participants tested positive for severe acute respiratory syndrome coronavirus 2 on reverse transcription PCR (RT-PCR) with nasopharyngeal samples, and all of them were symptomatic. In comparison to the findings of RT-PCR, the antigen test using anterior nasal samples showed 72.5% sensitivity (95% confidence interval [CI] 58.3–84.1%) and 100% specificity (95% CI 99.3–100%). Anterior nasal collection was associated with a significantly lower degree of coughs or sneezes induction and the severity of pain in comparison to nasopharyngeal collection (p < 0.001). The antigen test using anterior nasal samples showed moderate sensitivity in symptomatic patients who were at the early stages of the disease course but was less painful and induced fewer coughs or sneezes.
Introduction
The laboratory diagnosis of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) includes nucleic acid amplification tests (NAATs), antigen tests, and antibody tests1. Antigen tests are generally less sensitive than NAATs for detecting SARS-CoV-2 but are relatively inexpensive, and most can be performed at the point of care2.
The diagnostic performance of antigen test of nasopharyngeal samples has been evaluated, and the reported specificity is consistently high > 97%, while sensitivity ranges from 0 to 94%2. We previously evaluated the performance of an antigen test, QuickNavi-COVID19 Ag (Denka Co., Ltd., Tokyo, Japan), using nasopharyngeal samples from 1186 participants3. The overall sensitivity and specificity were 86.7% (95% confident interval [CI] 78.6–92.5%) and 100% (95% CI 99.7–100%), respectively, and the sensitivity for symptomatic participants was 91.7% (95% CI 82.7–96.9%)3.
In recent studies, the sensitivity of anterior nasal samples was reported to be comparable to that of nasopharyngeal samples for NAATs4,5. Anterior nasal collection was reported to be less painful than nasopharyngeal collection6and may cause less droplet dispersal. These benefits are also expected in antigen tests but have yet to be fully evaluated.
We prospectively evaluated the diagnostic performance of the QuickNavi-COVID19 Ag test using anterior nasal samples and compared the degrees of coughs or sneezes induction and the severity of pain between anterior nasal collection and nasopharyngeal collection.
Methods
We conducted the present prospective study between October 7, 2020 and January 9, 2021, at a drive-through PCR center where participants were referred from a local public health center and 97 primary care facilities in Tsukuba, Japan. After receiving the participants’ informed consent, additional anterior nasal samples for the antigen test were collected and their clinical information was obtained. Cases with no clinical data were excluded from this study. In cases where participants enrolled in the current study more than once, only the first evaluation was included in this study.
QuickNavi-COVID19 Ag is a lateral-flow antigen test which employs a sandwich immunochromatography method with mouse monoclonal antibodies against SARS-CoV-2. This method has been employed by various other antigen detection tests2. After a sample is mixed with specimen buffer and specimen droplets are added to the test cassette well, the monoclonal antibodies on a conjugate pad reacts with SARS-CoV-2 nucleoprotein. The antibody-antigen complexes are then captured by other monoclonal antibodies fixed on the test line, visualizing a red colored test line and that indicates a positive test result.
Sample collection and the antigen test procedure
We simultaneously obtained an anterior nasal sample for the antigen test and a nasopharyngeal sample for the PCR examination. All samples were obtained with FLOQSwabs (Copan Italia S.p.A., Brescia, Italy).
The anterior nasal sample was initially collected according to the manufacturer’s instructions. Namely, a nasopharyngeal-type flocked (NP-type) swab was inserted to 2 cm depth in one nasal cavity, rotated five times, and held in place for 5 s. The antigen test using the QuickNavi-COVID19 Ag kit was performed immediately after anterior nasal collection and the result was obtained by the visual interpretation of each examiner.
A nasopharyngeal sample was subsequently collected with an NP-type swab according to a previously described procedure7and was diluted in 3 mL of Universal Transport Medium (UTM) (Copan Italia S.p.A., Brescia, Italy). The UTM was transferred to an in-house microbiology laboratory located next to the drive-through sample-collecting site of the PCR center within an hour of sample collection.
SARS-CoV-2 detection using reverse transcription PCR
After the arrival of the UTM samples, purification and RNA extraction were performed with magLEAD 6gC (Precision System Science Co., Ltd., Chiba, Japan) from 200 µL aliquots of UTM for in-house reverse transcription (RT)-PCR on the same day as sample collection. RNA was eluted in 100 µL and stored at − 80 °C after the in-house RT-PCR test. The eluted samples were transferred to Denka Co., Ltd., every week for a reference real-time RT-PCR test on Applied Biosystems QuantStudio 3 (Thermo Fisher Scientific Inc., Waltham, MA, USA) using a QuantiTect Probe RT-PCR Kit (QIAGEN Inc., Germantown, MD, USA) and primer/probe N and N2 set8.
The presence or absence of SARS-CoV-2 was defined by the results of the reference real-time RT-PCR test. However, if discordance existed between the reference real-time RT-PCR test and the in-house RT-PCR test, a re-evaluation was performed with an Xpert Xpress SARS-CoV-2 and GeneXpert System (Cepheid, Sunnyvale, CA, USA), the results of which provided the final judgment.
The degrees of coughs or sneezes and the severity of pain induced by the sample collection procedure
The degrees of coughs or sneezes and the severity of pain caused by the insertion of the swab into the anterior nasal cavity and nasopharynx in the same participant were assessed. Examiners rated the degrees of coughs or sneezes induction from the following four categories: “None”, “Small, 1–2 times”, “Loud, 1–2 times” and “Loud, multiple times”. The severity of pain was evaluated with a five-point scale (Pain score), with 1 being "no pain" and 5 being “worst imaginable pain,” and the participants were asked to report a number from the scale.
The comparison of SARS-CoV-2 viral loads between different sample collection sites and swab types
We conducted an additional experiment to evaluate whether the viral loads differed between sample collection sites and swab types between January 8 and 19, 2021. After receiving the participants’ informed consent, two anterior nasal samples were obtained from the participants for whom a nasopharyngeal sample had already tested positive for SARS-CoV-2. Two anterior nasal swab samples were collected from each nostril using one with a NP-type swab and the other with an oropharyngeal-type flocked (OP-type) swab. These sample collections were performed on the same day.
The samples were diluted in 3 mL of UTM, and stored at − 80 °C. After several days of storage, the samples were thawed, and purification and RNA extraction were performed according to the above-described method. The viral concentrations in samples were quantified with the following procedure. The calibration curves were generated with 5, 50, and 500 copies/reaction of positive control (EDX SARS-CoV-2 Standard; Bio-Rad Laboratories, Inc., Hercules, CA, USA). Quantitative RT-PCR was performed on a LightCycler 96 System (Roche, Basel, Switzerland) using a THUNDERBIRD Probe One-step qRT-PCR Kit (TOYOBO Co. Ltd., Osaka, Japan) with a primer/probe N2 set.
Statistical analyses
The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of QuickNavi-COVID19 Ag and their 95% confidence intervals (CIs) were calculated with the Clopper and Pearson method. Categorical variables were assessed by Fisher’s exact test. The viral loads according to collection sites and swab types were compared by the Wilcoxon signed-rank test with Holm correction. The degrees of coughs or sneezes induction and the pain score were also compared between the two different collection procedures using the McNemar–Bowker test and the Wilcoxon signed-rank test, respectively.pvalues of < 0.05 were considered to indicate statistical significance. All statistical analyses were conducted using the R 3.5.2 software program (The R Foundation, Vienna, Austria).
Ethics statement
The present study was approved by the ethics committee of Tsukuba Medical Center Hospital (approval number: 2020-033). Informed consent was obtained from all participants. We conducted this study in accordance with the Declaration of Helsinki and followed ethical guidelines endorsed by the Ministry of Health, Labour and Welfare, Japan.
Results
病毒载量在不同样本集合地点nd swab types
In 32 identical SARS-CoV-2 positive cases, we evaluated the SARS-CoV-2 viral loads of nasopharyngeal samples (NPS), anterior nasal samples with NP-type swabs (AWN), and anterior nasal samples with OP-type swabs (AWO) (Fig.1).The median viral loads for NPS, AWN, and AWO were 53,560 (interquartile range [IQR] 605–608,050), 1792 (IQR 7–81,513), and 6369 (IQR 7–97,535), respectively. With the NPS as a reference, the PCR-positive rate for AWN was 84.4% (27/32; 95% CI 67.2–94.7%), while that for AWO was 81.3% (26/32; 95% CI 63.6–92.8%). In comparison to NPS, the viral load was significantly lower with AWN (p< 0.001) and AWO (p< 0.001), but there was no significant difference between AWN and AWO (p= 0.61). The viral loads and Ct values for all samples are described in TableS1aand TableS1b.
Demographic data of study population
A total of 876 participants were screened for the evaluation. Most samples were obtained at the drive-through PCR center, and only 17 were obtained after hospitalization. We excluded the participants who underwent duplicate tests (n = 7) or for whose clinical information were lacking (n = 7). Finally, 862 participants were included in the analysis.
Among the 862 participants, 790 (91.6%) were symptomatic and SARS-CoV-2 was detected in 50 (5.8%) on nasopharyngeal samples by the reference real-time RT-PCR test. The median duration from the onset of symptoms to sample collection was 2.0 days (IQR 1.0–3.0). There was one discordant sample that was positive on the in-house RT-PCR test and negative on the reference real-time RT-PCR test. The Xpert Xpress SARS-CoV-2 test provided a negative result for E target and a positive result of N2 target (cycle threshold [Ct] value of 39.8); thus, 51 (5.9%) participants were finally considered positive for SARS-CoV-2. The discordant sample was obtained from a participant who had been diagnosed with COVID-19 1 month before the current evaluation and who was referred to the PCR center due to refractory respiratory symptoms.
All 51 participants who were positive for SARS-CoV-2 were symptomatic (Table1); their characteristics are described in Table2. The most common symptom was fever (80.4%), followed by cough or sputum production (60.8%), sore throat (37.3%), runny nose or nasal congestion (35.3%), and loss of taste or smell (27.5%).
QuickNavi-COVID19 Ag usi的诊断性能ng anterior nasal samples
Of the 51 participants who were found to be SARS-CoV-2-positive by the RT-PCR test, 37 participants were found to be positive with the antigen test with anterior nasal samples (Table3).Among the 811 SARS-CoV-2-negative participants, all participants were found to be negative with the antigen test (Table3).抗原之间的和合率测试nd RT-PCR was thus 98.4% (95% CI 97.3–99.1%). The sensitivity, specificity, PPV, and NPV were 72.5% (95% CI 58.3–84.1%), 100% (95% CI 99.3–100%), 100% (95% CI 86.2–100%), and 98.3% (95% CI 97.2–99.1%), respectively (Table3).Among the 51 SARS-CoV-2 positive participants, the sensitivities of the antigen test in those with and without runny nose or nasal congestion were 88.9% (16/18, 95% CI 65.3–98.6%) and 63.6% (21/33, 95% CI 45.1–79.6%), respectively. This difference in sensitivity between the two groups did not reach statistical significance (p = 0.097).
Comparison of degrees of coughs or sneezes induction and the severity of pain between anterior nasal and nasopharyngeal sample collection
The degrees of coughs or sneezes induced by sample collection was measured in 784 participants (Fig.2).Coughing or sneezing was observed in 149 (19.0%) of anterior nasal collections and in 316 (40.3%) of nasopharyngeal collection. When coughs or sneezes occurred in anterior nasal collection, their degrees were significantly lower than in nasopharyngeal collection (p < 0.001).
The pain score was obtained from 90 participants (Fig.3).Fifty-seven participants (63.3%) reported no pain in anterior nasal collection. The median pain score of anterior nasal collection and nasopharyngeal collection was 1 (IQR 1–2) and 3 (IQR 2–4), respectively. In comparison to nasopharyngeal collection, anterior nasal collection was significantly less painful (p< 0.001).
Discussion
The QuickNavi-COVID19 Ag test using anterior nasal samples showed 72.5% sensitivity and 100% specificity. In comparison to nasopharyngeal collection, anterior nasal collection was less painful and was associated with fewer coughs or sneezes. In addition, the study demonstrated that the viral load of anterior nasal samples was significantly lower than that of nasopharyngeal samples. Meanwhile, the swab types did not influence the viral load of anterior nasal samples.
尽管不同的拭子之间成对比较samples lacked in this study, our study demonstrated that anterior nasal samples provided a lower antigen test sensitivity than our previous study evaluating nasopharyngeal samples3. Nevertheless, this lower sensitivity of 72.5% may be acceptable since according to the reported systematic review, sensitivity of nasal swab was 86% in comparison to nasopharyngeal swab by RT-PCR9. The sensitivity of antigen tests is largely influenced by the viral load in collected samples10,11,12,13. The QuickNavi-COVID19 Ag test could detect SARS-CoV-2 in almost all samples with Ct values < 30, and in 18.8% of samples with Ct values > 303. The viral load may vary between collection sites14, and this study recognized the viral load of samples was significantly lower when they were collected from the anterior nasal cavity (Fig.1).
On the other hand, the QuickNavi-COVID19 Ag test provided 100% specificity in both the present study and our previous study3. Although it is necessary to verify whether similar results can be obtained in other settings, false positives should be avoided to prevent unnecessary additional testing and inappropriate isolation measures15.
We observed that anterior nasal collection caused fewer coughs or sneezes in comparison to nasopharyngeal sample collection (Fig.2).Notably, anterior nasal collection induced coughs or sneezes in only 19% of participants. Coughs or sneezes generate droplets and prolong their dispersal by forming multiphase turbulent gas clouds16, which leads to greater droplet exposure. SARS-CoV-2 is mainly transmitted through droplets17; thus, anterior nasal collection, which was associated with fewer coughs or sneezes induction, may reduce the transmission risk among healthcare providers.
Anterior nasal collection was less painful (Fig.3), with more than half of the participants reporting no pain from the procedure. Nasopharyngeal collection is an uncomfortable and painful experience6and may discourage patients from receiving tests. Besides, nasopharyngeal collection may not be applicable if patients have a history of recent nasal trauma or surgery, remarkable nasal septum deviation, or marked coagulopathy7. Despite the decreased sensitivity, when NAATs are not readily available, an antigen test with anterior nasal samples may be an option in these clinical contexts.
The selection of swab type influences the uptake, extraction and recovery efficiency of the collected sample18,19. In this study, we compared two flocked swabs with different tip sizes (NP-type and OP-type swab). There was no significant difference in the viral load of the samples collected with the two types of swabs; however, the OP-type swab has a larger tip and seemed to handle a larger amount of samples collected. A previous study suggested that the efficiency of sample release was not associated with the absorbed volume20, which could explain the result in this study.
本研究与一些限额是否相关ions. First, the samples used for the reference real-time RT-PCR test were frozen and transported. Although the samples were frozen at − 80 °C, the viral loads may have been decreased during the storage and transport process. Nevertheless, in the case of discrepancy with in-house PCR, re-evaluation was performed and did not affect the calculation of the sensitivity of the antigen test. Second, asymptomatic SARS-CoV-2 positive patients were unintentionally not included in this study. Further study is required to evaluate the clinical performance of the antigen test in those patients. Third, we did not analyze gene mutations of detected SARS-CoV-2. However, according to the manufacturer’s information for use (version 4.0), QuickNavi-COVID19 Ag can similarly react with both variant 20I/501Y.V1, so called a UK variant (VOC 202012/01) and with variant 20J501Y.V3, so called a Brazilian variant P.1 (VOC 202101/02). Finally, this study was conducted at a single center and evaluated a single commercial rapid antigen product. Further research should be conducted to assess the generalizability of the findings.
In conclusion, the QuickNavi-COVID19 Ag test with an anterior nasal sample showed 100% specificity and moderate sensitivity in symptomatic individuals who were in the early course of the disease. Overall sensitivity was lower than the ones observed in our previous study that used nasopharyngeal samples. Anterior nasal collection was less invasive and induced fewer coughs or sneezes, which may be more comfortable for the patient and may reduce the risk of droplet exposure to healthcare workers.
Data availability
The data includes sensitive data about the health of human research subjects and thus cannot be directly deposited openly. However, anonymized, individual-level data that enable full replication of the study results are available from the corresponding author.
References
World Health Organization.Diagnostic Testing for SARS-CoV-2: Interim Guidance, 11 September 2020.https://apps.who.int/iris/handle/10665/334254(2020).
World Health Organization.Antigen-Detection in the Diagnosis of SARS-CoV-2 Infection Using Rapid Immunoassays: Interim Guidance, 11 September 2020.https://apps.who.int/iris/handle/10665/334253(2020).
Takeuchi, Y.et al.The evaluation of a newly developed antigen test (QuickNaviTM-COVID19 Ag) for SARS-CoV-2: a prospective observational study in Japan.J. Infect. Chemother.27, 890–894 (2021).
Péré, H.et al.Nasal swab sampling for SARS-CoV-2: a convenient alternative in times of nasopharyngeal swab shortage.J. Clin. Microbiol.58, e00721-e820 (2020).
Tu, Y.-P.et al.Swabs collected by patients or health care workers for SARS-CoV-2 testing.N. Engl. J. Med.383, 494–496 (2020).
Frazee, B. W.et al.Accuracy and discomfort of different types of intranasal specimen collection methods for molecular influenza testing in emergency department patients.Ann. Emerg. Med.71, 509-517.e1 (2018).
Marty, F. M., Chen, K. & Verrill, K. A. How to obtain a nasopharyngeal swab specimen.N. Engl. J. Med.382, e76 (2020).
Shirato, K.et al.为潜艇雷达发展的基因诊断方法ction for novel coronavirus 2019(nCoV-2019) in Japan.Jpn. J. Infect. Dis.73, 304–307 (2020).
Tsang, N. N. Y.et al.Diagnostic performance of different sampling approaches for SARS-CoV-2 RT-PCR testing: a systematic review and meta-analysis.Lancet Infect. Dis.https://doi.org/10.1016/S1473-3099(21)00146-8(2021).
Hirotsu, Y.et al.Prospective study of 1308 nasopharyngeal swabs from 1033 patients using the LUMIPULSE SARS-CoV-2 antigen test: comparison with RT-qPCR.Int. J. Infect. Dis.105, 7–14 (2021).
Aoki, K.et al.Clinical validation of quantitative SARS-CoV-2 antigen assays to estimate SARS-CoV-2 viral loads in nasopharyngeal swabs.J. Infect. Chemother.27, 613–616 (2021).
Salvagno, G. L., Gianfilippi, G., Bragantini, D., Henry, B. M. & Lippi, G. Clinical assessment of the Roche SARS-CoV-2 rapid antigen test.Diagnosishttps://doi.org/10.1515/dx-2020-0154(2021).
Merino, P.et al.Multicenter evaluation of the PanbioTMCOVID-19 rapid antigen-detection test for the diagnosis of SARS-CoV-2 infection.Clin. Microbiol. Infect.https://doi.org/10.1016/j.cmi.2021.02.001(2021).
Lee, R. A., Herigon, J. C., Benedetti, A., Pollock, N. R. & Denkinger, C. M. Performance of saliva, oropharyngeal swabs, and nasal swabs for SARS-CoV-2 molecular detection: a systematic review and meta-analysis.J. Clin. Microbiol.59, e02881-e2882 (2021).
Ogawa, T.et al.Another false-positive problem for a SARS-CoV-2 antigen test in Japan.J. Clin. Virol.131, 104612 (2020).
Bourouiba, L. Turbulent gas clouds and respiratory pathogen emissions.JAMA323, 1837–1838 (2020).
World Health Organization.Transmission of SARS-CoV-2: Implications for Infection Prevention Precautions.https://www.who.int/publications/i/item/modes-of-transmission-of-virus-causing-covid-19-implications-for-ipc-precaution-recommendations(2020).
Kahamba, T. R., Noble, L., Stevens, W. & Scott, L. Comparison of three nasopharyngeal swab types and the impact of physiochemical properties for optimal SARS-CoV-2 detection.J. Vaccin. Vaccin.S6, 005 (2020).
Bruijns, B. B., Tiggelaar, R. M. & Gardeniers, H. The extraction and recovery efficiency of pure DNA for different types of swabs.J. Forensic Sci.63, 1492–1499 (2018).
Zasada, A. A.et al.The influence of a swab type on the results of point-of-care tests.AMB Express10, 46 (2020).
Acknowledgements
We thank Mrs. Yoko Ueda, Mrs. Mio Matsumoto, Dr. Yumi Hirose and the staff in the Department of Clinical Laboratory of Tsukuba Medical Center Hospital for their intensive support of this study. We thank all of the medical institutions for providing their patients’ clinical information. Mrs. Yoko Ueda and Mrs. Mio Matsumoto significantly contributed to creating the database of this study.
Author information
Authors and Affiliations
Contributions
Y.T. drafted the manuscript and performed the statistical analyses. Y.A. was the chief investigator and responsible for the data analysis. A.U., S.N. and K.N. performed experiments. D.K., M.K. and S.M. interpreted results. H.I. supervised the project. H.S. designed the study. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing interests
Denka Co., Ltd., provided fees for research expenses and the QuickNavi-COVID19 Ag kits without charge. H.S. received a lecture fee from Otsuka Pharmaceutical Co., Ltd., regarding this study. D.K., M.K. and S.M. are employees of Denka Co., Ltd., the developer of the QuickNavi-COVID19 Ag. All other authors declare no potential conflict of interest.
Additional information
Publisher's note
施普林格自然保持中立regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visithttp://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Takeuchi, Y., Akashi, Y., Kato, D.et al.Diagnostic performance and characteristics of anterior nasal collection for the SARS-CoV-2 antigen test: a prospective study.Sci Rep11, 10519 (2021). https://doi.org/10.1038/s41598-021-90026-8
Received:
Accepted:
Published:
DOI:https://doi.org/10.1038/s41598-021-90026-8
This article is cited by
Clinical Performance of the cobas Liat SARS-CoV-2 & Influenza A/B Assay in Nasal Samples
Molecular Diagnosis & Therapy(2022)
Evaluation of a saliva molecular point of care for the detection of SARS-CoV-2 in ambulatory care
Scientific Reports(2021)
Comments
By submitting a comment you agree to abide by ourTermsandCommunity Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.