Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Published 28 July 2009, doi:10.1136/bmj.b2655
Cite this as: BMJ 2009;339:b2655
Elpidio-Cesar Nadala, director of process development1, Beng T Goh, consultant in genitourinary medicine2, Jose-Paolo Magbanua, senior research associate3, Penelope Barber, chief executive officer4, Alison Swain, senior doctor4, Sarah Alexander, clinical scientist5, Vivian Laitila, director of regulatory affairs1, Claude-Edouard Michel, research associate3, Lourdes Mahilum-Tapay, director of scientific affairs1, Ines Ushiro-Lumb, consultant virologist2, Catherine Ison, director5, Helen H Lee, reader in medical biotechnology3
1 Diagnostics for the Real World (Europe), Cambridge Science Park, Cambridge CB4 0WG, 2 Departments of Genitourinary Medicine and Virology, Barts and The London NHS Trust, London E1 1BB, 3 University of Cambridge, Department of Haematology, Diagnostics Development Unit, NHS Blood and Transplant Site, Cambridge CB2 2PT, 4 Brook in Birmingham, Birmingham B1 1BL, 5 Sexually Transmitted Bacteria Reference Laboratory, Health Protection Agency Centre for Infections, London NW9 5HT
Correspondence to: H H Lee hl207{at}cam.ac.uk
Design Evaluation of test performance in prospective cohort study.
Settings A young peoples sexual health centre (site 1) and a genitourinary medicine clinic (site 2) in the United Kingdom.
Participants 1211 men aged 16-73 attending either of the two sites.
Main outcome measures Sensitivity, specificity, positive predictive value, and negative predictive value of the Chlamydia Rapid Test versus polymerase chain reaction assay. Relation between the visual signal of the Chlamydia Rapid Test and organism load.
Results Detection rates for Chlamydia trachomatis infection with polymerase chain reaction were 4.4% (20/454) at site 1 and 11.9% (90/757) at site 2. Compared with polymerase chain reaction assay, the resolved sensitivity, specificity, positive predictive value, and negative predictive value of the Chlamydia Rapid Test was 82.6% (90/109), 98.5% (1085/1102), 84.1% (90/107), and 98.3% (1085/1104), respectively. The organism load in first void urine samples that were positive for chlamydia ranged from 7.28x102 to 6.93x106 plasmids/ml and correlated significantly with the visual signal of the Chlamydia Rapid Test (r=0.7897, P<0.001).
Conclusions The performance of the new Chlamydia Rapid Test with first void male urine samples indicates that it would be an effective diagnostic tool for chlamydial infection in men. The availability of test results within an hour allows for immediate treatment and contact tracing, potentially reducing the risks of persistent infection and onward transmission. The test could also provide a simple and reliable alternative to nucleic acid amplification assays for testing of male urine in chlamydial screening programmes in high prevalence settings.
Chlamydial infection is commonly asymptomatic and remains underdiagnosed. Efforts aimed at promoting safer sexual behaviours and at detecting and treating infected individuals, especially young adult men, are therefore important to reduce transmission to sexual partners.3 Chlamydial infection is most common among sexually active men and women aged under 25.1 4 In 2006, the overall rate of reported chlamydial infection in the US among women was almost three times that among men, reflecting the larger number of women screened.1 With the growing availability of urine testing, however, men are increasingly being tested for chlamydial infection.1 Recent evidence hinting at a causative role for chlamydial infection in male subfertility might also encourage increased uptake of testing in men.5 6 More widespread and systematic male testing could substantially reduce the infective pool, hence preventing transmission to female partners and reducing serious complications such as pelvic inflammatory disease, chronic pelvic pain, infertility, and ectopic pregnancy.
Given that the collection of urethral swabs is uncomfortable for the patient and must be performed by a trained clinician, screening for chlamydial infection in asymptomatic men can be optimised with a test that performs adequately on urine samples or less painful meatal swabs. Furthermore, the availability of a high performance, rapid, and simple to use test would allow the implementation of a test and treat regimen, whereby patients are treated on site during the initial visit. The use of rapid tests can result in the treatment of more infected individuals than the use of nucleic acid amplification tests if the return rate is less than 65%.7 Nucleic acid amplification tests are commonly used for chlamydial diagnosis and are more sensitive than enzyme immunoassay based tests. Nucleic acid amplification tests, however, take hours or days (if re-testing is required) to complete and are costly. While results of laboratory based tests usually take many days to reach the clinics, currently available rapid tests for the detection of chlamydia in male urine lack the required sensitivity, even when used in a test and treat setting.8
We have evaluated the performance of a new Chlamydia Rapid Test, developed at the diagnostics development unit of the University of Cambridge. The assay is used in conjunction with a collection device for male urine (FirstBurst),9 10 specifically designed to collect the first voided urine that contains a higher organism load, and test results are available in less than an hour. This assay was developed to aid in the diagnosis of chlamydial infection and to provide a screening tool for the detection of such infection among young sexually active males.
Participants
All men attending the two sites were invited to join the study. They were eligible for enrolment if they were aged at least 16, had not taken antibiotics in the previous month, and were able to understand the written information forms for the study. Each participant received an information sheet about the study. Participants gave written informed consent and were then interviewed confidentially about their symptoms and relevant sexual history. Participants at site 2 also filled in a written questionnaire concerning sample collection methods and preferences after they had provided a sample.
Specimen collection
Each participant provided two urine samples, the first one collected using a FirstBurst urine collection device9 that collects the first 4-5 ml of urine. Following the manufacturers instructions (Roche and Gen-Probe), the second urine specimen was collected with a collection cup routinely used in sexually transmitted disease clinics in the UK at least two hours after the FirstBurst specimen was collected. Although not randomised, a previous study showed that the order of collection did not significantly affect the organism load in specimens collected by urine cup and tested with the polymerase chain reaction assay.9 Each participant was shown an illustrated instruction sheet detailing collection of urine with the FirstBurst device.
The second urine sample was divided into two portions, one for polymerase chain reaction testing by an independent laboratory and the other for freezing and storage in case we needed to test discordant samples with the transcription mediated amplification assay. All urine specimens were handled and stored according to the recommendations of the relevant test manufacturers.
An independent clinical laboratory evaluated the reproducibility of the Chlamydia Rapid Test in a study using the guideline of the National Committee on Clinical Laboratory Standards.11 Two operators tested in duplicate a panel consisting of 10 randomised masked samples over a period of five days according to the procedure for the Chlamydia Rapid Test.
Testing with the Chlamydia Rapid Test
Clinic staff tested urine samples on site, with all staff having passed testers requirements in accordance with the National Committee on Clinical Laboratory Standards.11 A 3 ml portion of the FirstBurst urine sample was diluted with 6 ml of deionised water in a centrifuge tube and then centrifuged at 3000 g for 20 minutes at room temperature. Occasionally we performed batch centrifugation of up to 16 specimens/run. The resulting supernatant was discarded and the pellet was subjected to extraction by the sequential addition of 400 µl of reagent 1, 300 µl of reagent 2, and 100 µl of reagent 3, with mixing between additions. We then added 100 µl of the extracted sample to a tube containing lyophilised amplification and detection reagents. The resulting mixture was gently agitated until it became a clear pink solution, after which we added the test strip to the solution and allowed it to stand for 25 minutes before reading the result. The test strip contains a monoclonal antibody to chlamydial lipopolysaccharide12 at the test line and includes a separate procedural control line. The appearance of a result line on the test strip indicated the presence of chlamydia, which was further graded with a semi-quantitative in-house grading card.
Testing with polymerase chain reaction and transcription mediated amplification
The performance of the Chlamydia Rapid Test was assessed to meet the requirements for Conformité Européenne licensure, which stipulate that the comparator test should be a "state of the art" assay and should be performed with specimens approved for the test. Polymerase chain reaction testing for chlamydia, which is licensed for urine specimens, was chosen as the ideal standard test for the study. The Roche Amplicor CT/NG polymerase chain reaction assay has undergone comprehensive evaluations with male urine samples and is similar in reliability to other nucleic acid amplification methods for detection of C trachomatis in urine.13
Urine specimens were sent to a laboratory accredited by the Clinical Pathology Accreditation (UK) for C trachomatis testing with the Amplicor CT/NG polymerase chain reaction assay according to manufacturers instructions (Roche Diagnostic Systems, Branchburg, NJ). Samples that yielded discordant results with the Chlamydia Rapid Test and the polymerase chain reaction assay were tested with the mono-specific Aptima CT kit, a transcription mediated amplification assay (Gen-Probe, San Diego, CA) according to manufacturers instructions at the Sexually Transmitted Bacteria Reference Laboratory (Health Protection Agency, Colindale). In addition, 100 randomly selected specimens negative with polymerase chain reaction and 20 concordant positive samples were masked and tested by this latter assay to minimise potential bias introduced by testing discordant samples only.
Quantification of organism load
Real time quantitative polymerase chain reaction analysis was performed as described previously14 but with modifications.15 A portion (500 µl) of the FirstBurst urine sample from men with positive results with polymerase chain reaction was centrifuged at 17 860 g for 15 minutes at 25°C and the resulting pellet processed as described previously.15 A 20 µl portion of each DNA extract was used for quantitative polymerase chain reaction analysis. Estimation of organism load was determined from a reference curve constructed with a calibrated plasmid pCTL12A preparation (provided by I Clarke).
Statistical analysis
Standard statistical methods were used to analyse data with SAS V9.1 software (SAS, Cary, NC). A P value of <0.05 was considered significant.
Of the 66 excluded participants, 47 had incomplete specimen sets, seven withdrew, and the rest were excluded because of deviations from testing protocol. The mean age for the 1211 men who took part was 18.2 (range 16.0-25.0) at site 1 and 29.8 (16.5-73.4) at site 2 (P<0.001, unequal variance t test (Satterthwaite)). Figure 1 shows the recruitment and testing algorithm for the study participants at both clinical sites
. Most participants at site 1 attended the sexual health centre for contraception and other reproductive health services and were asymptomatic. In contrast, 62% (467/749) of the participants at site 2 (genitourinary medicine clinic) presented with symptoms that included urethral discharge (155/741, 21%) and dysuria (169/744, 23%). In addition, 3% (20/757) of the participants at site 2 attended the clinics after being identified through contact tracing. Of these 20 patients, 30% (6/20) were positive for chlamydia with polymerase chain reaction and 25% (5/20) were positive with the rapid test.
|
Performance of the Chlamydia Rapid Test
The Chlamydia Rapid Test was performed on urine collected with the FirstBurst device, while the polymerase chain reaction was performed on urine collected with the standard cup. Positivity rates with polymerase chain reaction assay were 4% (20/454) at site 1 and 12% (90/757) at site 2. The combined unresolved sensitivity and specificity of the Chlamydia Rapid Test was 81.8% and 98.5%, respectively (table 1)
. After the Sexually Transmitted Bacteria Reference Laboratory tested discordant samples, the Chlamydia Rapid Test had a combined overall sensitivity and specificity of 82.6% and 98.5% (table 1).
All 100 randomly selected concordant negative samples (100%, 95% confidence interval 96.38% to 100%) and 19/20 (75.13% to 99.87%) concordant positive samples were confirmed by the transcription mediated amplification assay (exact confidence interval calculated with the Monte Carlo exact method of estimation). When we took the results of the limited concordant testing into consideration, the imputed sensitivity, specificity, positive predictive value, and negative predictive value was 81.9% (range 54.0-82.6%), 98.1% (96.4-98.5%), 80.4% (63.6-84.1%), and 98.3% (94.8-98.3%), respectively. The ranges in brackets are the extreme scenarios, using both the lower and upper 95% confidence interval estimates for positive and negative concordance in our imputation.
|
|
Organism load in men positive with polymerase chain reaction
After the Chlamydia Rapid Test there was enough urine left from the FirstBurst sample to determine organism load in 80/90 men positive with polymerase chain reaction at site 2. We analysed the DNA extracted from these urine specimens with quantitative polymerase chain reaction assay with a primer set that amplifies a highly conserved sequence of the 7.5-kb cryptic plasmid of C trachomatis. The organism load for these samples ranged from 7.28x102 to 6.93x106 plasmids/ml of urine. The visual signal of the Chlamydia Rapid Test was significantly correlated (r=0.7897, P<0.001) with C trachomatis load (fig 2)
.
|
The Chlamydia Rapid Test examined was developed for the detection of C trachomatis infection in men with the use of first void urine as sample. C trachomatis infects the urethral mucosa in men, and this tissue is usually sampled either with urethral swabs or first void urine. The participants in our study preferred urine samples because of the discomfort associated with swab collection. We recently showed that the chlamydial load in first void urine does not differ significantly from that of urethral swabs.15 To facilitate the reliable collection of the first void urine samples, we used a new urine collection device (FirstBurst), which is provided with the Chlamydia Rapid Test kit. The urine sample collected with this device contains a load of C trachomatis up to six times that in specimens collected with a regular urine cup, thereby increasing the sensitivity of the test.9 The order of different collection methods did not significantly affect the organism load of the specimens of urine collected in cups tested with polymerase chain reaction.9
The evaluated Chlamydia Rapid Test incorporates a novel signal amplification system that has proved effective in enhancing the performance of this test.12 16 The level of sensitivity achieved by the Chlamydia Rapid Test in this study is unprecedented for an immunoassay based rapid test, as previously developed rapid tests for Chlamydia have shown poor sensitivity with cup collected male urine when compared with nucleic acid amplification tests.8 For example, using Ligase chain reaction as a comparison test, Clearview Chlamydia (Unipath, now Inverness) had a sensitivity and specificity of 67.7% and 95.5%, respectively, Testpack Chlamydia (Abbott) had 70.9% and 95.5%, and Surecell Chlamydia (Kodak) had 62.9% and 100%.8 The difference in performance with the previous rapid tests might in part be related to the FirstBurst sample collection.
The Chlamydia Rapid Test showed an overall unresolved sensitivity of 81.8% and a positive predictive value of 84.1%. At the young peoples sexual health centre (site 1), where the prevalence of chlamydial infection was only 4.4%, the positive predictive value of the Chlamydia Rapid Test was significantly lower (69.2 v 88.9%) than that at the genitourinary medicine clinic (site 2), where the prevalence of infection was 11.9%, although there was a slight overlap in the 95% confidence intervals for the two sites. This finding is not unexpected because of the different prevalence rates at the respective study sites. The Chlamydia Rapid Test also showed an overall high positive likelihood ratio (54.5:1), suggesting that a positive result multiplies the individuals original likelihood of chlamydia by 54.5:1.
Efforts to control chlamydial infection among young sexually active people are unlikely to succeed without an effective testing programme for men. Given that men do not get tested for chlamydia as often as women do, as well as the inevitable delay in obtaining results with currently available testing methods, men with asymptomatic chlamydial infection continue to provide a transmission link for the disease that is missed by current testing programmes. Prevention of the spread of disease will thus require a high performance rapid test for chlamydia that allows for a test and treat regimen, in addition to the existing nucleic acid amplification tests. Emerging concerns regarding the role of chlamydia in male subfertility might encourage more asymptomatic men to come forward for screening.5 6
The performance of the Chlamydia Rapid Test is clearly related to the organism load within the specimen. Higher loads have been associated with increased chlamydia positivity in tested sexual partners, suggesting that those with higher loads are more infectious.17 This was confirmed in our study, where we observed a higher positivity rate (30% with polymerase chain reaction v 25% with the Chlamydia Rapid Test) in men who attended because of contact tracing. Men who tested positive with the Chlamydia Rapid Test are thus likely to be the most infectious, and rapid removal of these infected men from the reservoir of infection with a test and treat regimen might have an advantage over traditional screening approaches. This hypothesis warrants further investigation in appropriately designed trials.
Reliance on nucleic acid testing alone can be problematic, depending on the target used in the assay. This is evidenced by the recent demonstration of the presence of the Swedish C trachomatis variant with partial deletion of plasmid in many European countries18 as well as another distinct variant strain that could not be detected by plasmid based nucleic acid amplification tests.19 These strains would be detectable by the Chlamydia Rapid Test because the test recognises the genus specific Chlamydia lipopolysaccharide.
In developing countries, the availability of the Chlamydia Rapid Test would also allow more men to be screened and treated. Specific diagnostic tests for chlamydia are rarely available in these regions and management is often based on self reported symptoms and clinical signs, thus missing asymptomatic men altogether. Given the high prevalence of chlamydial infection among sex workers in these settings,20 male customers are likely to transmit infection to their other sexual partners and should therefore be among the primary targets for chlamydia testing.
Strengths and weaknesses of the study
This study included two centres with relatively large population sizes at sites with low and high prevalence. We used confirmatory testing on discordant samples to resolve true chlamydial positivity and additional random testing to minimise the bias from "selective" analysis of discordant samples. In addition, there was high reproducibility of testing between operators, strengthening the validity of the laboratory methods. The Chlamydia Rapid Test specimens were collected from men who had not had to hold their urine for two hours, thus providing applicability in a real world setting without the time restrictions imposed by traditional testing algorithms.
The number of men positive for chlamydia at site 1 was low because of the low prevalence nature of this site. The 95% confidence intervals for the sensitivity of the Chlamydia Rapid Test were larger at site 1 than at site 2. Also, in the determination of chlamydia load, the reference curve was based on purified plasmid preparations in buffer, therefore we could not control for inhibitory substances potentially present in some urine specimens.
Future research
Future studies should focus on determining whether the widespread use of the Chlamydia Rapid Test in screening young men for chlamydial infection in high prevalence settings can help prevent sequelae among their female sexual partners. In addition, more studies are warranted to verify whether the Chlamydia Rapid Test would reassure young men that testing can be quick, simple, and non-invasive, and this might increase uptake. The rapid test might also be used to confirm the chlamydia status in men with symptomatic non-gonococcal urethritis at the point of care, thus allowing more efficient contact tracing and focusing the health promotion resources on these individuals at the time of testing. Any potential improvement of the outcome over current approaches with nucleic acid amplified based screening should be evaluated in relation to alternative strategies. Finally, to further reduce the testing time of the rapid test, it might be worth exploring the use of urethral swab, especially in genitourinary medicine clinics that routinely collect urethral smears. This advantage, however, should be balanced with the fear in men of urethral procedures, which abounds in genitourinary medicine clinics, not only among those who have attended previously.21
Conclusions
The new Chlamydia Rapid Test for urine samples from men showed high sensitivity and specificity that can produce results within an hour. It is therefore suitable as a primary diagnostic tool, especially in settings where patients need to be tested and treated in one visit. It could also be used as a screening tool in areas with a high prevalence of infection or in settings where access to nucleic acid amplification tests is limited or where the return rate is low. Further studies are required to determine the utility and cost effectiveness of the Chlamydia Rapid Test in such roles.
|
Cite this as: BMJ 2009;339:b2655
Contributors: HHL was the chief investigator and is the guarantor. E-CN wrote the first draft of the manuscript and led in the manufacture of the Chlamydia Rapid Test kits used in the study. BTG, IU-L, and PB were the principal investigators at the clinical sites. J-PM, LM-T, VL, and HHL developed the clinical plan and acted as clinical monitors. E-CN and C-EM developed the Chlamydia Rapid Test for men. J-PM and E-CN were responsible for data entry and analysis. AS was the clinician involved in the study at site 1. SA and CI tested and analysed discordant samples. All authors participated in drafting and revising the manuscript, and all approved the final version.
Funding: The study was funded by a Wellcome Trust grant to the University of Cambridge and additional support from the NIHR Cambridge Biomedical Research Centre. The funding sources had no role in study design; in the collection, analysis, or interpretation of data; in the writing of the report; or in the decision to submit the article for publication.
Competing interests: J-PM, C-EM, and HHL are equity holders in Diagnostics for the Real World, which markets the rapid test technologies developed at the University of Cambridge. Both the University of Cambridge and the Wellcome Trust are also equity holders of the company.
Ethical approval: The study was approved by Moorfields and Whittington research ethics committee (05/Q0504/53) and Brook in Birmingham research ethics committee and informed consent was given by all patients.
© Nadala et al 2009
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati What's this?