Research

Risk and protective factors for meningococcal disease in adolescents: matched cohort study

BMJ 2006; 332 doi: http://dx.doi.org/10.1136/bmj.38725.728472.BE (Published 23 February 2006) Cite this as: BMJ 2006;332:445
  1. Joanna Tully, clinical research fellow1,
  2. Russell M Viner, consultant in adolescent medicine and endocrinology2,
  3. Pietro G Coen, statistician1,
  4. James M Stuart, consultant epidemiologist4,
  5. Maria Zambon, head of respiratory virus unit5,
  6. Catherine Peckham, professor of paediatric epidemiology3,
  7. Clare Booth, research assistant6,
  8. Nigel Klein, professor of infectious diseases and immunology6,
  9. Ed Kaczmarski, director7,
  10. Robert Booy, professor of academic child health (robertb2{at}chw.edu.au)1
  1. 1 Academic Centre for Child Health, Queen Mary's School of Medicine and Dentistry at Barts and the London, University of London, London E1 1BB
  2. 2 Department of Paediatrics, Royal Free and University College Medical School, University College, London WC1E 6BT
  3. 3 Centre for Paediatric Epidemiology and Biostatistics, Institute of Child Health, London WC1N 3JH
  4. 4 Health Protection Agency (South West), Stonehouse GL10 3RF
  5. 5 Health Protection Agency, Respiratory Virus Unit, Health Protection Agency, London NW9 5HT
  6. 6 Infectious Diseases and Microbiology Unit, Institute of Child Health
  7. 7 Health Protection Agency, Meningococcal Reference Unit, Manchester Royal Infirmary, Manchester M13 9WZ
  1. Correspondence to: R Booy
  • Accepted 14 November 2005

Abstract

Objective To examine biological and social risk factors for meningococcal disease in adolescents.

Design Prospective, population based, matched cohort study with controls matched for age and sex in 1:1 matching. Controls were sought from the general practitioner.

Setting Six contiguous regions of England, which represent some 65% of the country's population.

Participants 15-19 year olds with meningococcal disease recruited at hospital admission in six regions (representing 65% of the population of England) from January 1999 to June 2000, and their matched controls.

Methods Blood samples and pernasal and throat swabs were taken from case patients at admission to hospital and from cases and matched controls at interview. Data on potential risk factors were gathered by confidential interview. Data were analysed by using univariate and multivariate conditional logistic regression.

Results 144 case control pairs were recruited (74 male (51%); median age 17.6). 114 cases (79%) were confirmed microbiologically. Significant independent risk factors for meningococcal disease were history of preceding illness (matched odds ratio 2.9, 95% confidence interval 1.4 to 5.9), intimate kissing with multiple partners (3.7, 1.7 to 8.1), being a university student (3.4, 1.2 to 10) and preterm birth (3.7, 1.0 to 13.5). Religious observance (0.09, 0.02 to 0.6) and meningococcal vaccination (0.12, 0.04 to 0.4) were associated with protection.

Conclusions Activities and events increasing risk for meningococcal disease in adolescence are different from in childhood. Students are at higher risk. Altering personal behaviours could moderate the risk. However, the development of further effective meningococcal vaccines remains a key public health priority.

Introduction

Invasive meningococcal disease is a life threatening condition, with endemic and epidemic manifestations in developed and developing countries.1 2 A primary incidence peak occurs in children aged < 5 years and a smaller peak in teenagers.1 The incidence of meningococcal disease in England2 and the United States3 rose during the 1990s, with a marked shift in age distribution towards older teenagers4 and a rise in disease due to serogroup C strains.5 This rise, together with a higher case fatality rate in the 15-19 year age group,3 4 caused much concern and was a major stimulus in the United Kingdom for developing the conjugate meningococcal serogroup C vaccine, which has been highly successful.6

The reasons for the peak in meningococcal disease in teenagers are poorly understood. Greater transmission of meningococci has been implicated,7 as prevalence of carriage increases through childhood.8

Studies in the peak teenage years are limited to subgroups such as college students,9 10 or to small numbers enrolled in larger studies.11 12 Possible risk factors in children include deficiency of mannose-binding lectin,13 preceding respiratory infections, particularly influenza A,1416 overcrowding,11 17 poverty,11 passive smoke exposure,11 12 and mouth kissing.11

Adolescence is a period of biopsychosocial maturation during which the adoption of potentially risky behaviours may produce a distinct risk profile. Studies have found living in college dormitories,9 10 patronage of campus bars, and active smoking18 to be risk factors. Other factors relevant to teenagers may include infection with Epstein-Barr virus,19 20 behaviours such as deep kissing, and substance misuse.21 22 Religious observance may be protective.23 We conducted a matched cohort study of meningococcal disease in adolescence to examine potential risk and protective factors.

Methods

Study setting and subjects

We conducted a prospective, population based, matched, cohort study covering six contiguous regions of England (North Thames, South Thames, Anglia and Oxford, South West, Trent, West Midlands), which represent about 65% of the country's population. The process of gaining ethical approval was challenging due to the wide geographic area and nature of both the study content and subject age group. It had implications on the recruitment of subjects and became the subject of a paper.24 The research fellow and research nurse collected data from 5 January 1999 until 9 June 2000, covering two winter peaks of meningococcal disease. Eligible subjects were teenagers aged 15-19 who had been admitted to hospital with a primary clinical diagnosis of meningococcal infection (signs of septicaemia or meningitis in association with hemorrhagic rash, or both). Laboratory confirmation of disease was sought at the reference laboratory in Manchester through culture or detection by polymerase chain reaction of Neisseria meningitidis from a normally sterile site or serodiagnosis in a patient with a clinically compatible illness.

Consultants in communicable disease control, clinicians, the national meningococcal reference unit, or the Meningitis Research Foundation helpline notified eligible subjects of the study centre by telephone or electronic mail. After referral of a possible case, the research fellow contacted the attending clinician to confirm the clinical diagnosis and to obtain informed consent for the patient's participation. We excluded cases if identified after the fifth day of admission to hospital, the subject had died, the attending doctor declined to participate, the subject did not speak English, or approval from the local research ethics committee had not yet been obtained.

We recruited controls from the case patient's general practitioner's list of patients. Each general practitioner was asked to contact the three patients on their list of the same sex as, and closest date of birth to, the case. This was to control selection bias by the doctor. We preferentially recruited the control nearest in age to the case. If none of these subjects consented we asked the doctor to send invitation letters to the next three who were nearest in age. Trained researchers interviewed subjects confidentially at home shortly after discharge from hospital. Each case-control pair was interviewed on the same day where possible. The interviewer completed standardised questionnaires.

As we were interested in specific, not necessarily habitual, behaviours, we obtained data from cases pertaining to the two week period before admission to hospital. We reduced the time between illness and interview and used memory aides (timelines, calendars, and personal diaries) to reduce recall bias for cases. To reduce recall bias in controls, we questioned subjects about the two week period immediately preceding interview. Because of this difference in time periods, it was not possible to blind researchers to the status of cases and controls.

Data collection

We obtained data from the participants on preceding illness: symptoms of prodromal illness (in cases) and preceding illness (in cases and controls—for example, fever, headache, cough, rhi-norrhoea, sore throat); on health behaviours: passive smoke exposure (number of smokers in participant's place of residence), active smoking (one or more cigarettes per day), and consumption of alcohol and illicit drugs; on intimacy behaviours: superficial and deep kissing contacts, close social contacts, and sharing of beds and bedrooms; on social behaviours: attendance at religious ceremonies, leisure activities, and social activities; on socioeconomic variables: education or employment status, living conditions. Data obtained from the participant's head of household included birth history (preterm delivery defined as gestation < 37 weeks); meningococcal vaccination history; and details of occupation, crowding, and home and car ownership. We regarded participants as head of household if they were employed or living independently.

Case patients gave a blood sample, pernasal swab, and throat swab within five days of admission. At interview, we collected a convalescent blood sample from cases and a blood sample, throat swab, and pernasal swab from controls. We considered the control blood sample comparable to the case convalescent sample as it was taken at a similar time (median difference of 0 days; interquartile range of −28 days to 0 days). We placed swabs in viral transport medium and transported them immediately to the Health Protection Agency (HPA; formerly Public Health Laboratory Service, PHLS), together with the blood sample. Blood samples were separated with serum divided into 4 aliquots and stored at −20°C. The viral transport medium containing the swabs was stored at −70°C.

The Health Protection Agency's national meningococcal reference unit in Manchester performed meningococcal serogroup B and C serology.25 Laboratory technicians at the University of Edinburgh used indirect immunofluorescence to perform virology for Epstein-Barr virus. Immunoglobulin G antiviral capsid antibody positivity was taken to indicate past infection with Epstein-Barr virus. Recent infection with Epstein-Barr virus was defined as positivity for IgM antiviral capsid antibody.26 The respiratory virus unit at the Central Public Health Laboratory in north London performed influenza serology and reverse transcriptase polymerase chain reaction analysis were performed.27 Haemagglutinin inhibition antibody titres were performed for influenza A subtypes H3N2 and H1N1 and for influenza B. Titres of > 320 against influenza A H3N2 and > 80 for influenza B were taken to indicate infection within the last year (personal communication, Maria Zambon, Health Protection Agency, 2000).

Laboratory technicians extracted DNA and RNA from throat and pernasal swabs. The Health Protection Agency undertook analysis by reverse transcriptase polymerase chain reaction for influenza A and B and respiratory syncytial virus and by polymerase chain reaction for Chlamydia pneumoniae and Mycoplasma pneumoniae.28 A lab technician determined mannose-binding lectin haplotypes at the Institute of Child Health in London. The exon 1 region of the mannose-binding lectin structural gene and promoter region polymorphisms were determined by using previously described heteroduplex procedures and the results used to predict concentrations of mannose-binding lectin. Subjects were divided into groups of low, medium, or high production of mannose-binding lectin, with low producers defined as either those subjects who were homozygous, or compound heterozygous for exon 1 mutations or those heterozygous for an exon 1 mutation and also carrying the low promoter variant.29 30

Statistical analysis

We used Stata 6 (College Station, Texas, YEAR?? OUTSTANDING QUERY) for our statistical analyses. We used Mantel Haenzel odds ratios to perform univariate analysis. We performed multivariate stepwise logistic regression; we included variables if they had a univariate significance level of P < 0.2.31 We determined socioeconomic status by household ownership of car and home and by subject occupation and included this a priori in the model. As risk behaviours may vary by time of year, we also included a seasonality variable in the model, with meningococcal disease high season defined as 70 or more cases per week. We made power calculations: in respect to active smoking, we speculated that the prevalence in cases and controls would be 30% and 12%, respectively, requiring 116 case-control pairs to provide 95% confidence intervals with 90% power. Using a similar approach for kissing, we hypothesised that multiple exposures in the previous fortnight might be found in 40% of cases and 20% of controls, requiring 118 pairs. These calculations did not take account of matching.

Results

During the study period, public health units in the study regions received 319 statutory notifications of meningococcal disease in teenagers aged 15-19. Of these, 244 were referred to the study centre and 153 were recruited. Of the 91 cases referred but not recruited, 23/244 (9%) were referred after the fifth day of admission, 18 (7%) came from districts where local ethical approval was delayed, 16 (7%) died before recruitment, 12 (5%) had an alternative diagnosis, 11 (5%) refused, in 5 (2%) the clinician in charge refused, 3 (1%) did not speak English, and 3 (1%) were not recruited for miscellaneous reasons. Of the 153 recruited, two died after recruitment, two later refused to participate, and five were lost to follow-up, resulting in 144 cases from whom questionnaire data were collected.

Of the 144 controls, 55 (38%) were the first control and 36 (25%) were the second control approached. In 20% of cases, we recruited the fourth or greater control.

Of the 144 case-control pairs, 74 (51%) were male (table 1). The median age at referral was 17.6 for cases and 17.7 for controls. Median time from admission of the case to interview was 53 (range 4-343) days for cases and 64 (19-317) days for controls.

Table 1

Demographic data on participating cases and controls. Values are numbers (percentages)

View this table:

Microbiological confirmation of diagnosis was available for 114 cases; positive on polymerase chain reaction in 50 (44%), positive on culture in 38 (33%), and positive on serology in 111 (97%). Sixty six (58%) strains were due to serogroup B, 43 (38%) serogroup C, 1 (0.9%) serogroup W135, 1 (0.9%) serogroup Y, and 3 were ungroupable. We found no significant differences between microbiologically proved and unproved cases in terms of admission to intensive care or symptoms of illness.

In the univariate matched analysis of biological factors, case patients were significantly more likely to report being unwell with a preceding illness in the fortnight before admission than were the controls in the fortnight before interview (P = 0.001; table 2). Samples for viral serology were available for 105 case-control pairs (73%). More cases than controls were positive for Epstein-Barr virus antiviral capsid antibody IgG (P = 0.12); three of 129 (2%) cases and none of 116 controls were IgM positive. We found no differences between cases and controls in the proportions with influenza A H3N2 or H1N1 titres > 320 or influenza B titres > 80. Of 81 cases with paired serology, nine (11%) showed at least a fourfold rise for influenza A (H3N2 7, H1N1 2), and five (6%) showed at least a fourfold rise for influenza B. The trend was for preterm birth (defined as < 37 weeks' gestation) to be associated with increased risk. Our a priori hypothesis didn't define 30 weeks as an important cut-off (this was defined as 37 weeks). However, after data collection was complete and during further analysis of data, we found that five cases but no controls were born at gestation of 30 weeks or less.

Table 2

Univariate analyses for biological factors. Values are numbers (percentages) unless otherwise indicated

View this table:

Throat or pernasal swab specimens came from 86 cases and 139 controls. We found no positive results on polymerase chain reaction from throat or pernasal swabs for influenza A or B, mycoplasma or respiratory syncytial virus. Samples for mannose-binding lectin analysis were available for 92 pairs (64%). Low production of mannose-binding lectin was not associated with disease. Immunisation was protective, and preterm delivery was linked with increased risk.

In the univariate analysis of health behaviours and social variables (table 3), factors associated with greater risk included having more than one intimate kissing contact and sharing a bedroom. Lower risk was associated with attending a religious ceremony at least once a week. Living in dormitory accommodation and socioeconomic status measured by subject's occupation or by using a composite variable of car and home ownership were not significant.

Table 3

Univariate analyses for health behaviours and social variables. Values are numbers (percentages) unless otherwise indicated

View this table:

Multivariate analysis

In the final model, factors independently associated with higher risk of meningococcal disease were history of preceding illness, intimate kissing, being a student and preterm birth (table 4). Factors independently associated with lower risk included religious observance and having received a vaccine against serogroup C meningococci. Multivariate analysis using only microbiologically confirmed cases resulted in less power but gave similar results except for preterm birth (odds ratio 2.3, 95% confidence interval 0.5 to 10.0, P = 0.3) and attendance at religious ceremonies (0.13, 0.01 to 1.4, P = 0.09). Regular active smoking, passive smoking, use of illegal drugs, bedroom sharing, and socioeconomic status were not independently associated with risk. Use of the registrar general's classification for parental occupation as a measure of socioeconomic status instead of the composite variable of car or home ownership, did not materially change the final model.

Table 4

Multivariate analysis of risk factors for meningococcal disease

View this table:

Discussion

Risk factors for meningococcal disease in adolescents differ from those in childhood. We conducted a large population based study of risk factors for meningococcal disease in adolescents and a specific epidemiological investigation of disease risk during the adolescent peak (in 15-19 year olds).

Role of preceding illness

Independent biological risk factors for meningococcal disease included a history of preceding illness and preterm birth. A preceding illness has previously been identified as a risk factor,9 12 15 16 32 and we confirmed this by using a symptom based definition of preceding illness. Preceding illness occurred in 53% of cases and 31% of controls so was neither necessary nor sufficient for disease. Its significance was unchanged after adjustment for high season of meningococcal disease or influenza. The precise aetiology of this preceding illness is unclear and may be a heterogeneous array of respiratory viruses. A case-control study of epidemic meningococcal disease in sub-Saharan Africa implicated adenovirus, parainfluenza, rhinovirus, mycoplasma, and respiratory syncytial virus.15 However, similar to Stuart et al,33 we found no evidence for respiratory syncytial virus being a predisposing agent. Our data did not support a role for Epstein-Barr virus or influenza infection, similar to findings from another recent study.12 However, outbreak14 34 35 and surveillance data linkage studies36 show that influenza may predispose to meningococcal disease. It is likely that our cases were no longer shedding virus by the time of recruitment, but serological results were not supportive.

Possible association with weeks of gestation

The association of preterm birth and disease has not been described previously and should be interpreted with caution. Significance was lost when only microbiological confirmed cases were included. Our hypothesis was that gestation < 37 weeks increased risk.

Interestingly, we found that five of our case patients but no controls were born at gestation of 30 weeks or less. This association may be a chance finding, biased by parental report, or, perhaps, could reflect real differences in immune function programming related to timing of birth.37 38 We did not find a significant relation between genetic determinants of production of mannose-binding lectin and risk of disease despite evidence that deficiency in mannose-binding lectin is a risk factor in young children.13 This may reflect lack of power, but it supports recent suggestions that mannose-binding lectin becomes less important in protecting against meningococcal disease with increasing age as elements of the acquired immune system mature.39

Association with kissing

Several adolescent health behaviours were significantly associated at univariate level, but only deep kissing with multiple partners remained independently significant in the multivariate model. This association has not been noted before in studies of college students and older adults.9 12 Kissing on the mouth has been suggested to be a risk factor in children,11 but we found no evidence supporting this in adolescents (data not shown). Intimate kissing has been shown to be a risk factor for the carriage of meningococci in university students40 and it is likely that intimate kissing with multiple partners increases risk of transmission. Sharing a bed or bedroom and having a partner were not significant in the model if intimate kissing was included, which implies that risk derives from oropharyngeal exchange rather than other behaviours related to proximity. Any public health message for young people emphasising that deep kissing with multiple partners increases risk of acquiring serious infections may influence a small subset to change behaviour. Evidence from randomised trials shows that health promotion to young people through general practice can beneficially influence risk behaviours,41 although the impact is likely to be small.

Given that we have shown that preceding upper respiratory infection is an important risk factor for meningococcal disease, our work provides an evidential basis for the UK Department of Health campaign for a teenager to “look out for your mate” (http://www.immunisation.nhs.uk/files/loymleaflet.pdf, accessed 23 May 2005), as apparent flu-like illness or hangover may in fact be the early stages of meningococcal sepsis.

Other possible risk factors

We found no significant role for active or passive smoking in adolescents, similar to previous findings in young adults,9 42 but in contrast to evidence that passive smoke exposure is a risk factor in children,11 12 who are more likely to be exposed to meningococci because of higher carriage rates in smoking parents.43

Recent attendance at a religious event was linked to lower risk of meningococcal disease, as reported elsewhere.23 The odds ratio was minimally changed when only microbiologically confirmed cases were included. The association was confirmed when the analysis was repeated for habitual religious attendance in the previous year (data not shown), indicating minimal bias due to non-attendance by cases because of preceding or prodromal illness. Religious observance has been associated with lower risk for all cause mortality,44 substance abuse, and sexual risk taking in adolescents45 and has beneficial immune effects.46 The most plausible explanation for our finding is that attendance at a religious event is associated with other lifestyle factors that promote health and protect against infection44 and that were not fully accounted for in our multivariate analysis.

University and school students were at higher risk of meningococcal disease than people in employment. Contrary to previous reports,9 10 we did not find that living in dormitory-style accommodation increased risk, although numbers were small (7% of cases, 6% of controls).

Student status may increase risk through crowding and increased social mixing, or through increased “risky” behaviours compared with employed young people of the same age.

Limitations of our study

Our findings are susceptible to the biases common to case-control studies,47 despite efforts to minimize selection and recall biases and confounding. Recruitment of cases and controls was population based and prospective. Only 4.5% of eligible case patients refused participation. Although 63% of our recruited controls were either the first or second approached, 20% were the fourth or greater approached. This is a source of selection bias, as these secondary controls may well be different from those not willing to participate (and this may relate to risk of exposure to meningococcal disease). Further, findings concerning religious observance may be confounded by control selection, in that highly observant young people may be more likely to volunteer. The approach taken of asking the case about a different time period to the control may introduce bias; however, the limitation of our approach has been addressed and at least partially validated in a recent statistical paper that used data from our study.48 It addressed the question: does disease incidence, and possibly other risk factors, vary with time of year, and concluded that the effect of risk factors and interactions may be adjusted for the time of year effect in a standard condition logistic regression analysis (as our paper has done) without introducing any bias.

We attempted to avoid recall bias by using a short recall period, memory aides, and a different recall period for cases and controls (adjusted for by a seasonal variable). The median times between hospital admission and interview for the case and control were 53 and 64 days, respectively, highly comparable to those in a recent case-control study of invasive pneumococcal disease by Nuorti et al.49 However, this study asked the case and control about the month before the case patient's illness, which was easier to do as their questions related more to habitual behaviour, which is easier to remember.

Excluding the few cases that died biased our sample towards less severe cases. Restricting analysis to microbiologically proved cases showed minimal confounding of the identified risk factors apart from preterm birth. A further potential source of bias arises from preceding or prodromal illness, as a reduction in risk behaviours in those who are becoming ill may underestimate the effect of risk factors for meningococcal disease and over-estimate protective effects. However, analysis of long term habitual data on active smoking and religious attendance indicated that behaviour change due to illness was not a significant source of bias.

What is already known on this topic

The incidence of meningococcal disease has two peaks: in early childhood and in adolescence

The incidence and case fatality rate in UK teenagers increased dramatically in the mid to late 1990s

Students living in dormitories are at greater risk than the general population of adolescents, but little is known of the risk factors for most cases of meningococcal disease in adolescents

What this study adds

Risk factors for meningococcal disease in adolescence differ from those in childhood

Independent risk factors include having multiple intimate kissing partners, history of preceding upper respiratory tract illness, preterm birth, and being a student

Reduced risk was associated with religious ceremony attendance and meningococcal vaccination

Changing personal behaviours could reduce the risk of meningococcal disease in adolescence

Conclusions

We identified a pattern of risk and protection for meningococcal disease in adolescence different from that seen in younger children. Intimate kissing with multiple partners, preceding illness, and being a student conferred higher risk of disease, whereas religious attendance and receipt of a meningococcal vaccine were associated with lower risk. Factors that are important in meningococcal disease risk in younger children, such as passive smoking and deficiency of mannose-binding lectin, were not significant in adolescence. Our findings imply that changing personal behaviours could reduce the risk of meningococcal disease in adolescence. Although behaviour based health promotion messages might have a small role in reducing the risk of disease, such campaigns are unlikely to have a major impact. The development of further effective meningococcal vaccines therefore remains a key public health priority.50

Many thanks to all those who have contributed substantially to this work: Dorothy Crawford, Elizabeth Haworth, Robert George, Tim Harrison, Mary Ramsay, Mac Turner, Mike Levin, Diane Melvin, Steve Gray, Alan Blackwell, Julie Roberts, Jennie Borg, Jane Scotland, Helen Bedford, Stuart Logan, and Angie Wade and the many clinicians and public health doctors who referred cases.

Footnotes

  • Contributors JT coordinated the study and drafted the manuscript. PGC was primarily responsible for data cleaning and analysis and contributed to manuscript revisions. JMS, MZ, CP, and EK contributed to study design, analysis, and manuscript revisions. CB and NK analysed genetic data and contributed to manuscript revisions. MZ was also responsible for laboratory analysis of viral data. RMV and RB designed the study, analysed data, and revised the manuscript. RB is guarantor.

  • Funding Meningitis Research Foundation, UK; in addition, the Wolfson Foundation provided an equipment grant. RMV is supported by the Health Foundation.

  • Competing interests RB has acted as a paid consultant for Wyeth, GlaxoSmithKline, and Aventis Pasteur. MZ has received honoraria from Berna Biotech to speak at industry conferences on influenza. The UK Health Protection Agency has received funding from Chiron vaccines, Wyeth vaccines, Aventis Pasteur, Roche, and GlaxoSmithKline to carry out analytical work on a contractual basis in MZ's laboratory.

  • Ethical approval North Thames multicentre research ethics committee and 125 local research ethics committees.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. 23.
  24. 24.
  25. 25.
  26. 26.
  27. 27.
  28. 28.
  29. 29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. 35.
  36. 36.
  37. 37.
  38. 38.
  39. 39.
  40. 40.
  41. 41.
  42. 42.
  43. 43.
  44. 44.
  45. 45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
  50. 50.