Home |
Current Issue |
Past Issues |
In the Clinic |
ACP Journal Club |
CME |
Collections |
Audio/Video |
Mobile |
Subscribe |
Tools |
Help |
ACP Online
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
1 July 1995 | Volume 123 Issue 1 | Pages 27-31
Objective: To determine in female tennis and squash players the effect of biological age (that is, the starting age of playing relative to the age at menarche) at which tennis or squash playing was started on the difference in bone mineral content between the playing and nonplaying arms.
Design: Cross-sectional study.
Setting: Finnish tennis and squash federations.
Participants: 105 female Finnish national-level players and 50 healthy female controls.
Main Outcome Measures: Differences in bone mineral content in playing and nonplaying (dominant to nondominant) arms (proximal humerus, humeral shaft, radial shaft, and distal radius) were compared in the players and controls and among six groups of players. Players were divided into groups according to the biological age (years before or after menarche) at which their playing careers began: more than 5 years before; 3 to 5 years before; 2 to 0 years before; 1 to 5 years after; 6 to 15 years after; and more than 15 years after.
Results: Compared with controls (whose mean ±SD differences in bone mineral content were 4.6% ±4.6%, 3.2% ±2.3%, 3.2% ±3.8%, and 3.9% ±4.3% at the previously noted anatomical sites), the players had a significantly (P < 0.001) larger side-to-side difference in every measured site (15.5% ±8.4%, 16.2% ±9.8%, 8.5% ±6.6, and 12.5% ±7.1%). Among players, the group differences in bone mineral content were significant (P < 0.001 to P = 0.005), with the group means clearly decreasing with increasing starting biological age of playing. The difference was two to four times greater in the players who had started their playing careers before or at menarche (lowest mean difference in bone mineral content, 10.5% ±7.2%; highest difference, 23.5% ±7.2%) than in those who started more than 15 years after menarche (lowest difference, 2.4% ±4.8%; highest difference, 9.6% ±4.9%). Adjustment for potential confounding factors (age and height) did not change these trends.
Conclusions: Bones of the playing extremity clearly benefit from active tennis and squash training, which increases their mineral mass. The benefit of playing is about two times greater if females start playing at or before menarche rather than after it. The minimal level and minimum number of years of activity necessary to produce these results, the extent to which this benefit is sustained after cessation of intensive training, and the degree to which these results can be extended to other forms of physical activity and other bone sites should be studied further.
In healthy persons, suggested main determinants of peak bone mass are race, sex, heredity, hormonal status, nutrition, and physical activity [4]. Of these, genetic factors play a major part, accounting for 60% to 80% of the variance [1]. Still, 20% to 40% of the variance may be due to environmental factors, including nutrition and physical activity, and it is important to focus on these factors because both can be easily controlled in generally acceptable ways.
The importance of physical activity in maintaining adult bone mass is widely recognized [1, 4-6]. However, the effects of physical activity on growing bone have received only scant and general attention [7-10], and, to our knowledge, no prospective, controlled follow-up studies have been done. Cross-sectional studies have provided preliminary evidence of the beneficial effect of exercise on the skeleton during growth, but they left many questions unanswered because of insufficient information about the type, intensity, frequency, and duration of the exercise and because of other limitations in the study design. Therefore, exact determination of the optimal age or level of exercise necessary to achieve maximal peak bone mass has not been possible [8].
Recent studies have shown unequivocally that bone mass increases dramatically and naturally during puberty and that bone mass reaches its peak before the end of the second decade of life, which is much earlier than was previously thought [11-15]. However, the extent to which physical activity can modify this development and the age at which the effects of exercise are most crucial are unknown.
Our objective was to determine the effect of biological age at which unilateral loading was started (that is, the starting age of training relative to the age at menarche) on the difference in bone mass in playing and nonplaying arms of female racket-sport players. Using athletes with a known history of unilateral loading and a wide range of starting ages of playing (from early childhood to early middle age), adequately matched nonplaying controls, and a study design with side-to-side comparison, we could control many confounding factors encountered in earlier cross-sectional studies (intrinsic factors such as age, height, weight, and hormonal status and extrinsic factors such as nutrition, smoking, and alcohol consumption).
We recruited 105 currently ranked national-level female tennis and squash players for our study through the Finnish tennis and squash federations. The ethical committee for clinical investigation at our institute approved the investigational protocol, and we obtained informed consent from all participants. Ninety-seven players were right-handed (played with the right, dominant hand), and the remaining eight were left-handed. The mean age of players was 27.7 ±11.4 years (±SD). They were clinically healthy with no known diseases and were not receiving medications known to affect bone metabolism; none had previously had upper extremity fractures. The players' active training history had to be 5 years or more (mean, 10 ±6 years). The mean starting age of the playing career (that is, the age at which the athlete started to practice at least 2 sessions each week on a regular basis) was 16 ±9 years. They trained 4.4 times per week on average, and the average duration of each session was 80 minutes (range, 60 to 180 minutes). None of the participants performed or had performed activities, other than playing the racket sport, that affected only one extremity.
For the control group, we recruited 50 healthy Finnish women from local schools and work places. All but 2 of them were right-handed (that is, the right hand was dominant). The mean age of this group was 27.2 ±9.2 years. All participants in this group were also clinically healthy and had had no previous upper extremity fractures. Although some of them did participate in casual recreational sports (such as jogging, biking, skiing, swimming, and aerobics), none was involved in intense physical training or activities or work affecting the dominant or nondominant arm only.
Interview
The participants received a mailed questionnaire, which they completed independently at home. At the session during which anthropometric and strength measurements were obtained, one of three investigators (PK, HH, or MS) quickly reviewed the questionnaire responses with participants. This review determined whether the participants had understood and answered all questions. The three procedures (anthropometric measurements, strength measurements, and questionnaire review) were done in random order and always after bone measurements were obtained. The investigator was blinded to the bone measurement results.
The questionnaire included data on years of active playing, starting age of playing, number of training sessions per week, training intensity, average duration of each session, physical activities other than tennis or squash playing, injuries, medication, known diseases, diet, possible vitamin or mineral supplementation, consumption of alcohol, and use of cigarettes. We assessed the daily dietary calcium intake using a prospective 7-day questionnaire on consumed food, and we analyzed the results using Micro-nutrica software (Social Insurance Institution, Helsinki, Finland).
We also asked all participants about the age at onset of menses. We determined the menstrual status and divided the participants into three categories: 1) normal cycle of 23 to 35 days, with or without use of low-dose oral contraceptives, 2) any irregularity in menstrual pattern [such as short or long period, anovulatory cycles, short luteal phase, or oligomenorrhea], and 3) amenorrhea (no menstruation during the previous 6 months). We also asked the participants whether they had ever had disturbances in menstruation and the duration (in years) of such disturbances.
To test our hypothesis that the biological age at which the playing career was started was important for the development of the side-to-side difference in bone mass, we divided the players into six groups according to the starting age of playing relative to the age at menarche: more than 5 years before menarche, 3 to 5 years before menarche, 2 to 0 years before menarche, 1 to 5 years after menarche, 6 to 15 years after menarche, and more than 15 years after menarche. This division was based on the general knowledge of the pubertal and growth development of healthy Finnish and other white girls [11-16]: Puberty, once begun, is generally complete within 3 years; growth spurts and accelerated natural bone accumulation begin at the onset of Tanner stage 2, reach a peak at stages 3 to 4, and end at stage 5; menarche usually occurs during stage 4; and the longitudinal growth and natural bone accumulation rates markedly decrease soon after menarche, so that increases are only minimal in Tanner stage 5. Thus, the women in the six groups could be named as players who had started their playing careers at childhood [mean starting age, 7.4 ±1.4] years) prepuberty (10.1 ±1.2 years), puberty (12.0 ±1.4 years), postpuberty (15.2 ±2.4 years), early adulthood (24.0 ±3.0 years), and adulthood (33.7 ±3.8 years).
Anthropometric Measurements
We measured the height and weight of each participant. Using a measuring tape, we determined the circumference of upper extremities. We measured upper arm circumference just below the lateral part of the triceps brachii muscle and measured forearm circumference at the middle of the medial epicondyle of the humerus and the styloid process of the ulna.
Strength Measurements
We determined the maximal isometric strength of upper extremities using an arm flexion-extension dynamometer (Digitest, Inc., Muurame, Finland). We measured grip strength using a standard grip strength meter.
Bone Mineral Measurements
Using a Norland XR-26 DXA scanner (Norland, Inc., Fort Atkinson, Wisconsin), a technician determined bone mineral content (expressed in grams) from four sites in the upper extremity (proximal humerus, humeral shaft, radial shaft, and distal radius) and from the right calcaneus. The same experienced laboratory technician did all measurements. Her day-to-day coefficient of variation for repeated bone mineral content measurements of the same participants was low, ranging from 0.5% to 1.2% depending on the site measured [17, 18].
Statistical Analyses
We made intra-individual side-to-side comparisons using the matched, paired t-test. We used the Student nonpaired t-test to compare the continuous-type background variables, arm and calcaneus bone mineral content, and percentage of side-to-side differences among the players and controls. To compare the noncontinuous background variables of players and controls, we used the chi-square or Fisher exact test.
We tested the players' side-to-side bone mineral content differences across the six groups of players using analysis of variance, analysis of covariance, and a test for linear trend for adjusted group means. According to the previously noted hypothesis that puberty is critical in natural bone accumulation and that menarche is the first sign of cessation of bone development, the analysis of covariance was designed to include 5 (6 1) orthogonal or pairwise uncorrelated contrasts: 1) starting playing no later than at menarche (the first three groups) compared with starting thereafter (the remaining three groups); 2) starting no later than 3 years before menarche (the first two groups) compared with starting at menarche (the third group); 3) starting more than 5 years before menarche (the first group) compared with starting 3 to 5 years before menarche (the second group); 4) starting 1 to 5 years after menarche (the fourth group) compared with starting thereafter (the remaining two groups); and 5) starting 6 to 15 years after menarche (the fifth group) compared with starting more than 15 years after menarche (the sixth group).
In the analysis of covariance, we considered age, height, weight, body mass index, age at menarche, years of training, average number of training sessions per week, average duration of the training sessions, total training time (years of training times the average number of training sessions each week x the average duration of the training sessions), daily calcium intake, and the relative strength variables (elbow flexion, elbow extension, and grip) as potential confounders. Previous or present menstrual disturbances, smoking, use of alcohol, and special diets, all of which are potential confounders, were so uncommon among the players (Table 1) that these variables did not confound the results. ARTICLE
Effect of Starting Age of Physical Activity on Bone Mass in the Dominant Arm of Tennis and Squash Players
Peak bone mass is an important determinant of bone mass later in life, and an increase in peak bone mass should decrease the risk for osteoporotic fractures [1-3]. Therefore, exact identification of the determinants of peak bone mass could help clinicians devise strategies to prevent fractures.
Methods
![]()
Top
Methods
Results
Discussion
Author & Article Info
References
Participants
|
Our results are expressed as the mean ±SD. The 95% CIs are presented when appropriate. The given significance levels refer to two-tailed tests. We considered a P value less than 0.05 to be significant.
Results
|
|---|
|
|
|---|
No significant differences were seen between the background characteristics of the players and those of the control participants (Table 1). The dominant-to-nondominant side difference in upper arm and forearm circumference and muscle strength was significantly greater in players than in controls (Table 2). Compared with that of control participants, the dominant-to-nondominant side difference in bone mineral content was significantly greater in players in every measured site (players, 8.5% to 16.2%; controls, 3.2% to 4.6%) (Table 2). The difference was especially clear in the humerus.
|
When we compared the dominant arm bone mineral contents of the players and controls, the players' values were significantly greater in every measured site except the radial shaft (8.2% to 10.3%) (Table 2). The bone mineral content of the right calcaneus was also significantly greater in players (10.6%) than in controls. In nondominant (unloaded) arms, the differences between players and controls were small and not significant (range, 2.1% to 0.1%).
Players' Bone Results according to the Biological Starting Age of Playing
Correlation analysis showed that only age and height correlated significantly with both the independent or predictive variable (the biological age at which training was started) and dependent or outcome variable (side-to-side difference in bone mineral content); these two variables were therefore used as covariates in the analysis of covariance. This was confirmed by the fact that addition of any of the other potential confounders did not change the results adjusted for age and height.
At each anatomical site, the players' side-to-side bone differences were highly significant across the groups (analysis of variance: P < 0.001 to P = 0.005), the group means clearly decreasing with increasing biological age at which playing was started Table 3 and Figure 1. For example, the difference was two to four times higher in the players who had started their playing careers before or at menarche (average difference, 10.5% to 23.5%) than in those who started more than 15 years after menarche (range, 2.4% to 9.6%). These great differences could also be verified by the fact that the CIs never overlapped among these groups (Figure 1).
|
|
Results of the trend test showed that findings at any site were not changed by adjustment for age and height (Table 3). In the analysis of covariance, this procedure did not alter findings in the proximal humerus or humeral shaft, whereas after this operation the group differences were no more significant for the radial shaft and distal radius (Table 3).
Of the five orthogonal contrasts of the analysis of covariance, the first contrast (players who started their playing careers no later than at menarche compared with those starting after menarche) was significant at every measured site except the distal radius. None of the remaining four contrasts was significant at any site.
Discussion
|
|---|
|
|
|---|
Our study provides evidence that physical activity during the pubescent years is crucial for maximizing bone mass (Table 3). Our findings did not ignore the potential for exercise-induced bone gain in adults but clearly showed that the benefit is about two times greater if women start their playing careers at or before menarche (humeral side-to-side difference, 17% to 24%) than after menarche (8% to 14%) (Figure 1).
Our study had several limitations. First, because our findings were derived from a selective group of healthy women who participated in a sport that strengthened the dominant arm, we cannot generalize the results to the general population. Second, although tennis and squash strokes seemed to cause considerable hypertrophy in the proximal humerus and distal radius, both of which are characteristic sites of osteoporotic fractures, our study did not show what type of activity would be the most beneficial in increasing bone mass in the other characteristic sites of these fractures (such as the spine, hip, knee, and ankle). Third, we do not know whether the additional bone mass in the playing arm is preserved throughout adulthood (with or without exercise). This question requires further follow-up of our players. Finally, an important undetermined issue is the minimum amount of exercise and minimum number of years of playing needed to achieve the observed increases and whether more exercise could further increase bone mass.
Our cross-sectional study suggested that tennis and squash activity started no later than puberty is maximally beneficial for mineralization of the bones of the playing arm, but longitudinal studies are needed.
Author and Article Information
|
|---|
|
|
|---|
References
|
|---|
|
|
|---|
1. Johnston CC Jr, Slemenda CW. Determinants of peak bone mass. Osteoporosis Int. 1993; (3 Suppl):54-5.
2. Hui SL, Slemenda CW, Johnston CC Jr. Baseline measurement of bone mass predicts fracture in white women. Ann Intern Med. 1989; 111:355-61.
3. Cummings SR, Black DM, Nevitt MC, Browner W, Cauley J, Ensrud K, et al. Bone density at various sites for prediction of hip fractures. The Study of Osteoporotic Fractures Research Group. Lancet. 1993; 341:72-5.
4. Ott SM. Bone density in adolescents (Editorial). N Engl J Med. 1991; 325:1646-7.
5. Dalsky GP, Socke KS, Eshani AA, Slatopolsky E, Lee WC, Birge SJ Jr. Weight-bearing exercise training and lumbar bone mineral content in postmenopausal women. Ann Intern Med. 1988; 108:824-8.
6. Kannus P, Haapasalo H, Sievanen H, Oja P, Vuori I. The site-specific effects of long-term unilateral activity on bone mineral density and content. Bone. 1994; 15:279-84.
7. McCulloch RG, Bailey DA, Houston CS, Dodd BL. Effects of physical activity, dietary calcium intake and selected lifestyle factors on bone density in young women. Can Med Assoc J. 1990; 142:221-7.
8. Slemenda CW, Miller JZ, Hui SL, Reister TK, Johnston CC Jr. Role of physical activity in the development of skeletal mass in children. J Bone Miner Res. 1991; 6:1227-33.
9. Conroy BP, Kraemer WJ, Maresh CM, Fleck SJ, Stone MH, Fry AC, et al. Bone mineral density in elite junior Olympic weightlifters. Med Sci Sports Exerc. 1993; 25:1103-9.
10. Grimston SK, Willows ND, Hanley DA. Mechanical loading regime and its relationship to bone mineral density in children. Med Sci Sports Exerc. 1993; 25:1203-10.
11. Theintz G, Buchs B, Rizzoli R, Slosman D, Clavien H, Sizonenko PC, et al. Longitudinal monitoring of bone mass accumulation in healthy adolescents: evidence for a marked reduction after 16 years of age at the levels of lumbar spine and femoral neck in female subjects. J Clin Endocrinol Metab. 1992; 75:1060-5.
12. Kroger H, Kotaniemi A, Kroger L, Alhava E. Development of bone mass and bone density of the spine and femoral necka prospective study of 65 children and adolescents. Bone Miner. 1993; 23:171-82.
13. Matkovic V, Jelic T, Wardlaw GM, Ilich JZ, Goel PK, Wright JK, et al. Timing of peak bone mass in Caucasian females and its implication for the prevention of osteoporosis. Inference from a cross-sectional model. J Clin Invest. 1994; 93:799-808.
14. Lu PW, Briody JN, Ogle GD, Morley K, Humphries IR, Allen J, et al. Bone mineral density of total body, spine, and femoral neck in children and young adults: a cross-sectional and longitudinal study. J Bone Miner Res. 1994; 9:1451-8.
15. Katzman DK, Bachrach LK, Carter DR, Marcus R. Clinical and anthropometric correlates of bone mineral acquisition in healthy adolescent girls. J Clin Endocrinol Metab. 1991; 73:1332-9.
16. Tanner JM. Growth and maturation during adolescence. Nutr Rev. 1981:39:43-55.
17. Sievanen H, Oja P, Vuori I. Precision of dual-energy x-ray absorptiometry in determining bone mineral density and content of various skeletal sites. J Nucl Med. 1992; 33:1137-42.
18. Sievanen H, Kannus P, Oja P, Vuori I. Precision of dual energy x-ray absorptiometry in the upper extremities. Bone Miner. 1993; 20:235-43.
This article has been cited by other articles:
![]() |
K. M. Middleton, S. A. Kelly, and T. Garland Jr Selective breeding as a tool to probe skeletal response to high voluntary locomotor activity in mice Integr. Comp. Biol., June 18, 2008; (2008) icn057v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. P. WARREN and A. T. CHUA Exercise-Induced Amenorrhea and Bone Health in the Adolescent Athlete Ann. N.Y. Acad. Sci., June 1, 2008; 1135(1): 244 - 252. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. M Pluim, J B. Staal, B. L Marks, S. Miller, and D. Miley Health benefits of tennis Br. J. Sports Med., November 1, 2007; 41(11): 760 - 768. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Roth, M. Linge, N. Tzaribachev, R. Schweizer, and J. Kuemmerle-Deschner Musculoskeletal abnormalities in juvenile idiopathic arthritis--a 4-year longitudinal study Rheumatology, July 1, 2007; 46(7): 1180 - 1184. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Nordstrom, M. Neovius, and A. Nordstrom Early and Rapid Bone Mineral Density Loss of the Proximal Femur in Men J. Clin. Endocrinol. Metab., May 1, 2007; 92(5): 1902 - 1908. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Lorentzon, D. Mellstrom, E. Haug, and C. Ohlsson Smoking Is Associated with Lower Bone Mineral Density and Reduced Cortical Thickness in Young Men J. Clin. Endocrinol. Metab., February 1, 2007; 92(2): 497 - 503. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. K. Karlsson, P. Gerdhem, and H. G. Ahlborg The prevention of osteoporotic fractures J Bone Joint Surg Br, October 1, 2005; 87-B(10): 1320 - 1327. [Full Text] [PDF] |
||||
![]() |
H A McKay, L MacLean, M Petit, K MacKelvie-O'Brien, P Janssen, T Beck, and K M Khan "Bounce at the Bell": a novel program of short bouts of exercise improves proximal femur bone mass in early pubertal children Br. J. Sports Med., August 1, 2005; 39(8): 521 - 526. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Eastell Role of oestrogen in the regulation of bone turnover at the menarche J. Endocrinol., May 1, 2005; 185(2): 223 - 234. [Abstract] [Full Text] [PDF] |
||||
![]() |
M K Torstveit, J Sundgot-Borgen, and J D Wark Low bone mineral density is two to three times more prevalent in non-athletic premenopausal women than in elite athletes: a comprehensive controlled study * Commentary Br. J. Sports Med., May 1, 2005; 39(5): 282 - 287. [Abstract] [Full Text] [PDF] |
||||
![]() |
C H Turner and A G Robling Exercises for improving bone strength Br. J. Sports Med., April 1, 2005; 39(4): 188 - 189. [Full Text] [PDF] |
||||
![]() |
J H Davies, B A J Evans, and J W Gregory Bone mass acquisition in healthy children Arch. Dis. Child., April 1, 2005; 90(4): 373 - 378. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Wu, X. X. Wang, M. Higuchi, K. Yamada, and Y. Ishimi High bone mass gained by exercise in growing male mice is increased by subsequent reduced exercise J Appl Physiol, September 1, 2004; 97(3): 806 - 810. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. McVeigh, S. A. Norris, N. Cameron, and J. M. Pettifor Associations between physical activity and bone mass in black and white South African children at age 9 yr J Appl Physiol, September 1, 2004; 97(3): 1006 - 1012. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M. Norvell, S. M. Ponik, D. K. Bowen, R. Gerard, and F. M. Pavalko Fluid shear stress induction of COX-2 protein and prostaglandin release in cultured MC3T3-E1 osteoblasts does not require intact microfilaments or microtubules J Appl Physiol, March 1, 2004; 96(3): 957 - 966. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. R. Taaffe, E. M. Simonsick, M. Visser, S. Volpato, M. C. Nevitt, J. A. Cauley, F. A. Tylavsky, and T. B. Harris Lower Extremity Physical Performance and Hip Bone Mineral Density in Elderly Black and White Men and Women: Cross-Sectional Associations in the Health ABC Study J. Gerontol. A Biol. Sci. Med. Sci., October 1, 2003; 58(10): M934 - 942. [Abstract] [Full Text] [PDF] |
||||
![]() |
M.-C. Wang, P. B Crawford, M. Hudes, M. Van Loan, K. Siemering, and L. K Bachrach Diet in midpuberty and sedentary activity in prepuberty predict peak bone mass Am. J. Clinical Nutrition, February 1, 2003; 77(2): 495 - 503. [Abstract] [Full Text] [PDF] |
||||
![]() |
F. Scopacasa, J.M. Wishart, A.G. Need, M. Horowitz, H.A. Morris, and B.E.C. Nordin Bone Density and Bone-Related Biochemical Variables in Normal Men: A Longitudinal Study J. Gerontol. A Biol. Sci. Med. Sci., June 1, 2002; 57(6): M385 - 391. [Abstract] [Full Text] |
||||
![]() |
C. M Weaver Calcium requirements of physically active people Am. J. Clinical Nutrition, August 1, 2000; 72(2): 579S - 584. [Abstract] [Full Text] [PDF] |
||||
![]() |
K J MacKelvie, J E Taunton, H A McKay, and K M Khan Bone mineral density and serum testosterone in chronically trained, high mileage 40-55 year old male runners Br. J. Sports Med., August 1, 2000; 34(4): 273 - 278. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. J. Anderson The important role of physical activity in skeletal development: how exercise may counter low calcium intake Am. J. Clinical Nutrition, June 1, 2000; 71(6): 1384 - 1386. [Full Text] [PDF] |
||||
![]() |
P. Kannus Preventing osteoporosis, falls, and fractures among elderly people BMJ, January 23, 1999; 318(7178): 205 - 206. [Full Text] |
||||
![]() |
THE EARLIER EXERCISE STARTS, THE BETTER FOR BONE MASS Journal Watch (General), July 7, 1995; 1995(707): 2 - 2. [Full Text] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||