| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Rheumatology 2001; 40: 1331-1336
© 2001 British Society for Rheumatology
Review |
Therapeutic ultrasound in soft tissue lesions
Rheumatology Unit, Addenbrooke's Hospital, Hills Road, Cambridge CB2 2QQ, UK
| Abstract |
|---|
Therapeutic ultrasound is one of the most common treatments used in the management of soft tissue lesions, which constitute the majority of rheumatic complaints. Although many laboratory-based research studies have demonstrated a number of physiological effects of ultrasound upon living tissue, there is remarkably little evidence for benefit in the treatment of soft tissue injuries. This may be related to several confounding factors, including technical variables, the complexity and variety of underlying pathologies in soft tissue lesions, methodological limitations of clinical studies, or true lack of effect. In this review the scientific basis for the use of therapeutic ultrasound in soft tissue lesions and the existing evidence relating to its clinical effect are detailed.
KEY WORDS: Ultrasound, Evidence, Therapeutic, Soft tissue, Tendon, Healing.
| Introduction |
|---|
It is over 70 years since the interactions between high (ultra)-frequency sound waves and living tissue were initially studied and the use of such energy as a form of therapy was first suggested [1]. Ultrasound has since been used to treat a wide variety of disorders, from skin wounds to malignant tumours [2, 3]. It has become one of the most commonly used treatments in the management of soft tissue injuries, and it has been estimated that over a million NHS treatments annually involve its use [4]. However, although many laboratory-based research studies have demonstrated a number of physiological effects of ultrasound upon living tissue [516], there is remarkable little evidence for benefit in the treatment of soft tissue injuries [1720]. In this paper, the scientific basis for the use of therapeutic ultrasound in soft tissue lesions and the existing evidence relating to its clinical effect are reviewed.
| Characteristics of therapeutic ultrasound |
|---|
Ultrasound consists of inaudible high-frequency mechanical vibrations created when a generator produces electrical energy that is converted to acoustic energy through mechanical deformation of a piezoelectric crystal located within the transducer. The waves produced are transmitted by propagation through molecular collision and vibration, with a progressive loss of the intensity of the energy during passage through the tissue (attenuation), due to absorption, dispersion or scattering of the wave [21].
The total amount of energy in an ultrasound beam is its power, expressed in watts. The amount of energy that reaches a specific site is dependent upon characteristics of the ultrasound (frequency, intensity, amplitude, focus and beam uniformity) and the tissues through which it travels. Important terminology with respect to the characteristics of ultrasound and variables that may affect the dose delivered are given in Tables 1
and 2
.
|
|
Therapeutic ultrasound has a frequency range of 0.753 MHz, with most machines set at a frequency of 1 or 3 MHz. Low-frequency ultrasound waves have greater depth of penetration but are less focused. Ultrasound at a frequency of 1 MHz is absorbed primarily by tissues at a depth of 35 cm [22] and is therefore recommended for deeper injuries and in patients with more subcutaneous fat. A frequency of 3 MHz is recommended for more superficial lesions at depths of l2 cm [22, 23].
Tissues can be characterized by their acoustic impedance, the product of their density and the speed at which ultrasound will travel through it. Low absorption (and therefore high penetration) of ultrasound waves is seen in tissues that are high in water content (e.g. fat), whereas absorption is higher in tissues rich in protein (e.g. skeletal muscle) [24]. The larger the difference in acoustic impedance between different tissues, the less the transmission from one to the other [25]. When reflected ultrasound meets further waves being transmitted, a standing wave (hot spot) may be created, which has potential adverse effects upon tissue [26]. Such effects can be minimized by ensuring that the apparatus delivers a uniform wave, using pulsed waves (see below), and moving the transducer during treatment [24].
The larger the diameter of the effective radiating area of the transducer face, the more focused the beam of ultrasound produced. Within this beam, energy is distributed unevenly, the greatest non-uniformity occurring close to the transducer surface (near zone). The variability of the beam intensity is termed the beam non-uniformity ratio (BNR), the ratio of the maximal intensity of the transducer to the average intensity across the transducer face. This should optimally be 1:1 and certainly less than 8:l [27].
Coupling media, in the form of water, oils and most commonly gels, prevent reflection of the waves away at the soft tissue/air interface by excluding air from between the transducer and patient. Different media have different impedances. Any coupling medium should have an acoustic impedance similar to that of the transducer, should absorb little of the ultrasound, remain free of air bubbles and allow easy movement of the transducer over the skin surface [28].
Ultrasound dosage can also be varied by alteration of wave amplitude and intensity [the rate at which it is being delivered per unit area of the transducer surface (watts/cm2)]. Machines differ with respect to the definition chosen for their intensity setting (Table 1
). In addition, therapeutic ultrasound can be pulsed or continuous. The former has on/off cycles, each component of which can be varied to alter the dose. Continuous ultrasound has a greater heating effect but either form at low intensity will produce non-thermal effects.
| Modified forms of ultrasound |
|---|
Modified forms of ultrasound include phonophoresis and extracorporeal shock wave therapy (ESWT). Phonophoresis involves the use of ultrasound energy for the transdermal delivery of low molecular weight drugs [29]. ESWT involves high-energy, focused ultrasound energy delivered using a modified lithotripter [30]. These techniques will not be considered further in this review.
| The physiological effects of ultrasound |
|---|
Ultrasound may induce thermal and non-thermal physical effects in tissues (Table 3
|
It has been suggested that the non-thermal effects of ultrasound, including cavitation and acoustic microstreaming, are more important in the treatment of soft tissue lesions than are thermal effects [32]. Cavitation occurs when gas-filled bubbles expand and compress because of ultrasonically induced pressure changes in tissue fluids, with a resulting increase in flow in the surrounding fluid [33]. Stable (regular) cavitation is considered to be beneficial to injured tissue, whereas unstable (transient) cavitation is considered to cause tissue damage [34]. The former can be sustained at lower intensities than are required for unstable cavitation and can be suppressed by the use of very short pulses. At least 1000 cycles at 1 MHz are required to establish stable cavitation [34]. Acoustic microstreaming, the unidirectional movement of fluids along cell membranes, occurs as a result of the mechanical pressure changes within the ultrasound field. Microstreaming may alter cell membrane structure, function and permeability [25], which has been suggested to stimulate tissue repair [32]. Effects of cavitation and microstreaming that have been demonstrated in vitro include stimulation of fibroblast repair and collagen synthesis [58], tissue regeneration [6] and bone healing [9].
Most of our knowledge of the effects of ultrasound on living tissue has been gained through in vitro studies and animal models, and much of this research has focused in particular upon skin wounds and ulcers. It has been suggested that ultrasound interacts with one or more components of inflammation, and earlier resolution of inflammation [2], accelerated fibrinolysis [10, 11], stimulation of macrophage-derived fibroblast mitogenic factors [12], heightened fibroblast recruitment [2], accelerated angiogenesis [13], increased matrix synthesis [7], more dense collagen fibrils [14] and increased tissue tensile strength [8, 15, 16] have all been demonstrated in vitro. Such findings form the basis for the use of ultrasound to promote and accelerate tissue healing and repair. Although these findings are relevant to wound healing, their relevance to tendinopathies, which represent a significant proportion of soft tissue injuries, is unclear. The histopathological spectrum of tendinopathies is wide and varies from inflammatory lesions of the tenosynovium to degenerative tendinoses in the absence of an overt inflammatory response [34]. The degenerative process is poorly understood, but is considered to represent a failure of the internal tendon cells to repair and remodel the extracellular matrix after injury [35, 36]. Extensive studies of normal and degenerate human tendons have shown striking variations in matrix composition [3538], alteration of collagen fibre type distribution, with a relative increase in type III collagen over type I collagen, and, in some tendon lesions, fibrovascular proliferation and the focal expression of type II collagen, representative of fibrocartilaginous change. After injury, an increase in matrix turnover is necessary to remove damaged matrix and to remodel scar tissue. The effects of ultrasound upon these processes, which are themselves poorly understood, are not yet known.
Alternatively, ultrasound may be used for its thermal effects in order to relieve pain and muscle spasm to increase tissue extensibility, which may be of use in combination with stretching exercises to achieve optimal tissue length [39]. Lengthening with thermal doses of ultrasound has been demonstrated in the ligament of normal knees [40] and in scar tissue [41]. Once the tissue has been heated to an adequate level (considered to be 4045°C [34]), the opportunity to stretch the tissues lasts for up to 10 min before the tissue cools [42].
Research on the use of ultrasound specifically in tendon healing is minimal and relates only to animals, with conflicting findings. Increases in tensile strength, energy absorption, mobility, improved collagen fibril alignment, reduction in inflammatory infiltrate and scar tissue in tendons has been demonstrated in some studies [43, 44] but not others [4546]. These studies varied significantly with respect to the regimes used.
Caution must be exercised in extrapolating these results to human tendon lesions, as differences exist between species in the types of collagen in tendon.
| Ultrasound in soft tissue lesions: the evidence for clinical effect |
|---|
Ultrasound is commonly used in the treatment of most soft tissue complaints, particularly lesions of tendon, ligament and bursa. Clinical studies of ultrasound in soft tissue injuries are limited by appropriate outcome measures (pain, swelling and function) and do not have the advantage of wound-healing studies, which can evaluate the lesion more closely by wound tracing.
Gam and Johanssen reviewed 293 papers published between 1953 and 1993 to evaluate the evidence of effect of ultrasound in the treatment of musculoskeletal pain [17]. Twenty-two trials were found which compared ultrasound treatment with sham ultrasound, non-ultrasound treatment or no treatment. These trials assessed a variety of disorders, including lateral epicondylitis (four studies), periarthrosis humeroscapularis (two studies), shoulder bursitis (three studies), tendinitis of the shoulder and elbow (one study), ankle distorsion (sprain) (two studies), and other disorders such as osteoarthritis of the knee (three studies), low back pain (two studies), myofascial pain (one study), traumatized perineum (two studies) and breast pain after delivery (one study). These studies were evaluated with respect to a list of predefined criteria and were found to be lacking with respect to description of drop-outs, randomization methods, the apparatus used, mode of delivery, the size of the sound head, the size of the site treated and follow-up time. In 16 of these trials, ultrasound treatments were compared with sham ultrasound and in 13 cases data were presented in a way that made pooling possible. Two standardized effect sizes were applied to the results to enable evaluation of the effect of ultrasound treatment on pain. No evidence was found for pain relief with ultrasound treatment.
Since the review of Gam and Johanssen [17], further papers have been published on the subject of ultrasound treatment upon soft tissue lesions, but few have added any support to the use of ultrasound. In a review of 400 randomized trials of the use of physiotherapy in a variety of musculoskeletal disorders, Beckerman et al. identified 16 trials involving ultrasound [18]. Low methodological quality was noted in most studies, with a median methodological score of 41 (range 1770) out of a maximum score of 100. The authors concluded that there was no evidence to suggest that the treatment was effective, and although they indicated that there may be some evidence to support its use in elbow disorders, they did not give further details.
Two systematic reviews found ultrasound to be ineffective in the management of pain in the shoulder [19, 20], one of the most common sites for soft tissue pain. In a systematic review of interventions in shoulder disorders, Van der Heijden et al. identified six trials of ultrasound [20]. However, because of insufficient blinding, dissimilar groups at baseline, inadequate sample sizes, varied outcome measures, withdrawal from treatment and inadequate follow-up, only three trials were considered to be of adequate methodological quality to be included for review. One of the three trials included subjects with rotator cuff lesions [47], one included those with subacromial bursitis (which usually occurs in the presence of a rotator cuff lesion) [48] and one included all subjects with shoulder pain [49]. It was concluded that therapeutic ultrasound is ineffective in the treatment of shoulder disorders.
| Ultrasound and the stage of injury |
|---|
There has been some suggestion that ultrasound may be of particular use in the early stages after injury, whereas many studies have evaluated more chronic lesions (or those of unspecified duration). This has been addressed in part by the use of delayed onset muscle soreness (DOMS) as a clinical model of acute inflammation. Again, conflicting results are reported. A reduction in pain and tenderness and increased muscle strength in DOMS has been reported [50], but this has not been confirmed by other workers [51]. There is evidence that thermal doses of ultrasound in DOMS can aggravate pain and stiffness [52].
| Explaining the apparent lack of effect |
|---|
It is apparent that, although ultrasound is used extensively in soft tissue injuries and there are rational theories for its use, sound evidence for its effectiveness in such conditions is lacking. While in vitro studies of ultrasound have demonstrated numerous effects, these have failed to translate into in vivo success. The absence of evidence for benefit for ultrasound in soft tissue lesions may be due to a true lack of effect, but poor study design or technical factors may play a role [53]. As has been outlined, there are many technical variables in the delivery of ultrasound treatment that may act as a source of error in such studies (Table 4
|
Inadequate calibration of machines has also been noted [54]. Pye and Milford evaluated 85 ultrasound therapy machines in use in Lothian Region, Scotland for performance and calibration [54]. Of the machines tested, 69% had power outputs that differed by more than 30% from the expected values. Therapy machines more than 1012 yr old and modern dual-frequency treatment heads performed particularly badly.
The design of clinical studies also may be at fault. Significant heterogeneity of study populations, with the inclusion of a variety of disorders presenting with shoulder pain, prevents a clear conclusion being made with respect to ultrasound and rotator cuff tendinopathies. It is possible that ultrasound is effective only in the earlier stages after tissue injury and there is a need for studies which specifically define not only the lesion being evaluated, but also its chronicity.
The non-inflammatory, degenerative nature of many soft tissue lesions, in particular those affecting the tendon, and the presence of more complex underlying pathologies may also contribute to the apparent lack of effect of ultrasound. Even if ultrasound is truly therapeutic, it is inappropriate to use it as the sole approach to the management of soft tissue lesions. Unfortunately, this situation is not uncommon, other important aspects of rehabilitation frequently being neglected in favour of the use of a machine. Failure to address other causative factors in the aetiology of the lesion and its chronicity may also lead to apparent ineffectiveness of ultrasound as a therapy. Other factors, such as an individual's body composition, which will affect the extent of transmission of the ultrasound waves, are more difficult to control.
| Conclusions: the future |
|---|
In view of the scientific rationales for the use of ultrasound in soft tissue lesions, it would be premature to abandon the use of ultrasound because of the current lack of clinical evidence for effect. Studies must include ultrasound units that are calibrated regularly and other variables, such as coupling media and transducer surface area, must be described clearly. Reliable methods of measurement for characterizing the output and performance of ultrasound physiotherapy equipment have been developed and can be used to ensure the delivery of a standard dosage of ultrasound therapy. Adequate randomized double-blind placebo-controlled clinical studies are required of the use of ultrasound therapy at specific doses in specific, closely defined soft tissue lesions.
| References |
|---|
- Wood RW, Loomis AL. The physical and biological effects of high frequency sound waves of great intensity. London, Edinburgh, Dublin Philosophical Magazine J Sci1927;4:41736.
- Young SR, Dyson M. Effect of therapeutic ultrasound on the healing of full-thickness excised skin lesions. Ultrasonics1990;28:17580.[ISI][Medline]
- Quan KM, Shiran M, Watmough DJ. Applicators for generating ultrasound-induced hyperthermia in neoplastic tumours and for use in ultrasound physiotherapy. Phys Med Biol1989;34:171931.[Medline]
- ter Haar G, Dyson M, Oakley EM. The use of ultrasound by physiotherapists in Britain. Ultrasound Med Biol1985;13:65963.
- Webster DF, Harvey W, Dyson M, Pond JB. The role of ultrasound-induced cavitation in the in vitro stimulation of collagen synthesis in human fibroblasts. Ultrasonics1980;18:337.[ISI][Medline]
- Dyson M, Luke DA. Induction of mast cell degranulation in skin by ultrasound. IEEE Trans Ultrasonics Ferroelectrics Frequency Control1986;UFFC-33:194.[Medline]
- Webster DF. The effect of ultrasound on wound healing. PhD thesis. London: University of London, 1980.
- Byl NN, McKenzie AL, West JM et al. Low dose ultrasound effect on wound healing: a controlled study with Yucatan pigs. Arch Phys Med Rehab1992;73:65664.[ISI][Medline]
- Pilla AA, Figueiredo M, Nasser P et al. Non-invasive low intensity pulsed ultrasound: a potent accelerator of bone repair. Proceedings, 36th Annual Meeting, Orthopaedics Research Society, New Orleans, 1990.
- Harpaz D, Chen X, Francis CW et al. Ultrasound enhancement of thrombolysis and reperfusion in vitro. J Am Coll Cardiol1993;2:150711.
- Francis CW, Onundarson PT, Cartensen EL et al. Enhancement of fibrinolysis by ultrasound. J Clin Invest1992;90:20638.
- Young SR, Dyson M. Macrophage responsiveness to therapeutic ultrasound. Ultrasound Med Biol1990;16:80916.[ISI][Medline]
- Young SR, Dyson M. The effect of therapeutic ultrasound on angiogenesis. Ultrasound Med Biol1990;16:2619.[ISI][Medline]
- Friedar S. A pilot study: the therapeutic effect of ultrasound following partial rupture of Achilles tendons in male rats. J Orthop Sports Phys Ther1988;10:39.
- Byl NN, McKenzie AL, Wong T et al. Incisional wound healing: a controlled study of low and high dose ultrasound. J Orth Sports Phys Ther1993;18:61928.
- Pocock BJZ. The effect of therapeutic ultrasound on the mechanical properties of surgical incisions in Wistar rats. BSc thesis. London: University of London, 1994.
- Gam AN, Johannsen F. Ultrasound therapy in musculoskeletal disorders: a meta-analysis. Pair1995;63:8591.
- Beckerman H, Bouter LM, van der Heijden GJ, de Bie RA, Koes BW. Efficacy of physiotherapy for musculoskeletal disorders: what can we learn from research? Br J Gen Pract1993;43:737.[ISI][Medline]
-
Green S, Buchbinder R, Glazier R, Forbes A. Systematic review of randomised controlled trials of interventions for painful shoulder: selection criteria, outcome assessment and efficacy. Br Med J1998;316:35460.
[Abstract/Free Full Text] -
Van der Heijden GJMG, van der Windt DAWM, de Winter AF. Physiotherapy for patients with shoulder disorders: a systematic review of randomised controlled clinical trials. Br Med J1997;315:2530.
[Abstract/Free Full Text] - ter Haar C. Basic physics of therapeutic ultrasound. Physiotherapy1987;73:1103.
- Gann N. Ultrasound: current concepts. Clin Manage1991;11:649.
- Ziskin M, McDiarmid T, Michlovitz S. Therapeutic ultrasound. In: Michlovitz S, ed. Thermal agents in rehabilitation. Philadelphia: F. A. Davis, 1990.
- Dyson M. Mechanisms involved in therapeutic ultrasound. Physiotherapy1987;73:11620.
- Williams AR. Production and transmission of ultrasound. Physiotherapy1987;73:1136.
- Ziskin M, McDiarmid T, Michlovitz S. Therapeutic ultrasound. In: Michlovitz S, ed. Thermal agents in rehabilitation. Philadelphia: F. A. Davis, 1990.
- Hekkenberg RT, Reibold R, Zeqiri B. Development of standard measurement methods for essential properties of ultrasound therapy equipment. Ultrasound Med Biol1994;20:8398.[ISI][Medline]
- McDiarmid T, Burns PN. Clinical applications of therapeutic ultrasound. Physiotherapy1987;73:155.
- Kanikkannan N, Kandimalla K, Lamba SS, Singh M. Structureactivity relationship of chemical penetration enhancers in transdermal drug delivery. Curr Med Chem2000;7:593608.[ISI][Medline]
- Loew M, Daecke W, Kusnierczak D, Rahmanzadeh M, Ewerbeck V. Shock-wave therapy is effective for chronic calcifying tendinitis of the shoulder. J Bone Joint Surg Br1999;81:8637.
- Prentice WE. Therapeutic modalities in sports medicine, 3rd edition. St Louis: Mosby, 1994.
- Dyson M, Suckling J. Stimulation of tissue repair by ultrasound: a survey of the mechanisms involved. Physiotherapy1978;64:1058.[Medline]
- Josza L, Kannus P. Human tendons. Anatomy, physiology and pathology. Champaign, IL, 1997.
- Wells PNT. Biomedical ultrasonics. London: Academic Press, 1977.
-
Riley GP, Harrall RL, Constant CR et al. Tendon degeneration and chronic shoulder pain: changes in the collagen composition of the human rotator cuff tendons in rotator cuff tendinitis. Ann Rheum Dis1994;53:35966.
[Abstract/Free Full Text] - Riley GP. Ageing and pathology of the rotator cuff. In: Archer C, Benjamin M, Caterson B, Ralphs J, eds. The biology of the synovial joint. Harwood Academic Publishers, 1999.
- Riley GP, Harrall RL, Cawston TE et al. Tenascin C and human tendon degeneration. Am J Pathol1996;149:93343.[Abstract]
-
Riley GP, Harrall RL, Constant CR et al. The prevalence and possible pathological significance of calcium phosphate salt accumulation in tendon matrix degeneration. Ann Rheum Dis1996;55:10915.
[Abstract/Free Full Text] - Reed B, Ashikaga T. The effects of heating with ultrasound on joint replacement. J Orthop Sports Phys Ther1997;26:1317.[ISI][Medline]
- Ellis DG. Cross-sectional area measurement for tendon specimens: a comparison of several methods. J Biomech1969;2:17586.[ISI][Medline]
-
Noyes FR, Torvik PJ, Hyde WB, DeLucas JL. Biomechanics of ligament failure. II. An analysis of immobilisation exercise and reconditioning effects in primates. J Bone Joint Surg Am1974;56:140618.
[Abstract/Free Full Text] - Frankel VH, Nordin M. Basic biomechanics of the skeletal system. Philadelphia: Lea & Febiger, 1980:1520.
- Enwemeka CS. The effects of therapeutic ultrasound on tendon healing. A biomechanical study. Am J Phys Med Rehabil1989;68:2837.[ISI][Medline]
- Gan BS, Huys S, Sherebrin MH, Scilley CG. The effects of ultrasound treatment on flexor tendon healing in the chicken limb. J Hand Surg Br1995;20:80914.[Medline]
- Turner SM, Powell ES, Ng CS. The effect of ultrasound on the healing of repaired cockerel tendon: is collagen cross-linkage a factor? J Hand Surg Br1989;14:42833.[Medline]
- Roberts M, Rutherford JH, Harris D. The effect of ultrasound on flexor tendon repairs in the rabbit. Hand1982;14:1720.[ISI][Medline]
- Berry H, Fernandes L, Bloom B et al. Clinical study comparing acupuncture, physiotherapy, injection and oral anti-inflammatory therapy in shoulder cuff lesions. Curr Med Res Opin1980;7:1216.[ISI][Medline]
- Downing DS, Weinstein A. Ultrasound therapy of subacromial bursitis. A double blind trial. Phys Ther1986;66:1949.
- Nykanen M. Pulsed ultrasound treatment of the shoulder. A randomised, double blind, placebo controlled trial. Scand J Rehabil Med1995;27:1058.[ISI][Medline]
- Hasson S, Mundorf R, Barnes W, Williams J, Fujii M. Effect of pulsed ultrasound versus placebo on muscle soreness perception and muscular performance. Scand J Rehabil Med1990;22:199205.[ISI][Medline]
- Craig JA, Bradley J, Walsh DM, Baxter GD, Allen JM. Delayed onset muscle soreness: lack of effect of therapeutic ultrasound in humans. Arch Phys Med Rehabil1999;80:31823.[ISI][Medline]
-
Ciccone C, Leggin B, Callamaro J. Effects of ultrasound and trolamine salicylate phonophoresis on delayed-onset muscle soreness. Phys Ther1991;71:66678.
[Abstract/Free Full Text] - Clarke GH, Stenner L. The use of therapeutic ultrasound. Physiotherapy1976;62:18590.[Medline]
- Pye SD, Milford C. The performance of ultrasound physiotherapy machines in Lothian region, Scotland, 1992. Ultrasound Med Biol1994;20:34759.
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
V. J Robertson Invited Commentary Physical Therapy, August 1, 2007; 87(8): 995 - 999. [Full Text] [PDF] |
||||
![]() |
R. A Wong, B. Schumann, R. Townsend, and C. A Phelps A Survey of Therapeutic Ultrasound Use by Physical Therapists Who Are Orthopaedic Certified Specialists Physical Therapy, August 1, 2007; 87(8): 986 - 994. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. D. Rees, A. M. Wilson, and R. L. Wolman Current concepts in the management of tendon disorders Rheumatology, May 1, 2006; 45(5): 508 - 521. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||

