Category: psychometric tools

New Article Published

This paper was the result of a collaboration with the University of South Wales and part of Dr. Brian Cunniffe’s PhD work. A unique study looking elite rugby players in the real world of competitive sport. Just like every study some limitations but a good chance to look at what happens away from the laboratories.

‘Home Vs Away’ Competition: Effect on Psychophysiological Variables in Elite Rugby Union 

Section: Original Investigation
Authors: Brian Cunniffe1,2, Kevin A Morgan3, Julien S Baker, Marco Cardinale1,5, and Bruce Davies 3
Affiliations: 1Institute of Sport Exercise and Health, University College London, UK. 2English Institute of Sport, Bisham Abbey National Sports Centre, Marlow, UK. 3Dept. Sport, Health and Exercise Science, University of South Wales, Pontypridd, Wales, UK. 4Division, Sport and Exercise Science, University of the West of Scotland, Hamilton, Scotland, UK. 5Aspire Academy, Doha, Qatar.
Acceptance Date: April 28, 2015
This study evaluated the effect of game venue and starting status on pre-competitive psychophysiological measures in elite rugby union. Saliva samples were taken from  players (starting XV, n = 15  + non-starters; n = 9) on a control day and 90 min prior to 4 games played consecutively at home and away venues against local rivals (LR) and league-leaders (LL). Pre-competition psychological states were assessed using the Competitive State Anxiety Inventory-2. The squad recorded two wins (home) and two losses (away) over the study period. Calculated effect sizes (ES) showed higher pregame cortisol (C) and testosterone (T) difference values before all games compared to a baseline control day (ES: 0.7 to 1.5). Similar findings were observed for cognitive and somatic anxiety. Small between venue C differences were observed in starting XV players (ES: 0.2 to 0.25). Conversely, lower ‘home’ T (ES: 0.95) and higher ‘away’ C (ES: 0.6) difference values were observed in non-starters. Lower T difference values were apparent in non-starters (vs. starting XV) before ‘home’ games providing evidence of a between group effect (ES: 0.92). Findings show an anticipatory rise in psychophysiological variables prior to competition. Knowledge of starting-status appears a moderating factor in the magnitude of player endocrine response between home and away game venues.
Keywords: Home advantage; hormones; psychophysiological; cortisol; testosterone; rugby.

Monitoring training load: Quo vadis? #3

The first two posts dealt with inexpensive and more expensive methods. I will now discuss the use of psychometric tools to get another dimension of monitoring training loads. I have not discussed the use of GPS or similar technologies, but will cover this in the next post.

I really want to present some info on various tools currently used and discuss pros and cons of them.

Profile of Mood States (POMS)

The Profile of Mood States (POMS) is a psychological rating scale used to assess transient, distinct mood states. The original scale, developed by McNair et al, has 65 items describing feelings people have.  There is a brief version,  comprising 11 of the original POMS items, developed by Cella et al, in 1987.  However, this version (Brief POMS) provides only one score for overall psychological distress.  There is yet another version called the short form of the Profile of Mood States (POMS-SF) developed by Shacham in 1983.  The short form version contains 37 items, selected from the original POMS.  It retains the six subscale information provided by POMS. The POM–Bipolar is the newest addition to the POMS. It measures moods and feelings primarily in clinical rather than nonclinical settings. It can help to determine an individual’s psychiatric status for therapy, or be used to compare mood profiles associated with various personality disorders. In nonclinical settings, the POMS–Bipolar can assess mood changes produced by techniques such as psychotherapy or meditation.

Here it is possible to download a POMS scale.

This scale has been used in a variety of populations with more than 2000 studies being performed using it. However there is a paucity of data on athletes and its links to other measures of overtraining and overreaching.

The POMS assessments are self-report inventories in which respondents rate a series of mood states (such as "Untroubled" or "Sorry for things done") based on how well each item describes the respondent’s mood during one of three time frames (i.e., during the past week, including today; right now; other). Normative data are based on the "during the past week, including today" time frame. The POMS Standard form contains 65 items and takes approximately 10 minutes to complete. The respondent rates each item on a 5-point scale ranging from “Not at all” to “Extremely”. The POMS Brief form, which is ideal for use with patients for whom ordinary tasks can be difficult and time-consuming, uses the same scale as the POMS Standard form, but contains only 30 items. It takes only 5 minutes to complete. Both the POMS Standard and POMS

Brief assessments measure six identified mood factors:

• Tension-Anxiety
• Depression-Dejection
• Anger-Hostility
• Vigor-Activity
• Fatigue-Inertia
• Confusion-Bewilderment

The POMS-Bi form contains 72 items and uses a 4-point scale. It takes approximately 10 minutes to complete. Responses for the POMS-Bi range from “Much unlike this” to “Much like this”. Unlike the other POMS assessments, the POMS-Bi measures both positive and negative affects. For each of the six bipolar scales, one pole represents the positive aspects of the dimension while the other pole refers to the negative aspects:

• Composed-Anxious
• Agreeable-Hostile
• Elated-Depressed
• Confident-Unsure
• Energetic-Tired
• Clearheaded-Confused

Since 1971, numerous research studies have provided evidence for the predictive and construct validity of the POMS Standard and POMS Brief assessments. Alpha coefficient and other studies have found the POMS Standard and POMS Brief to exhibit a highly satisfactory level of internal consistency, while product moment correlations indicate a reasonable level of test-retest reliability. Factor analytic replications provide evidence of the factorial validity of the 6 mood factors, and an examination of the individual items defining each mood state supporting the content validity of the factor scores. Studies have also supported the bipolar nature of moods measured by the POMS-Bi assessment, and reliability studies have shown that POMS-Bi items demonstrate sufficient internal consistency.

One of the first encouraging studies by O’Connor et al. (1989) examined POMS scores and resting salivary cortisol levels in 14 female college swimmers during progressive increases and decreases in training volume, and were compared to the same measures in eight active college women who served as controls. Training volume increased from 2,000 yards/day in September (baseline) to a peak of 12,000 yards/day in January (overtraining), followed by a reduction in training (taper) to 4,500 yards/day by February. The swimmers experienced significant alterations in tension, depression, anger, vigor, fatigue and global mood across the training season compared to the controls. Salivary cortisol was significantly greater in the swimmers compared to the controls during baseline and overtraining, but was not different between the groups following the taper. Salivary cortisol was significantly correlated with depressed mood during overtraining (r = .50) but not at baseline or taper. Global mood, depression, and salivary cortisol were significantly higher during the overtraining phase in those swimmers classified as stale, compared to those swimmers who did not exhibit large performance decrements.

This was one of the initial studies suggesting a link between increasing training workloads, POMS scores and cortisol responses advocating the possibility of using this psychometric tool to understand how athletes were coping with training loads.

Urhausen et al. (1998) found that the parameters of mood state at rest as well as the subjective rating of perceived exertion during exercise were significantly impaired during overtraining in a follow up study with endurance athletes.

Filaire et al. (2001) used POMS together with endocrine markers to study soccer players and found that in such group decreased testosterone to cortisol ratio does not automatically lead to a decrease in team performance or a state of team overtraining. However, they suggested that combined psychological and physiological changes during high-intensity training are primarily of interest when monitoring training stress in relation to performance.

It seems therefore clear that POMS has the potential to be used to assess how athletes cope with training loads and POMS score can potentially have a link with hormonal  imbalances.

REST Q Questionnaire

The Recovery-Stress Questionnaire for Athletes [RESTQ-Sport] is a questionnaire reported to identify the extent to which athletes are physically or mentally stressed and their current perception of recovery (Kellmann & Kallus, 2000 and Kellmann & Kallus 2001). It has been used by many individuals and organizations throughout the world and can therefore be reasonably estimated to have been used on at least several thousand high-performance athletes as a diagnostic tool to detect under-recovery states and to plan recovery practices. The predecessor of this psychometric tool was a General Recovery-Stress Questionnaire (Kallus, 1995) formulated on the idea that people will respond differently to physiological and psychological demands depending on how well-rested they are when faced with these demands.

The RESTQ-Sport was constructed based on the notion that an athlete well recovered may perform better than one who is under-recovered. However, theoretical and practical concerns governed the methods used to determine the 19 subscales of the RESTQ-Sport (Kellmann & Kallus, 2000 and Kellmann & Kallus, 2001) used an a priori method of identifying each of the subscales, combining to form several scales that reflect various aspects of stress and recovery. The RESTQ-Sport was developed through research in the area of stress for the General Scale, and the Sport Scale was comprised of items observed to coincide with stress or recovery states in athletes (Kellmann & Kallus, 2001).

The test consists of 7 stress scales, and 5 recovery scales.

The scales are:

General stress
Emotional stress
Social stress
Lack of energy
Physical complaints
Social recovery
Physical recovery
General well-being
Sleep quality
Disturbed breaks
Burnout/emotional exhaustion
Fitness/being in shape
Burnout/personal accomplishment

If you are interested in knowing more about this test and have a software to score the results, I strongly suggest you buy Dr. Kellmann’s and Kallus’ book at Human Kinetics. The book also contains a software to score the questionnaire and provide you with a graph.

The graph normally looks like this one presented by James Marshall in his blog:

Figure 1

However, you can develop your own spreadsheet to score it and graph it as I did.


Many studies have shown how valid and reliable this test is. However one of the most interesting ones was published by Jurimae et al. (2004). They studied the effects of increasing training loads in competitive rowers and found significant relationships between training volume and Fatigue scores (r=0.49), Somatic Complaints (r=0.50} and Sleep Quality (r=-0.58) at the end of heavy training. In addition, significant relationships were also observed between cortisol and Fatigue scores (r=0.48) at the end of heavy training as well as between changes in cortisol and changes in Fatigue (r=0.57) and Social Stress (r=0.51).

It should be pointed out that this test cannot be performed every day as it asks the athlete about how often the respondent participated in various activities during the preceding three days/nights. A Likert-type scale is used with values ranging from 0 (never) to 6 (always) to rank the frequency of activities/experiences of the preceding 3 days/nights.

BORG scale and perception of effort

The concept of perceived exertion was introduced half a century ago and an operational definition presented with methods to measure different aspects of perceived effort, strain and fatigue. One very common method is the RPE-Scale for "Ratings of Perceived Exertion" ("the Borg Scale") officially known now as the "Borg RPE Scale®".

As Professor Borg explains: “Stevens’ "Ratio (R) scaling methods for determinations of S-R-functions have been improved in order not only to obtain relative functions but also direct ("absolute") levels of intensity. This was done by placing verbal anchors, from simple category (C) scales (rank order scales) such as "very weak", "moderate", "strong" etc at the best possible position on a ratio scale, a "CR-scale", covering the total subjective dynamic range, so that a congruence in meaning was obtained between the numbers and the anchors”.

If you are really interested in this you should read Dr. Elisabet Borg’s thesis here where she presents the innovative approach to develop the "Borg CR100 Scale®" (also called the "centiMax Scale"). I had the pleasure to listen to her lecture last year in Italy and I was impressed by the quality of work she has done to follow up her father’s intuitions on the original rate of perceived exertion.

You can read more about Dr. Elisabet Borg here and about Professor Gunnar Borg here.

Recommendations to use a "Borg Scale" is given by many professional societies, e.g. American Heart Association, American Thoracic Society, American College of Sports Medicine, British Association for Cardiac Rehabilitation

These scales can be obtained from the firm: "Borg Perception", Gunnar Borg, Rädisvägen 124, 165 73 Hässelby, Sweden. Phone 46-8-271426.

Other alternatives

There are various tools out there these days such as the following ones:

  • Life Stress (LESCA)
  • State trait anxiety inventory (STAI)
  • Athletic coping skills inventory (ACSI)

however I have no experience in using them…maybe some of you readers know more and what to write comments about any of them?

Enough info now for psychometric tools…next post will cover aspects connected to strength, power and speed.