Preprints are early versions of research articles that have not been peer reviewed. They should not be regarded as conclusive and should not be reported in news media as established information.
Download file
Download file
Download file
Download file
Download file
5 files

ScholarOne - Investigating Expert-Rater Agreement and Inter/Intra-Rater Reliability of Two Fundamental Movement Skills for the Locomotor Subscale of the FG-COMPASS

posted on 2023-08-08, 10:15 authored by Lino Perez, Ovande Furtado JrOvande Furtado Jr
The Furtado-Gallagher Child Observational Movement Pattern Assessment System (FG-COMPASS) is an observational tool using sequential decisions to assess fundamental movement skill proficiency. The current version of the test has three locomotor and five manipulative skills. This study assessed expert-rater agreement and inter- and intra-rater reliability of two new scales to be added to the locomotor subscale. This study was divided into two phases. In Phase I, 60 children between the ages of 5 and 10 were filmed performing the gallop and vertical jump skills. An expert in motor behavior classified the videotapes using the newly created rating scales. Next, eight videos were selected for training purposes and 24 videos for testing purposes. In Phase II, 30 undergraduate students served as raters and underwent training before the testing session. The data were analyzed using weighted kappa (Kw) and the intra-class correlation coefficient (ICC). The results suggested a ‘very good’ agreement between the expert and raters for vertical jump (Kw = .96) and gallop (Kw =.89). The ICC values for vertical jump and gallop were .98 and .94, respectively. The mean kappa values for inter-rater reliability were considered ‘very good’ for vertical jump (MKw=.92) and ‘good’ for gallop (MKw=.78). The ICC values were .98 and .95 for vertical jump and gallop, respectively - which is considered ‘excellent’. The kappa values for intra-rater reliability were .96 and .85 for vertical jump and gallop, respectively. The ICC values were .98 and .92 for vertical jump and gallop, respectively. These results show that the proposed rating scales are reliable in assessing vertical jump and gallop. Future studies should focus on criterion-related validity and reliability evidence from live performances.


Declaration of conflicts of interest


Corresponding author email

Lead author country

  • United States

Lead author job role

  • Other

Lead author institution

California State University Northridge College of Health and Human Development

Human Participants

  • Yes

Ethics statement

We obtained approval from the Institutional Review Board (IRB) and We also received permission from the IRB to enlist 30 undergraduate students as raters. These participants signed a research-informed consent and thoroughly reviewed the rating scale for either gallop or vertical jump.

Terms agreed

  • Yes, I agree to Advance terms


Log in to write your comment here...

Usage metrics

    Advance: Social Sciences & Humanities