Development and Psychometric Examination of a New Social Competence Outcome Measure for Children with Autism Spectrum Disorder: The Observational Social Competence Assessment

Current assessments of social competence for children with autism spectrum disorder (ASD) are mostly designed for screening or diagnosis, not for measuring outcomes. This study aimed to develop a professional-administrated outcome measure, the Observational Social Competence Assessment (OSCA), and examine its psychometric properties. The OSCA was constructed based on a multidimensional view of social competence (i.e., social skill elements, social reciprocity, and social adjustment). For psychometric evaluation, 89 children with ASD between 3 and 12 years (mean = 70.69 months, SD = 15.31) were assessed with the OSCA and with assessments of ASD symptoms, verbal comprehension ability, and adaptive function. The results show that the OSCA has good internal consistency (Cronbach’s α = 0.820–0.954), test–retest reliability (intraclass correlation coefficients [ICC] = 0.917–0.960), and inter-rater reliability (ICC = 0.905–0.974). The OSCA also has good convergent (r = 0.508–0.703, p < 0.01) and divergent validity (r = 0.105, p = 0.496), as well as good responsiveness to changes in the social adjustment dimension (Cohen’s d = 1.26 and standardized response mean [SRM] = 1.92). Conclusively, these results show that the OSCA is sufficiently reliable, valid and responsive to be applied as an outcome measure of social competence in children with ASD.