The psychometric properties of the Strengths and Difficulties Questionnaire in a multi-ethnic sample of young children

Objectives: Developed countries are becoming more multi-ethnic, with consequent problems of maintaining invariance of health questionnaires. We aimed to explore commonalities in the structure of the Strengths and Difficulties Questionnaire (SDQ) completed for young children in a multi-ethnic English cohort while examining potential method effects and misfitting items. The secondary aim was to demonstrate the usefulness of bifactor modelling and exploratory structural equation modelling (ESEM) for kinanthropological research. Methods: We used SDQ data from 3,290 children enrolled in the Born in Bradford cohort, completed by parents (usually the mother) at child age 3 and 4 and teachers at age 5. The factor structure for 11 potential configurations was assessed in each age group using confirmatory factor analysis. ESEM was used to assess misfitting items under the best fitting configuration. Results: The best fitting configuration was a bifactor model of the 2 broader scales and a methods factor, using the 20 difficulties items. Generally, factor loadings increased between age 3 and age 5. Several items contributed to misfit. Conclusions: There was less support for the robustness and hypothesised structure of the SDQ in this sample. Bifactor scores that account for measurement error could be useful if carefully applied in epidemiological and kinanthropological studies in multi-ethnic and/or younger age samples.

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In: B. N. Petrov & F. Csaki (Eds.), Second International Symposium on Information Theory. Budapest: Akademiai Kiado.

2. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. CrossRef

3. Bhugra, D. (2005). Cultural identities and cultural congruency: a new model for evaluating mental distress in immigrants. Acta Psychiatr Scand, 111(2), 84–93. CrossRef

4. Browne, M. W. (2001). An Overview of Analytic Rotation in Exploratory Factor Analysis. Multivariate Behavioral Research, 2001/01/01, 36(1), 111–150. CrossRef

5. Caci, H., Morin, A. J., & Tran, A. (2015). Investigation of a bifactor model of the Strengths and Difficulties Questionnaire. Eur Child Adolesc Psychiatry, 2015/01/29, 1–11. CrossRef

6. Croft, S., Stride, C., Maughan, B., & Rowe, R. (2015). Validity of the Strengths and Difficulties Questionnaire in Preschool-Aged Children. Pediatrics, May 1, 2015, 135(5), e1210-e1219. CrossRef

7. Enders, C. K., & Bandalos, D. L. (2001). The Relative Performance of Full Information Maximum Likelihood Estimation for Missing Data in Structural Equation Models. Structural Equation Modeling: A Multidisciplinary Journal, 8(3), 430–457. CrossRef

8. Ezpeleta, L., Granero, R., de la Osa, N., Penelo, E., et al. (2013). Psychometric properties of the Strengths and Difficulties Questionnaire(3–4) in 3-year-old preschoolers. Compr Psychiatry, Apr 2013, 54(3), 282–291. CrossRef

9. Fuchs, S., Klein, A. M., Otto, Y., & von Klitzing, K. (2013). Prevalence of emotional and behavioral symptoms and their impact on daily life activities in a community sample of 3 to 5-year-old children. Child Psychiatry Hum Dev, Aug 2013, 44(4), 493–503. CrossRef

10. Glazebrook, C., McPherson, A. C., Macdonald, I. A., Swift, J. A., et al. (2006). Asthma as a barrier to children's physical activity: implications for body mass index and mental health. Pediatrics, 118(6), 2443–2449. CrossRef

11. Goodman, A., Heiervang, E., Fleitlich-Bilyk, B., Alyahri, A., et al. (2012). Cross-national differences in questionnaires do not necessarily reflect comparable differences in disorder prevalence. Soc Psychiatry Psychiatr Epidemiol, Aug 2012, 47(8), 1321–1331. CrossRef

12. Goodman, A., Lamping, D. L., & Ploubidis, G. B. (2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): data from British parents, teachers and children. J Abnorm Child Psychol, Nov 2010a, 38(8), 1179–1191. CrossRef

13. Goodman, A., Patel, V., & Leon, D. A. (2010). Why do British Indian children have an apparent mental health advantage? J Child Psychol Psychiatry, Oct 2010b, 51(10), 1171–1183. CrossRef

14. Goodman, R. (1997). The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry, Jul 1997, 38(5), 581–586. CrossRef

15. Goodman, R. (2001). Psychometric properties of the strengths and difficulties questionnaire. J Am Acad Child Adolesc Psychiatry, Nov 2001, 40(11), 1337–1345. CrossRef

16. Goodman, R., Ford, T., Simmons, H., Gatward, R., et al. (2000). Using the Strengths and Difficulties Questionnaire (SDQ) to screen for child psychiatric disorders in a community sample. Br J Psychiatry, Dec 2000a, 177, 534–539. CrossRef

17. Goodman, R., Renfrew, D., & Mullick, M. (2000). Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. Eur Child Adolesc Psychiatry, Jun 2000b, 9(2), 129–134. CrossRef

18. Gregorich, S. E. (2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11 (Suppl 3)), 78. CrossRef

19. Hamer, M., Stamatakis, E., & Mishra, G. (2009). Psychological distress, television viewing, and physical activity in children aged 4 to 12 years. Pediatrics, May 2009, 123(5), 1263–1268. CrossRef

20. Hill, C. R., & Hughes, J. N. (2007). An Examination of the Convergent and Discriminant Validity of the Strengths and Difficulties Questionnaire. School Psychology Quarterly, 22(3), 380–406. CrossRef

21. Hu, L., & Bentler, M. P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. CrossRef

22. Law, M., Petrenchik, T., King, G., & Hurley, P. (2007). Perceived Environmental Barriers to Recreational, Community, and School Participation for Children and Youth With Physical Disabilities. Archives of Physical Medicine and Rehabilitation, Dec 2007, 88(12), 1636–1642. CrossRef

23. Majnemer, A., Shevell, M., Law, M., Birnbaum, R., et al. (2008). Participation and enjoyment of leisure activities in school aged children with cerebral palsy. Developmental Medicine & Child Neurology, 50(10), 751–758. CrossRef

24. McCrory, C., & Layte, R. (2012). Testing competing models of the Strengths and Difficulties Questionnaire's (SDQ's) factor structure for the parent-informant instrument. Personality and Individual Differences, Jun 2012, 52(8), 882–887. CrossRef

25. Mellor, D., & Stokes, M. (2007). The Factor Structure of the Strengths and Difficulties Questionnaire. European Journal of Psychological Assessment, 23(2), 102–112. CrossRef

26. Mieloo, C. L., Bevaart, F., Donker, M. C., van Oort, F. V., et al. (2014). Validation of the SDQ in a multi-ethnic population of young children. Eur J Public Health, Feb 2014, 24(1), 26–32. CrossRef

27. Muthén, B. (1993). Goodness of fit with categorical and other non-normal variables. In: K. A. Bollen & J. S. Long (Eds.) Testing structural equation models. Newbury Park, CA: Sage, pp. 205–243.

28. Muthén, L., & Muthén, B. (2016). Mplus User's Guide. Sixth Edition. Los Angeles, CA: Muthén & Muthén, 1998–2016a.

29. Muthén, L., & Muthén, B. (2016) Mplus: Statistical analysis with latent variables. [Version for 7.3]. Los Angeles, CA, 1998–2016b.

30. Nazroo, J. Y. (1998). Genetic, Cultural or Socio-economic Vulnerability? Explaining Ethnic Inequalities in Health. Sociology of Health & Illness, 20(5), 710–730. CrossRef

31. Nixon, G. M., Thompson, J. M., Han, D. Y., Becroft, D. M. et al. (2008). Short sleep duration in middle childhood: risk factors and consequences. Sleep, 31(1), 71.

32. Page, A. S., Cooper, A. R., Griew, P., & Jago, R. (2010). Children's screen viewing is related to psychological difficulties irrespective of physical activity. Pediatrics, 126(5), e1011–e1017. CrossRef

33. Petermann, U., Petermann, F. and Schreyer, I. (2010). The German Strengths and Difficulties Questionnaire (SDQ): Validity of the teacher version for preschoolers. European Journal of Psychological Assessment, 26(4), 256–262. CrossRef

34. Prady, S. L., Pickett, K. E., Croudace, T., Mason, D., et al. (2015). Maternal psychological distress in primary care and association with child behavioural outcomes at age three. Eur Child Adolesc Psychiatry, Sep 2015, 24, 1–13.

35. Raynor, P., & Born in Bradford Collaborative Group (2008). Born in Bradford, a cohort study of babies born in Bradford, and their parents: protocol for the recruitment phase. BMC Public Health, 8, 327. CrossRef

36. Sagatun, A., Søgaard, A. J., Bjertness, E., Selmer, R., et al. (2007). The association between weekly hours of physical activity and mental health: A three-year follow-up study of 15–16-year-old students in the city of Oslo, Norway. BMC Public Health, 7(1), 1–9. CrossRef

37. Schwarz, G. E. (1978). Estimating the dimension of a model. Annals of Statistics, 6(2), 461–464. CrossRef

38. Steiger, J. H., & Lind, J. (1980). Statistically-based tests for the number of common factors. In: Proceedings of the Annual Spring Meeting of the Psychometric Society, Iowa City, IA 758.

39. Stevanovic, D., Urban, R., Atilola, O., Vostanis, P., et al. (2014). Does the Strengths and Difficulties Questionnaire – self report yield invariant measurements across different nations? Data from the International Child Mental Health Study Group. Epidemiol Psychiatr Sci, Apr 2014, 1–12.

40. Stone, L. L., Otten, R., Engels, R. C., Vermulst, A. A., et al. (2010). Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4- to 12-year-olds: a review. Clin Child Fam Psychol Rev, Sep 2010, 13(3), 254–274. CrossRef

41. Theunissen, M. H., Vogels, A. G., de Wolff, M. S., & Reijneveld, S. A. (2013). Characteristics of the strengths and difficulties questionnaire in preschool children. Pediatrics, Feb 2013, 131(2), e446–454. CrossRef

42. Ussher, M., Owen, C., Cook, D., & Whincup, P. (2007). The relationship between physical activity, sedentary behaviour and psychological wellbeing among adolescents. Social Psychiatry and Psychiatric Epidemiology, 42(10), 851–856. CrossRef

43. Van de Looij-Jansen, P. M., Goedhart, A. W., de Wilde, E. J., & Treffers, P. D. (2011). Confirmatory factor analysis and factorial invariance analysis of the adolescent self-report Strengths and Difficulties Questionnaire: how important are method effects and minor factors? Br J Clin Psychol, Jun 2011, 50(2), 127–144. CrossRef

44. Watson, K. D., Papageorgiou, A., Jones, G., Taylor, S., et al. (2003). Low back pain in schoolchildren: the role of mechanical and psychosocial factors. Arch Dis Child, 88(1), 12–17. CrossRef

45. Wiles, N., Jones, G., Haase, A., Lawlor, D., et al. (2008). Physical activity and emotional problems amongst adolescents. Social Psychiatry and Psychiatric Epidemiology, 43(10), 765–772. CrossRef

46. Wright, J., Small, N., Raynor, P., Tuffnell, D., et al. (2013). Cohort profile: The Born in Bradford multi-ethnic family cohort study. Int J Epidemiol, 42(4), 978–991. CrossRef

47. Yu, C. Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes. Doctoral dissertation, University of California, Los Angeles.