Examining the validity of the use of ratio IQs in psychological assessments | IQ tests are amongst the most used psychological assessments, both in research and clinical settings. For participants who cannot complete IQ tests normed for their age, ratio IQ scores (RIQ) are routinely computed and used as a proxy of IQ, especially in large research databases to avoid missing data points. However, because it has never been scientifically validated, this practice is questionable. In the era of big data, it is important to examine the validity of this widely used practice. In this paper, we use the case of autism to examine the differences between standard full-scale IQ (FSIQ) and RIQ. Data was extracted from four databases in which ages, FSIQ scores and subtests raw scores were available for autistic participants between 2 and 17 years old. The IQ tests included were the MSEL (N=12033), DAS-II early years (N=1270), DAS-II school age (N=2848), WISC-IV (N=471) and WISC-V (N=129). RIQs were computed for each participant as well as the discrepancy (DSC) between RIQ and FSIQ. We performed two linear regressions to respectively assess the effect of FSIQ and of age on the DSC for each IQ test, followed by additional analyses comparing age subgroups as well as FSIQ subgroups on DSC. Participants at the extremes of the FSIQ distribution tended to have a greater DSC than participants with average FSIQ. Furthermore, age significantly predicted the DSC, with RIQ superior to FSIQ for younger participants while the opposite was found for older participants. These results question the validity of this widely used alternative scoring method, especially for individuals at the extremes of the normal distribution, with whom RIQs are most often employed. | 8/17423 | Secondary Analysis | Shared |
Controls for SCCRIP | To establish a well characterized cohort for pediatric patients living with sickle cell disease | 8/11185 | Secondary Analysis | Private |
Working Title: Differentiating Core Autism Symptomatology | Autism spectrum disorder (ASD) is characterized by persistent deficits in social communication and social interaction, social-emotional reciprocity, and repetitive behavior or restricted interest (American Psychiatric Association [APA], 2013). This study extends the existing literature by clarifying the extent to which mental health disorder symptoms differentially converge with autism symptoms related to social communication and restricted and repetitive behavior, as well as the extent to which mental health symptoms are empirically differentiated from the core autism symptom domains. Although there is a well-documented correlation between the severity of core ASD symptoms and the presence of mental health disorder symptoms, such as anxiety and irritability, the nature of this linkage remains poorly understood. In this project, the National Database for Autism Research (NDAR) and Research Domain Criteria Database (RDoCdb) were used to observe continuous symptom measures such as the Social Responsiveness Scale (SRS) and the Child Behavior Checklist (CBCL) to examine correlation matrices as well as factor structure models to examine these patterns of association. The SRS “social communication” and “repetitive restricted” subscales were correlated with the CBCL externalizing, internalizing, attention, conduct, aggression, psychosomatic, and withdrawn subscales. We hypothesized that “repetitive and restricted” behaviors would be more correlated with the CBCL scales than would the “social communication” scale. These results were also interpreted according to age and IQ. In conclusion, this study may elucidate ongoing questions about the centrality of mental health symptoms like anxiety to aspects of ASD taxonomy. | 27/11144 | Secondary Analysis | Private |
Characterizing Auditory Hyperreactivity in Autism | Objective: To answer the following research questions: 1) What is the prevalence of auditory hyper-reactivity in ASD? 2) Does auditory hyper-reactivity severity change with age? and 3) What are the most common auditory stimuli reported to be bothersome?
Research Design: Primarily descriptive secondary data analysis.
Methods: Type of data: Questionnaire items regarding auditory hyper-reactivity will be filtered from: Autism Diagnostic Interview-Revised, Sensory Profile (all forms), Sensory Over-Responsivity Scale, and Sensory Experiences Questionnaire in addition to demographics (i.e., age, race, ethnicity, diagnoses).
Analysis Plan: Descriptive statistics, tables and figures will be used to summarize the prevalence and severity of auditory hyper-reactivity by age. Linear regression modeling will be used to evaluate changes in auditory hyper-reactivity by age. If data is available for control subjects, statistical analyses will be conducted for means comparison (ASD vs. non-ASD).
| 21/7001 | Secondary Analysis | Private |
The effect of compensatory mechanisms during and after pregnancy on a child's development | Early childhood involves rapid processes of human growth leading to different trajectories in physical, cognitive, social, and emotional development (Graignic-Philippe et al., 2014). These processes are influenced by a wide variety of factors such as maternal health, environmental stressors, and early childhood experiences. Current literature has shown how exposure to both acute and chronic stress during pregnancy have a pathogenetic effect throughout childhood (Kim & Leventhal, 2015; Rice, et al, 2010), leading to neurotypical or atypical development. Studies have shown how these stressors are linked neurodevelopmental disorders such Autism Spectrum Disorders (Zerbo et al., 2015; Atladóttir et al., 2012) or Attention Deficit Hyperactivity Disorder (Rosenqvist et al., 2019).
In recent years, there has been a shift from traditional diagnostic research models to synthesis of different scientific fields to map lifecourse development in order for rapid translation into healthcare practices (Halfon et al., 2014). Whilst there are studies showing links between stress and atypical developmental outcomes, there is still very limited literature on compensatory mechanisms found pre- and post-pregnancy, which illustrate development of protective factors (such as presence of self-regulation, high verbal intelligence, sociability, adept social communication) against atypical developmental outcomes. This study aims to identify and measure the presence of these protective factors that appear to guard against or mitigate the emergence of neurodevelopmental disorders. Therefore, nationwide and longitudinal data are needed in order to accurately create risk models in order to map developmental trajectories.
| 25/5717 | Secondary Analysis | Private |
Psychometric Analysis of the Social Communication Questionnaire Using an Item-Response Theory Framework: Implications for the Use of the Lifetime and Current Forms | The Social Communication Questionnaire (SCQ) was developed as a screener of Autism Spectrum Disorder (ASD). To date, the majority of the SCQ utility studies focused on its external validity (e.g., ROC curve analyses), but very few have addressed the internal validity issues. With samples consisting of 2,134 individuals available from the National Database for Autism Research (NDAR), the current study examined the factor structure, item-level characteristics, and measurement equivalence of the SCQ forms (i.e., Lifetime form and Current form) using both the classical true score theory and the item response theory (IRT). While our findings indicate sufficient psychometric properties of the SCQ Lifetime form, measurement issues emerged with respect to the SCQ Current form. These issues include lower internal consistencies, a weaker factor structure, lower item discriminations, significant pseudo-guessing effects, and subscale-level measurement bias. Thus, we caution researchers and clinicians about the use of the SCQ Current form. In particular, it seems inappropriate to use the Current form as an alternative to the Lifetime form among children younger than 5 years old or under other special situations (e.g., teacher-report data), although such practices were advised by the publisher of the SCQ. Instead, we recommend modifying the wording of the Lifetime form items rather than switching to the Current form where a 3-month timeframe is specified for responding to SCQ items. Future studies may consider investigating the association between the temporality of certain behaviors and the individual’s potential for being diagnosed with ASD, as well as the age neutrality of the SCQ. | 16/2054 | Secondary Analysis | Shared |
Computer-Based Testing to Shorten the Social Communication Questionnaire (SCQ): A Proof-of-Principle Study of the Lifetime and Current Forms | The Social Communication Questionnaire (SCQ) is a 40-item instrument designed to screen children at risk for Autism Spectrum Disorder (ASD). Both Lifetime and Current forms of the scale are available. Although these forms are manageable for many respondents, their use may result in substantial respondent and administrative burden, particularly among individuals who have difficulty reading, have physical illness, and/or are asked to take multiple questionnaires. The objective of this research was to examine the potential of two stopping rules for computer-based testing (namely, curtailment and stochastic curtailment) to shorten the SCQ without compromising its screening properties. A retrospective analysis was conducted using data from the National Database for Autism Research (NDAR); responses regarding 1236 at-risk individuals from the SCQ Lifetime and 709 at-risk individuals from the SCQ Current were analyzed. In post-hoc simulation, curtailment reduced mean test lengths by 29% to 44% compared to the full-length Lifetime form, and by 25% to 39% compared to the full-length Current form, while providing the same screening result as the corresponding full-length form in 100% of cases. Stochastic curtailment made further reductions in test length, but was not always concordant with the full-length form’s screening result. These findings suggest that curtailment has potential to improve the efficiency of the SCQ in computer-based administrations and should be tested prospectively. | 18/1820 | Secondary Analysis | Private |
Development of a Short Form of the SRS: An Application of IRT | Background: Research and practice in autism spectrum disorder (ASD) rely on quantitative measures, such as the Social Responsiveness Scale (SRS), for characterization and diagnosis. Like many ASD diagnostic measures, SRS scores are influenced by factors unrelated to ASD core features. This study further interrogates the psychometric properties of the SRS using item response theory (IRT), and demonstrates a strategy to enhance measure specificity by applying IRT results.
Methods: SRS analyses were conducted on a large sample (N=21,426) of youth from four ASD databases. Items were subjected to item factor analyses and evaluation of item bias by gender, age, and expressive language level.
Results: Item selection based on dimensionality and DIF analyses produced a reduced item SRS subscale that was unidimensional in structure, highly reliable (α=.96), and free of gender, age, expressive language, and non-verbal IQ influence. The subscale also showed strong relationships with established measures of autism symptom severity (ADOS, ADI-R, Vineland). Degree of association between all measures varied as a function of expressive language.
Conclusions: Results identified specific SRS items that are more vulnerable to non-ASD-related traits. The resultant 16-item SRS subscale may possess superior psychometric properties compared to the original scale and emerge as a more precise measure of ASD core symptom severity, facilitating research and practice. Future research using IRT is needed to further refine existing measures of autism symptomatology. | 26/1478 | Secondary Analysis | Private |
Revising the Social Communication Questionnaire scoring procedures for Autism Spectrum Disorder and potential Social Communication Disorder | In analyzing data from the National Database for Autism Research, we examine revising the Social Communication Questionnaire (SCQ), a commonly used screening instrument for Autism Spectrum Disorder. A combination of Item Response Theory and Mokken scaling techniques were utilized to achieve this and abbreviated scoring of the SCQ is suggested. The psychometric sensitivity of this abbreviated SCQ was examined via bootstrapped Receiver Operator Characteristic (ROC) curve analyses. Additionally, we examined the sensitivity of the abbreviated and total scaled SCQ as it relates to a potential diagnosis of Social (Pragmatic) Communication Disorder (SCD). As SCD is a new disorder introduced with the fifth edition of the Diagnostic and Statistical Manual (DSM-5), we identified individuals with potential diagnosis of SCD among individuals with ASD via mixture modeling techniques using the same NDAR data. These analyses revealed two classes or clusters of individuals when considering the two core areas of impairment among individuals with ASD: social communication and restricted, repetitive patterns of behavior. | 16/889 | Secondary Analysis | Shared |
The Sensitivity and Specificity of the Social Communication Questionnaire for Autism Spectrum Disorder with Respect to Age | Scientific Abstract
The Social Communication Questionnaire (SCQ) assesses communication skills and social functioning in screening for symptoms of autism-spectrum disorder (ASD). The SCQ is recommended for individuals between 4 to 40 years with a cutoff score of 15 for referral. Mixed findings have been reported regarding the recommended cutoff score’s ability to accurately classify an individual as at-risk for ASD (sensitivity) versus an individual as not at-risk for ASD (specificity). Based on a sample from the National Database for Autism Research (n=344; age: 1.58 to 25.92 years old), the present study examined the SCQ’s sensitivity versus specificity across a range of ages. We recommend that the cutoff scores for the SCQ be re-evaluated with age as a consideration.
Lay Abstract
The age neutrality of the Social Communication Questionnaire (SCQ) was examined as a common screener for ASD. Mixed findings have been reported regarding the recommended cutoff score’s ability to accurately classify an individual as at-risk for ASD (sensitivity) versus accurately classifying an individual as not at-risk for ASD (specificity). With a sample from the National Database for Autism Research, the present study examined the SCQ’s sensitivity versus specificity. Analyses indicated that the actual sensitivity and specificity scores were lower than initially reported by the creators of the SCQ. | 2/339 | Secondary Analysis | Shared |
Convergent and Discriminant Validity and Reliability of the Pediatric Anxiety Rating Scale in Youth with Autism Spectrum Disorders | The psychometric properties of the Pediatric Anxiety Rating Scale (PARS), a clinician-administered measure for assessing severity of anxiety symptoms, were examined in 72 children and adolescents diagnosed with an autism spectrum disorder (ASD). The internal consistency of the PARS was 0.59, suggesting that the items were related but not repetitive.The PARS was strongly correlated with clinician-ratings of overall anxiety severity and parent-
report anxiety measures, supporting convergent validity. Results for divergent validity were mixed. Although the PARS was not associated with the sum of the Social and Communication items on the Autism Diagnostic Observation System, it was moderately correlated with parent-reported inattention, aggression and externalizing behavior. Overall, these results suggest that the psychometric properties of the PARS are adequate for assessing anxiety
symptoms in youth with ASD, although additional clarification of divergent validity is needed. | 23/50 | Primary Analysis | Shared |