Northern Ontario Assessment and Resource Centre 

Research

Our research agenda is comprised of studies that further our understanding of how to support individuals with learning disabilities and associated disorders so that they may achieve academic success.

Projects conducted have focused on gathering normative data, developing new measurement tools, understanding the factors that contribute to academic transitions, investigating the efficacy of assistive technology, and surveying the needs of post-secondary students and staff.

We can also be found on Researchgate

Research Grants

  • Mental Health Innovation Fund
  • Human Resources and Skills Development Canada
  • Knowledge Network for Applied Education Research (KNAER)
  • Higher Education Quality Council of Ontario HEQCO
  • Ministry of Colleges, Training and Universities (MTCU)
  • Aboriginal Education Office of Ontario

Partnerships

  • Regional Assessment and Resource Centre (RARC)
  • Learning Disability Association of Sudbury (LDAS)
  • Rainbow District School Board (RDSB)
  • Sudbury Catholic District School Board (SCDSB)
  • Centre francophone d’évaluation et de ressources de l’Ontario (CFERO)
  • Canadian Mental Health Association of Sudbury (CMHA)
  • Ontario Colleges and Universites
    • Confederation College, Collège Boréal, Nipissing University, Northern College, Cambrian College, Sault College, Seneca College, Sheridan College, Loyalist College, St. Claire College, George Brown College, St. Lawrence College, Georgian College, Centennial College, Algonquin College, Conestoga College, Laurentian University

Research Dollars Received

Research Projects

Research Partnerships

Current Projects

Improving Bilingual Assessments

In partnership with the Centre francophone d’évaluation et de ressources de l’Ontario (CFERO) we are examining the cross-linguistic transfer of language skills in bilingual college and university students to better understand and improve the assessment process for these students.

Identifying Post-Pandemic Academic Achievement

Working with the Sudbury Catholic District School Board, we are using examining the academic achievement of children and adolescents, with and without disabilities, following the pandemic.

Learning Strategies and Study Skills for Students with Disabilities

We are examining the learning strategy use and study approaches of post-secondary students with disabilities to identify predictors of success.

Virtual Psychoeducational Assessments

Most of the commonly used tests in a psychoeducational assessment were designed to be administered in-person. Administration over a live synchronous videoconferencing service has not been validated. In collaboration with the Regional Assessment and Resource Centre (RARC), we are investigating whether virtual administrations yield results that are comparable to in-person administration.

Past Projects

Publications

Abstract
Although extended time for tests and examinations is the most commonly requested and provided accommodation in post-secondary institutions, best practice guidelines from existing research are rarely translated into practice. Thus, a review of the literature was undertaken to examine support for granting additional assessment time to persons in specific disability categories. Based on this review, no more than 25% additional time is supported for students with learning disabilities, and even then, only when their documented area of functional impairment overlaps with assessment task requirements. No research support exists for the provision of extra time for students with attention deficit/hyperactivity disorder (AD/HD) or mental health diagnoses. Research is silent on the appropriateness of additional assessment time for individuals with autism spectrum disorder and thus individuals need to be considered on a case-by-case basis. In very exceptional situations, more than 25% additional time may be warranted, but this would need to be well considered using an established decision-making model.

Full text available at: https://www.researchgate.net/publication/359454325_Provision_of_Extended_Assessment_Time_in_Post-secondary_Settings_a_Review_of_the_Literature_and_Proposed_Guidelines_for_Practice

Abstract
This study utilized the Simple View of Reading (SVR) model cognitive subtypes to determine the impact of text-to-speech (TTS) software on the reading comprehension of 94 grade 8 students with reading difficulties.  Method: paired samples t tests for all four SVR groups were conducted to examine reading comprehension scores under TTS and no-TTS conditions. Results: only those participants with a dyslexic profile (listening comprehension greater than decoding skills), demonstrated significant gains in reading comprehension in the TTS compared to the no-TTS condition; a large effect size (1.58 grade level increase) was found. Furthermore, this group’s literal comprehension improved much more than their inferential comprehension when utilizing TTS.  Implications: a one-size fits all approach for the selection of TTS for struggling readers is not recommended. SVR subtyping incorporated into psychoeducational assessments can inform appropriate assignment of TTS to struggling readers.

To request a full-text copy contact Robert Silvestri

Link to the journal: http://dx.doi.org/10.1177/01626434211033577

Abstract
Memory aids are now frequently provided to elementary and secondary school students to increase their success in achieving provincial curriculum standards. While such an accommodation may meet the immediate goal of improved academic performance it may not be warranted based on an actual long-term memory retrieval impairment and may therefore be inequitable, providing an unfair academic advantage relative to non-disabled students. Furthermore, providing memory aid accommodations inappropriately may rob students of the opportunity to learn effective study and retrieval strategies, leading instead to dependence on an accommodation that may not be continued once they enter post-secondary education. An appropriate accommodation at the post-secondary level of education removes a disability-related barrier (functional impairment) and assists only those facing such barriers; under human rights legislation, accommodations are not implemented to guarantee success, reduce anxiety, or provide unequal access to material. Memory aids improve the retrieval of information from long-term storage for everyone. As such, the current widespread provision of this accommodation prior to post-secondary studies must be evaluated critically, with such supports offered only when justified. A six-step process for determining when memory aids are an appropriate accommodation within the post-secondary setting is provided and discussed.

To request a full-text copy contact Alana Holmes

Link to the journal: https://doi.org/10.1177/0829573520979581

Abstract
Recent directives from legislative bodies in the USA and Canada assert that self-report and previous experience should constitute the basis from which accommodations are determined for students with disabilities (SWDs). Extended time for tests is a highly requested accommodation; postsecondary institutions have focused on 50% additional time as a universal starting point. However, the limited research on the issue of extended time has mostly drawn inferences to real-life test situations from studies employing simulated testing situations and participants with self-reported disability status. Archival data from 825 tests/exams held at one college during the 2012 and 2013 school years were analyzed to determine whether, and to what degree students with learning disabilities (SLDs) used the 50% extra time accorded them and what factors influenced the use of extra time. The majority of SLDs did not use extended time, and those who accessed it rarely used more than 25%. Findings have significant implications with respect to the procedures currently in use for the assignment of extra time to SLDs.

To request a full-text copy contact Alana Holmes

Link to journal: https://link.springer.com/article/10.1007/s12207-019-09339-9

Abstract
Historically, students with disabilities in Canada provided comprehensive and objective documentation of their diagnosis and related functional impairments to access appropriate accommodations at the postsecondary level. Recently, some Canadian provinces have adopted an approach whereby students with mental health disabilities need not reveal their diagnosis; a healthcare professional may simply verify that a disability exists, enumerate the functional impairments, and detail the accommodations to be provided.   Without transparent documentation, Disability Services Offices frequently rely upon physicians for this information. We completed a census of all medical training programs in Ontario to evaluate the extent to which medical professionals receive training in determining functional impairments in postsecondary students with mental health conditions. Our findings demonstrated that the vast majority of medical residents receive no such training. Two programs report offering limited training in subjective methods such as self-report or the wishes of the client. Implications and recommended best practice are discussed.

Full text available at: https://www.researchgate.net/publication/329129145_Medically_confirmed_functional_impairment_as_proof_of_accommodation_need_in_postsecondary_education_Are_Ontario’s_campuses_the_bellwether_of_an_inequitable_decision-making_paradigm

Abstract
Staff at campus-based counselling and disability centres in 15 of Ontario’s 24 community colleges completed 3536 surveys on 1964 individual students querying the presence of mental illness and academic challenges as reported by students accessing these services.  Survey data was analyzed to determine prevalence rates of mental disorders and investigate for the presence of a relationship between specific mental illnesses and any associated academic impacts.  More than half of these students had diagnoses with mood and anxiety disorders being the most common individual and comorbid diagnoses.  The academic challenges reported by students with mental illnesses occurred in particular patterns relative to specific diagnoses; alertness/attention challenges were associated with mood disorders while memory/executive function problems were linked to anxiety disorders.  Implications for training and service practices of counselling and disability staff are reviewed as are future research directions for accommodating the academic needs of students with mental illnesses.

Full text available at: https://www.researchgate.net/publication/281845280_Rates_of_Mental_Illness_and_Associated_Academic_Impacts_in_Ontario’s_College_Students

Miller et al. have challenged the findings of our two previous studies, based largely on the assumption that our findings are biased due to the clinical sample used.  However, they fail to address the primary tenet of our studies, namely, that clinicians will obtain different scores on the Wechsler Adult Intelligence Scale-IV (WAIS-IV) depending on whether Canadian or American norms are used. This reply seeks to provide empirical evidence supporting the existence of such score differences even when nonclinical samples are used, and identifies some of the clinical decisions that are potentially affected by choice of normative data.

Full text available at: https://www.researchgate.net/publication/276206454_Getting_Back_to_the_Main_Point

Abstract
Building on a recent work of Harrison, Armstrong, Harrison, Iverson and Lange which suggested that Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV) scores might systematically overestimate the severity of intellectual impairments if Canadian norms are used, the present study examined differences between Canadian and American derived WAIS-IV scores from 861 postsecondary students attending school across the province of Ontario, Canada.  This broader data set confirmed a trend whereby individuals’ raw scores systematically produced lower standardized scores through the use of Canadian as opposed to American norms.  The differences do not appear to be due to cultural, educational, or population differences, as participants acted as their own controls.  The ramifications of utilizing the different norms were examined with regard to psychoeducational assessments and educational placement decisions particularly with respect to the diagnoses of Learning Disability and Intellectual Disability.

Full text available at: https://www.researchgate.net/publication/270958533_Implications_for_Educational_Classification_and_Psychological_Diagnoses_Using_the_Wechsler_Adult_Intelligence_Scale-Fourth_Edition_With_Canadian_Versus_American_Norms

Abstract
Disability Service Staff at colleges and universities in Ontario, Canada were surveyed regarding the number of students arriving at their offices with the label of mild intellectual disability.  Information was obtained regarding criteria used in association with this label, documentation required to support the classification, and accommodations provided, as well as the types of programs in which these students enroll and their success in those programs.  Results demonstrate little consistency across institutions regarding the criteria employed when making this identification, and the accommodations and supports provided.  Even with supports and accommodations, respondents estimated that fewer than 25% of such students are able to succeed at the postsecondary level, although a larger percentage appear to benefit from specialized college programs.  Best practice guidelines are needed with respect to assessment and diagnosis of this condition, and specialized programs may be required to address success and retention at the postsecondary level.

Full text available at: https://www.researchgate.net/publication/234915100_Mild_Intellectual_Disability_at_the_Postsecondary_Level_Results_of_a_Survey_of_Disability_Service_Offices

Abstract
A Canadian context for the diagnosis of students with specific learning disabilities (LD) was investigated in the present literature review.  A systematic review of the literature was undertaken to determine the current and best practices in this field.  Overall, no agreed upon definition of LD was identified, although core similarities in definitions were noted.  Furthermore, recent research shows that many psychological
assessments fail to adhere to any one definition when making this diagnosis, and as a result the diagnosis may or may not reflect the presence of a permanent disability that impairs academic functioning at the postsecondary level.  There is, therefore, a need to adopt a consistent, evidence-based approach to diagnosis of LD in Canada.  Recommendations regarding best practices and appropriate criteria for diagnosis of LD are discussed.

Full text available at: https://www.researchgate.net/publication/216768158_Easier_Said_Than_Done_Operationalizing_the_Diagnosis_of_Learning_Disability_for_Use_at_the_Postsecondary_Level_in_Canada

Abstract
An increasing number of students with Learning Disabilities (LD) are enrolling in postsecondary education (PSE). Assistive technology (AT) is often provided to these students to circumvent academic deficits. This article will focus on research at the PSE level and students with LD to (a) identify AT service delivery practices, (b) describe the most frequently used ATs, (c) review research on the efficacy of AT to circumvent academic deficits, and (d) provide suggestions for future research on AT efficacy and for formulation of recommendations within psychoeducational reports.  The use of AT by PSE students with LD appears to have moved ahead of research, proving or even testing the effectiveness of ATs in supporting the learning needs of this population.

Full text available at: https://www.researchgate.net/publication/254083217_Assistive_Technology_Use_by_Students_With_LD_in_Postsecondary_Education_A_Case_of_Application_Before_Investigation

Poster Presentations

Holmes, A., Silvestri, R., & Rahemtulla, R. (2015, June). Who does text-to-speech assistive technology benefit? Using word decoding and verbal ability to guide recommendations. Poster presented at the annual conference of the Canadian Psychology Association, Ottawa, ON.

Holmes, A., & Rahemtulla, R. (2015, November). Measuring the academic achievement gap between Americans and Canadians using the Wechsler Individual Achievement Test–Third Edition. Poster accepted for presentation at the National Academy of Neuropsychology Annual Conference, Austin, TX.

Holmes, A., & Silvestri, R. (2013, June). Disability disclosure rates and predictors of disability disclosure in the workplace by postsecondary graduates with learning disabilities. Poster session presented at the annual conference of the Canadian Psychological Association, Quebec City, QC.

Holmes, A., & Silvestri, R. (2012, June). Faculty preparedness for teaching students with mental illness. Poster session presented at the annual conference of the Canadian Psychological Association, Halifax, NS.

Holmes, A., Silvestri, R., & Kostakos, M. (2011, June). Mental illness in Ontario’s student college population. Poster session presented at the annual conference of the Canadian Psychological Association, Toronto, ON.

Holmes, A., Silvestri, R., & Gouge, A. (2010, June). Examination of brief self-report measures of anxiety in postsecondary students. Poster session presented at the annual conference of the Canadian Psychological Association, Winnipeg, MB.

Holmes, A., Silvestri, R., & Harrison, A. (2010, June). Employment success of graduates with learning disabilities from Ontario’s colleges and universities. Poster session presented at the annual conference of the Canadian Psychological Association, Winnipeg, MN.

Holmes, A., Silvestri, R., & Gouge, A. (2009, June). Text-to-voice technology in an adult sample with reading difficulties: An examination of the efficacy. Poster presented at the annual conference of the Canadian Psychological Association, Montreal, QC.

Program Development and Evaluation

Our Programs

Drawing from current research, we develop evidence-based programming to support students with disabilities. Our programs are routinely evaluated to ensure they are meeting their objectives and incorporating new knowledge.

Accessible College Transitions (ACT 2022 – present)

With the support of the Glenn Crombie Centre for Student Support at Cambrian College, we created a hybrid 8-week course to help students with disabilities and mental health challenges prepare for post-secondary studies.

The course is offered at no charge to incoming Cambrian College students or graduating Sudbury-area high school students preparing for college or university. It is offered three times a year coinciding with the Fall, Winter and Spring semesters. The course includes weekly Zoom-based group meetings and homework that students complete on their own time or with the support of course moderators. By the end of the course, students will have developed a learning profile that articulates their personal strengths, needs, goals and tools.

Students who successfully complete the course are eligible for three general education credits towards programs at Cambrian College.

For more information about ACT, please visit: https://www.noarc-cerno.ca/act/

Creating Exceptional Learners (CEL 2006 – 2020)

CEL began as a pilot project in 2006 run in partnership with the Rainbow District School Board (RDSB).

The CEL program was based upon an inclusionary approach to supporting students with LD. Students were withdrawn from their classrooms and taught skills and technology directly tied into their classroom work. The CEL program used comprehensive psycho-educational assessments to determine each student’s learning needs and provided updated, specific, and age-appropriate skills in Learning Strategies, Assistive Technology use and self-advocacy.

Student enrollment and participation in this program was done through referral from the RDSB.

For more information about CEL please contact Robert Silvestri

Successful Transitions Online and Mentoring Program (STOMP 2016-2020)

STOMP was developed in partnership with the Regional Assessment and Resource Centre (RARC) and the National Educational Association of Disabled Students (NEADS) with funding from the Ministry of Training, Colleges, and Universities’ Mental Health Innovation Fund.

STOMP aimed to prepare students with mental health challenges, ADHD and learning disabilities for the transition from high school to college or university. Students completed an online course covering the key areas of transition and attended three in-person workshops. Teacher candidates from the Laurentian University Faculty of Education, were trained as online course moderators. As well, STOMP connected its students to peer mentoring support at their destination college or university.

Program recruitment ran from December to January and was open to Grade 12 students in the Sudbury area with plans to attend any college or university in Ontario. The program was free of charge.

For more information about STOMP please contact Rafiq Rahemtulla

Program Evaluation

Using our research expertise we provide program evaluation services to our consortium members and related community agencies.

Screening for Exceptionalities (2021 – present)

We are assisting the Sudbury Catholic District School Board by evaluating the sensitivity and specificity of a screening tool that they are using to identify their students for further assessment for exceptionalities.

 Intensive Support Classroom Evaluation (2016 – 2020)

We provided consultative research, best practices guidelines and evaluated the Rainbow District School Board’s (RDSB) Intensive Support Classroom for students with Learning Disabilities. This program was comprised of grade 4-6 students with severe reading disabilities, offered them one year of intensive reading instruction in a dedicated classroom.

Coaching for Students with Learning Disabilities (2014-2015)

The Learning Disabilities Association of Sudbury (LDAS) offers a coaching program for their student members. Each student is paired with a teacher candidate (i.e., a coach) who works with them to enhance their self-awareness and instruct them in the use of assistive technology and learning strategies for a school year. At the request of the LDAS, NOARC evaluated the program’s effectiveness in preparing students for the transition to secondary school.

  • For more information on this coaching program, please contact the Learning Disabilities Association of Sudbury at:  http://ldasudbury.ca/

 Distance Counselling Efficacy (2013-2014)

Confederation College, during the 2013-2014 school year, enhanced access to its counselling services for its satellite campuses by using telephone, videoconferencing and other technologies to make counselling available across great distances. We evaluated the efficacy of the distance counselling as well as traditional in-person counselling and differences between the modalities.