- NBCOT certification examinations are criterion-referenced, meaning a candidate must obtain a score that is equal to or greater than the minimum passing score in order to pass the examination.
- Overall performance is reported on a standardized scale ranging from 300 to 600.
- A total scaled score of at least 450 is required to pass the OTR or COTA certification examination.
- It is important to note that the passing standard is based on candidate performance across the entire exam.
- Pass-fail decisions are based only on the total number of exam questions answered correctly, and there is no domain-level passing standard.
- Likewise, for the OTR examination, the passing standard is based on the responses provided across the entire exam.
- Separate scores are not calculated for the CST and multiple choice sections.
Scaled Scoring
A scaled score is a mathematical conversion of the number of items that a candidate correctly answered (raw score) that is transformed so that a consistent scale is used across all forms of the test. This transformation is similar to converting a weight from pounds to kilograms or a temperature from Celsius to Fahrenheit. The weight or temperature has not changed, only the format used to report the units.
Reporting scaled scores is standard practice on certification examinations and other standardized tests. The use of scaled scores allows for direct comparisons of scores across multiple test forms. Scaled scoring applies the same passing standard to all test forms, ensuring that the passing standard remains constant over time regardless of which version of the exam a candidate takes.
Why are scaled scores used?
Scaled scores provide consistent and comparable scoring across exam forms. Percent correct and number of correct scores are simply other ways of reporting raw scores and therefore, do not resolve the issue of comparability of scores across different versions of the exam. Although each version of the examination tests the same domains of occupational therapy practice, each form contains a different set of test items, which means that one or more questions on one test form may vary in difficulty from the questions appearing on another test form. Simply using a raw score does not account for this difference.
Norm-referenced scoring is used to indicate performance differences among test takers, whereas criterion-referenced scoring uses a pre-defined minimum standard or criterion that all candidates must achieve as an indicator of whether the candidate has acquired specific knowledge as defined by a valid content outline. Best test practices involve the use of scaled scoring to address direct comparison of scores across multiple versions of the examination, not to other candidates’ performance.
Passing
The NBCOT certification examinations are criterion-referenced, meaning a candidate’s performance is compared to a pre-determined minimum standard. In keeping with accreditation standards, NBCOT completes standard-setting studies to establish the passing standard for the OTR and COTA examinations. The methodology used for the most recent standard-setting studies, the Modified Angoff methodology, requires panels of subject matter experts to identify the minimum level of competency required to pass the examinations.1
Candidates who pass the examination receive a performance feedback report that includes a congratulatory letter and the candidate’s earned exam score.
NBCOT also provides performance feedback to those candidates who do not achieve the passing standard on the examination. This performance feedback report includes the candidate’s score, as well as the average score of new graduates who recently passed the examination. The report also includes a domain-level performance chart to help a candidate identify areas of relative strength and weakness and additional information regarding how individual domain scores can be used. Finally, a list of frequently asked questions is presented to address queries regarding the determination of the passing score, use of scaled scores, candidate performance comparisons, score reporting, exam preparation, and exam content.
Results and Scoring Schedule
Why are scores not provided immediately?
Calibration of the test items using Item Response Theory statistics is only one of the quality control procedures NBCOT uses as part of its score verification procedures. Additional quality control measures regarding test administration processes and procedures take place after administration of an examination and prior to sending an official feedback report in order to ensure candidates receive accurate information about their final scores.2