Roles and Responsibilities of Stakeholders
Subject Matter Experts
- The content/domain experts
- May be experienced people in the area being assessed (e.g., people who have done the job that is being assessed)
- Writes questions to add to the item bank
- Mark/grade constructed response questions
- Participate in standard setting sessions
- Review questions written by others and ensure alignment to programs of study
- Review assessments to ensure appropriateness to target candidates
Item Bank Administrators
- The person(s) responsible for maintenance and management of the item bank
- Ensures that items and assessments are entered and stored in the bank appropriately
- Manages access rights and privileges for uses of the bank
- Monitors and reports on item exposure
- Works with IT/database experts to ensure scalability and technical stability of bank
Psychometricians
- The test measurement expert within an organization
- Conducts and interprets item and test analyses (e.g., classical test theory, item response theory)
- Conducts standard setting sessions (e.g., modified Angoff, Bookmark method, etc.) to help set cut scores (pass scores)
- Designs and implements statistical equating models to allow for the comparison of results over time or across assessments
- Conducts analyses regarding demographic difference to ensure fairness (e.g., differential item functioning – DIF)
- Designs and interprets reports at various levels
- Designs beta test (field test or pilot test) models to obtain preliminary statistics on questions
- Conducts validity studies
- Evaluates and monitors test reliability
Test Sponsor/Program Management
- Specify general and infrastructure requirements
- Document roles and responsibilities
- Documents candidate, check-in/check-out staff, proctor/invigilator, and support staff eligibility requirements
- Define late arrival acceptance policies
- Documents candidate pre-screening requirements
- Document how the test administration process should be documented
- Specify the proctor/candidate ratio and support staff
- Specify any support staff ratio and support staff
Program Administration
- Administers and/or delegates administration of security policies and procedures (such as check, or delegate checking of eligibility) to meet the requirements specified by the Test Sponsor
- Ensure documentation is maintained and distributed as per the requirements of the Test Sponsor
- Handle exceptions
Candidate
- The individual taking the assessment
- Also sometimes referred to as participant or examinee
- Meet eligibility requirements Enroll Check In Take Test Maintain confidentiality
Check In/Out staff
- Ensure that the Test Sponsor's requirements for checking in and checking out candidates are met which may include:
- Check the identity of the candidate preparing to take the test
- Check any on-site eligibility requirements of the candidate preparing to take the test are met
- Maintain documentation (computerized or otherwise) to maintain an audt trail of the test administration process
- Ensure documentation is distributed as per the requirements of the Test Sponsor
This website is maintained by