Data-Driven Psychometric Services

We support our clients through all areas of their exam program. Competency profile/Job Task Analysis (JTA) is the process of establishing industry relevant competencies at a specific level of proficiency required for successful performance in a field. Generally competency profile/JTA development is a multi-step process involving interviews, surveys, focus groups and so on, all of which For Good Measure can guide an organization through to best support the foundations of a client’s exam program.

A high-quality examination blueprint is a recipe for the assembly of a defensible exam. Multiple-choice exams to OSCEs, live or remote sessions, we will design and conduct processes to create blueprints to fit your circumstances and needs.

The development of test questions and tasks (e.g., OSCE – Observed Structured Clinical Examinations) is the single-most time and resource-intensive activity that testing organizations will conduct. For Good Measure staff has deep experience in the fundamentals of a successful item or task. For Good Measure offers innovative AI Assisted Item Development approaches that dramatically increases the number of items that can be developed in a far shorter period of time at less cost than traditional item development.

We offer industry leading innovative solutions to significantly reduce the manual work required of SMEs to identify enemy items within their item banks. Our in-house developed proprietary item enemy detection tool identifies potential item enemy pairs with high accuracy, dramatically reducing the number of potential enemy pairs requiring review by SMEs from many thousands to a manageable handful.

The assembly of a defensible exam requires many constraints to be satisfied beyond the blueprint. For a licensing exam, constraints for cognitive level, gender, passages, images, specific competencies, average difficulty, discrimination, and common items are typical. For Good Measure uses optimization technology for assembly so you can administer an exam with the precise characteristics you require and one that’s fair to your test takers.

Item analysis is the critical step where your organization gains insight into how your candidates are understanding your items. Classical or Item Response Theory, For Good Measure will provide not only the key statistics but also a concrete interpretation of the numbers so you can have clarity about how your items are functioning and what specific changes could make them better.

The function of a certification or licensing exam is to make sound decisions about the capabilities of test takers. These decisions have profound effects as they determine whether the public is protected when they engage the services of a professional and also if the candidate is able to earn a living in the occupation they’ve trained for. Standard setting sets the threshold for determining the readiness of candidates for professional practice and is one of the key services offered by For Good Measure. From modified Angoff to Nedelsky, Borderline regression to Bookmark, we can facilitate a session that best fits your program.

In testing, accuracy and interpretability go hand in hand. Though accurate numbers reveal the capabilities of candidates, well-designed reports allow those numbers to make sense to people. For Good Measure takes care of both. Response data are always double-scored and matched to ensure 100% accuracy; carefully crafted reports reveal the desired interpretations and discourage inappropriate ones.

Unfortunately cheating on tests and content theft is a reality that all organizations that administer assessments need to prevent and address in order to ensure the validity of their exam programs. For Good Measure are experts in collusion detection (assessing whether candidates are copying/sharing item answers with one another) and whether test security issues are present. We don’t just do the analyses and throw the analyses over the fence to our clients to deal with, we support our clients completely, walking them through the detected collusion/test security issues and recommending appropriate courses of action.

Designing, developing, and implementing a technical entry to practice examination is no small task but likely For Good Measure is here to guide our clients through the process. We are experts in not only the technical design of entry to practice exams but also in development of the exam program through all of the psychometric processes from competency profile development to blueprinting to item development to exam delivery. In addition we guide our clients through the policies and financial options that future-proof high-stakes exam programs to be self-sufficient and well funded.

Practice tests are an invaluable resource to candidates preparing to take their exam. In addition, practice tests can generate supplementary funds for regulators and exam providers. For Good Measure is able to leverage our knowledge and expertise to offer clients efficient approaches to develop the surplus items required to not only populate a practice test program but set it up online to collect fees and allow candidates to access the practice tests 24/7/365 from anywhere in the world.

Ensuring that your exam program meets international recognized standards in the assessment industry is top of mind for our clients. For Good Measure offers defensibility audits which compare a clients exam program with internationally recognized standards for high-stakes assessment identifying strengths and weaknesses with recommendations. Our clients value our hands-on approach which provides more than a generic report that is of limited use. For Good Measure ensures that our clients are provided with a path forward to address defensibility gaps in their exam program and enhance the organization’s defensibility strengths.

Transitioning from paper-based exams to computer-based exams offer many benefits including enhanced security, remote proctoring options, and faster turnaround of results to name a few. At For Good Measure we have over 45 years of combined experience helping organizations move their paper-based exams to online modern, secure, reliable item authoring, banking, and exam administration platforms.

Assessing practical knowledge, skills and abilities is a fundamental need of regulators and there are many options to approach assessment of these areas such as an OSCE. For Good Measure has extensive experience designing, building and implementing clinical exams, practical exams, and OSCE and performance based examinations including scale development, scoring models, and standard setting approaches.

For Good Measure has conducted numerous special studies for organizations ranging in topics from approaches to standard setting with small sample sizes, proposing methodologies to evaluate the defensibility of using third party exams (e.g., US certification/licensing exams), to evaluating the entry to practice requirements for applicants (Canadian and internationally educated) and the assessment approaches that best support the assessment of candidate competence.