The IMEAc Assessor Standard Framework (ASF) was developed to standardize and strengthen the competency of medical education assessors through a balanced evaluation of Knowledge, Practice, and Values (KPV). Applied during the Intensive Assessor Training Workshop 1/69, the framework demonstrated that most participants achieved the Competent Assessor level, with several showing potential for Professional or Expert roles. ASF supports targeted assessor development, balanced team composition, and clear professional progression. The evaluation also identified challenges in assessing long-term professional development, bridging theory and practice, and ensuring data consistency.

The implementation of the ASF marks a significant milestone for IMEAc. We can ensure that the accreditation of medical schools in Thailand remains rigorous, transparent, and aligned with international standards. IMEAc plans to address these gaps through  monitoring, mentoring programs, and assessor calibration activities.

Introduction to the Assessor Standard Framework (ASF)

The Institute for Medical Education Accreditation (IMEAc) has developed the Assessor Standard Framework (ASF) to standardize and enhance the competency of medical education assessors. This framework serves as a professional competency roadmap designed to standardize the assessment process. It ensures that all assessors possess a balanced integration of Knowledge (K), Practical Skills (P), and Professional Values (V).

Definition of Competency Levels

The ASF categorizes assessor expertise into four progressive levels:

1. Assessor Candidate: Individuals who have successfully completed the practical training workshop and are invited to serve as Assessor Interns.
2. Competent Assessor: Those who have demonstrated sufficient proficiency to transition from an intern status to a full Assessor.
3. Professional Assessor: Experienced assessors who have been evaluated and officially appointed as Lead Assessors.
4. Expert Assessor: Senior Lead Assessors appointed as experts, serving as guest speakers, consultants, or institutional representatives.

The KPV Dimensions of Competency

To ensure a holistic evaluation, the ASF utilizes the KPV dimensions:

• Knowledge (K): Mastery of TMC.WFME.BME standards and Quality Assurance (QA) mechanisms.
• Practice (P): Practical skills including information seeking (P2.1), analytical thinking and decision-making (P2.2), teamwork (P2.3), and presentation/feedback skills (P2.4).
• Values (V): Adherence to the THAI core values (Fairness, Accountability, Integrity, Transparency, Heartiness) and a commitment to continuous self-development.

Insights from the Intensive Assessor Training Workshop 1/69

Following the recent workshop involving 31 participants, the ASF was applied to evaluate readiness. The overall results indicate a high level of potential:

• Academic Proficiency: Most participants achieved near-perfect scores (90-100%) in the Knowledge (K1) assessment regarding TMC.WFME.BME standards.
• Competency Distribution: The majority of participants successfully reached the Competent Assessor (C) level, showing readiness for official registration.
• Leadership Potential: Several participants demonstrated exceptional performance, reaching the Professional (PF) or Expert (E) levels, particularly in teamwork and analytical thinking. These individuals are identified as future Lead Assessors.
• Values Alignment: Participants showed strong adherence to the THAI (Transparency and Trust, Heartiness, Accountability and Fairness, and Integrity) core values though the area of “Continuous Development” (V1) remains a focus for long-term monitoring.

The Benefit of ASF Implementation

By adopting the ASF, IMEAc ensures that the accreditation process is not only rigorous but also transparent and consistent. This framework allows for:

• Targeted Development: Identifying specific areas where assessors need further training.
• Balanced Team Composition: Strategically forming assessment teams by mixing different competency levels (e.g., pairing a Professional Lead with Competent Assessors).
• Professional Growth: Providing a clear career path for medical educators to advance from interns to nationally recognized experts.

Identified Gaps and Challenges

Despite the positive outcomes, the application of the ASF revealed certain areas for improvement:

1. Assessment of Long-term Development (V1): A high percentage of participants were marked as “NA” (Not Assessable) in the Continuous Development dimension. This suggests that short-term intensive workshops are insufficient to evaluate long-term learning behaviors and self-reflection.
2. Theory-Practice Gap: While knowledge scores were uniformly high, variance was observed in the Practical (P) dimensions. This highlights a need to better bridge the gap between “knowing the standards” and “applying them in complex, simulated scenarios.”
3. Data Consistency: Minor inconsistencies in recording evaluation symbols were identified, which may affect the precision of the assessor registry if not standardized.

The Way Forward

To further strengthen the IMEAc accreditation system, the following strategic actions will be implemented:

• Post-Workshop Monitoring: A system will be developed to monitor continuous development (V1) through post-training portfolios or real-world assessment reports.
• Mentoring Program: Expert (E) and Professional (PF) assessors will be assigned as mentors to guide Competent (C) assessors during actual site visits.
• Assessor Calibration: Periodic calibration sessions for evaluators will be conducted to ensure consistent grading and interpretation of the ASF criteria across all workshops.

Conclusion

The implementation of the ASF marks a significant milestone for IMEAc. By identifying both the strengths and the gaps within our assessor pool, we can ensure that the accreditation of medical schools in Thailand remains rigorous, transparent, and aligned with international standards.

References:

• IMEAc Assessor Professional Standard Framework
• Summary of Intensive IMEAc Assessor Training 1/69 Assessment Results