30 avril 2025
S’inscrire au Vretta Buzz
The underlying idea behind any benchmarking lies in the desire or ambition to improve, which requires the use of a specific method. In the context of educational assessment, this method may take the form of a review, self-evaluation, or benchmarking against international standards. The exercise of self-evaluation, as a simplified form of initial benchmarking, carries a powerful message that signals the readiness for a culture of feedback exchange, where the most meaningful learning occurs.
Recognizing the importance of self-evaluation, the International Association for Educational Assessment (IAEA) decided to develop not only a set of standards for assessment organizations - The International Standards for Educational Assessment Organisations (later referred as ‘the Standards’), but also implementation guidelines that begin with self-evaluation. This is a strategic approach to promoting a culture of reflection and continuous improvement, reinforcing the idea that, as in many other cases, the best teacher is ourselves, when we are open and honest about our current practices, without hesitation or pride. In this case, it is especially important to have competent evaluators or auditors who understand and follow the principles of this cycle, which is not only about demonstrating reputation through benchmarking, but also about promoting learning through the feedback-sharing process.
This article focuses on the benefits and insights gained from conducting benchmarking reviews, particularly in the context of the digitalization of assessments and the efforts of organizations pursuing modernization through technology in their assessment processes.
Many organizations with solid experience and seasoned team members naturally demonstrate confidence in the operations managed throughout the production cycle, which is a valuable strength when building products for end-users. However, incidents do happen, and none of us are free from the risks associated with the production line or service delivery. The best we can do is adopt a preventive mindset toward any risks that could negatively impact the workflow and be prepared to address them. Readiness in such cases can be either personal or institutional; while personal readiness may save a team or a few individuals, it will not help the institution as a whole. Thus, building institutional readiness to tackle or prevent incidents is a team effort, achieved by creating a transparent, integrated self-evaluation mechanism that fosters mutual understanding and a collaborative resilience mindset, continually strengthened through open discussions and feedback sessions.
The implementation process for the IAEA standards is a self-paced process that is driven mainly by the commitment of the assessment organization. The Standards themselves are the combination of processes structured into four sections, each guiding organizations through a comprehensive self-evaluation and improvement process in educational assessment.
Section 1 focuses on evaluating an organization’s processes against three key measurement standards: validity, reliability, and fairness, which highlight potential threats such as construct under-representation, construct irrelevance, and unacceptable reliability that can arise at any stage of the assessment cycle if not properly addressed.
Section 2 covers the organizational standards, focusing on the structure of the organization and the people contributing to its operations, emphasizing the importance of internal capacity and workforce competencies in maintaining high-quality assessment practices.
Section 3 introduces the operational process standards, detailing key phases of the assessment cycle, examination development, examination administration, marking, and grading and reporting, making sure that operational practices align with the overall goals of fairness, security, and accuracy.
Section 4 provides illustrative scenarios related to the organizational and operational standards covered in the previous sections, presenting critical questions to help organizations reflect on their practices and encouraging deeper, more practical engagement with the Standards.
Each section has a distinct focus and style, supporting organizations in systematically reviewing, analyzing, and improving their assessment processes in line with international best practices.
Level of Engagement | Purpose | Related Standard Section | Focus of Standard Section |
1.1 Initial Review (Self-Evaluation) | Review scope and content of the Standards to identify relevant standards and future directions. | Section 1 | Measurement standards: validity, reliability, fairness; threats like construct under-representation, irrelevance, and poor reliability. |
1.2 Reflective Review (Self-Evaluation) | Engage broader teams to identify conformity and gaps. | Section 2 and Section 3 | Section 2: Organizational standards (people, structure). Section 3: Operational standards (exam development, administration, marking, grading/reporting). |
2. Peer Evaluation | Independent review to validate practices and provide feedback for improvement. | Section 4 | Scenario-based self-review examples; key questions for reflection on organizational and operational practices. |
First of all, the concept of feedback was embedded in the foundation of the Standards when institutions were invited to participate in pre-pilot and pilot evaluations. The pre-pilot phase involved the Caribbean Examinations Council (CXC) and the Independent Examinations Board (IEB) of South Africa, while the pilot phase included the State Examination Center of Azerbaijan, the Hong Kong Examinations and Assessment Authority, the Aga Khan University Examination Board (Pakistan), the Singapore Examinations and Assessment Board, the Examinations Council of Zambia, and the Zimbabwe School Examinations Council, all of whom engaged in self-evaluation and provided feedback to the IAEA.
This core element of self-evaluation remains central, not only as a tool for validation but also as a means of generating feedback for the organization being evaluated, which fosters a sense of ownership and engagement in the process, helping organizations feel like active participants rather than outsiders in the learning environment. Consequently, such a start sets an example not only for individuals or teams, but also for interconnected teams working across an integrated workflow, promoting institutional maturity in applying self-evaluation mechanisms.
The IAEA Standards were established to provide a framework that promotes trust, validity, reliability, and fairness in educational assessment processes worldwide, which is a genuine cause to care for and the IAEA and founding members of the Standards definitely need to get credit for their work. By aligning operational practices with the IAEA’s educational assessment principles, organizations can reinforce not only the technical complexity of their systems but also the validity, fairness, and global credibility of their assessment processes. From a practical standpoint, Section 4 presents cases in the form of questions to help assessment organizations prepare for self-evaluation and engage peer evaluators, guiding them to align with the scope and content of the Standards, identify relevant standards for self-assessment, and determine future directions.
The FAQ section of the Standards documentation addresses the question, “Do the Standards cover the role of Information Technology (IT) in an educational assessment organization?”, indicating that the Standards incorporate guidance on a general IT framework and benchmarks of good practice. These are intended to help organizations establish the necessary infrastructure for assessment delivery, secure data management, and ensure privacy and access controls in digital assessment systems.
Since organizations may vary in their levels of maturity, scope, and the involvement of different providers in delivering certain parts of their services depending on the government context, I am pleased to offer support in adjusting the standards and practical questions to assist in the transformation of assessment organizations and to help them achieve operational excellence for the benefit of their youth and human resource potential.
Vali Huseyn is an educational assessment expert and quality auditor, recognized for promoting excellence and reform-driven scaling in assessment organizations by using his government experience, field expertise, and regional network.
He holds academic qualifications in educational policy, planning, and administration from Boston University (USA), as well as in educational assessment from Durham University (UK), with a set of competencies on using assessments to inform evidence-based policymaking. In his work connecting national reforms with international benchmarks, Vali has used CEFR and PISA as guiding frameworks to support improvement strategies for assessment instruments at the State Examination Center of the Republic of Azerbaijan, and more recently, provides consultancy in the same areas to the National Testing Center of Kazakhstan. Additionally, Vali serves as a quality auditor and provides institutional quality audit services in partnership with the Dutch organization RCEC, most recently for the national assessment agency CENEVAL in Mexico.
Vali also has hands-on experience in the CIS region, particularly in Azerbaijan, Kazakhstan, and Uzbekistan, and has strong familiarity with the educational landscape of the Kyrgyz Republic. Vali is fluent in four languages, Azerbaijani, Russian, Turkish, and English, which he uses in professional settings to support effective communication, overcome linguistic barriers, and deepen contextual understanding across countries in the region. He has also served as a consultant for the UNESCO Institute for Statistics, contributing to data collection on large-scale assessments in the post-Soviet region.
Feel free to contact Vali and ask for a meeting if you are interested in adopting the IAEA International Standards, through LinkedIn.
[1] Digitalization Review: A Guide to Modernizing the Assessment Life Cycle: https://www.vretta.com/buzz/digitalization-review/
[2] IAEA International Standards https://iaea.info/iaea-international-standards-update-faq/