Apply For the Award

Site: AMEE ESME
Course: ASPIRE submission home
Book: Apply For the Award
Printed by: Guest user
Date: Sunday, 22 December 2024, 1:59 PM

Description


Award Information

This section provides further details about the ASPIRE 'Assessment of Students' Award.

Please take the time to go through this content thoroughly to familiarize yourself with the application criteria and the expert panel involved in the process. Understanding these elements is crucial for a successful application. 

At the end of the content, you will need to fill out the web form to generate the invoice. Completing this form is an essential step in your application process, as it will allow you to proceed with the payment for your selected award. Make sure to provide all the required information to ensure a smooth and efficient processing of your request.

To navigate, use the 'next' and 'back' arrows at the side of the page, or use the Table of Contents to jump to a specific page.

You can also download pdf versions of this guidance and a sample application form for reference.

About the Award

For an institution to be regarded as achieving excellence in the area of assessment there should be evidence of an outstanding programme of assessment which can be demonstrated to actively promote learning in order to achieve the curriculum objectives, provide a fair assessment of learner achievement and ensure patient safety by only allowing competent individuals to progress and graduate.  

It is recognised that cultural, social and other issues are likely to have an influence on assessment in a medical, dental and veterinary school and that how assessment manifests itself will vary from school to school.  It should be noted that excellence may be found in institutions with limited access to resources just as much as wealthier institutions. The way in which institutions demonstrate cost effectiveness and context appropriateness will be taken into account by the panel when reviewing individual submissions.  If a criterion is not appropriate or relevant, given specific regional or cultural issues, please explain.   

The notion of excellence also embodies the active engagement with scholarship and a desire to seek continuous improvement in the area of assessment of competence.  Please provide evidence that the school represents cutting-edge thinking with regard to assessment.   Examples should be given of innovative practices in the area of assessment. 

For a school to be assessed as excellent in relation to assessment, supporting evidence must be provided.   

Expert Panel

  • Katharine Boursicot (Chair), Singapore
  • Valdes Bollela, Brazil
  • Christy Boscardin, USA
  • Katy Cobb, UK
  • John Cookson, UK
  • Kevin Eva, Canada
  • Sandra Kemp, Australia
  • Debra Klamen, USA
  • Dianne Manning, South Africa
  • Chris Roberts, Australia
  • Maria Rachid, Lebanon
  • Michael Tweed, New Zealand
  • Rukhsana Zuberi, Pakistan
  • Barry Quinn, UK
  • Anais Deere, UK

Prospective applicants are strongly encouraged to contact the panel chair for an informal discussion before beginning their application. 

Criterion 1

The assessment programme serves and supports the mission of the institution and the goal of medical, dental and veterinary education globally in enhancing and improving the health of both populations and individuals. 

Examples of evidence that might be provided: 

  • Context, vision, and mission statements of the school. 
  • Overall academic program map and its outcomes, showing the alignment with context, vision, and mission, setting out what the School wishes to achieve in its programme, whether it claims any distinctive features and in particular whether it aims to address a particular health need. 
  • A description of the assessment program, detailing how the assessment system fits into the context and vision. 
  • Outline where assessment fits into the overall academic programme, its purpose at different parts of the curriculum, and how specific assessment activities are combined to facilitate decision-making/student guidance. o Institutional policy documentation that outlines the assessment philosophy/fit between assessment and curricular activities. 
  • A description of the process to ensure the needs of the community are represented in the assessment program, possibly including anonymous surveys of stakeholders. 
  • Mission statement of the university juxtaposed with map of assessment program. 
  • Narrative explanation of ways in which the assessment programme tailoring takes place. 
  • Copy of policy statements that outline the goals of the assessment programme along with some indication of how/when students are kept informed of these goals. 
  • Justification that the assessments used represent good practice.
  • Narrative outlining the philosophy used/justifying the approach(es) adopted. 
These examples are provided by reviewers and are intended to be indicative rather than exhaustive. You may have other evidence that would be equally important and which support your case for excellence. 

Criterion 2

The assessment programme supports, enhances, and creates learning opportunities.

Examples of evidence that might be provided: 

  • Institutional policies or instructions that require strong alignment and examples of that alignment. 
  • Evidence that the outcomes of the course support the aims, that the learning processes enable students to meet the outcomes, and that the assessment will make it clear to all whether or not these have been achieved. Blueprints are often helpful here. 
  • Evidence that the various assessment methods used are appropriately related to what is being assessed. 
  • A description of the mechanisms used to provide feedback and an anonymous survey of students. 
  • Student testimonials/surveys (ideally collected/submitted by third party). 
  • Evidence that the results of formative assessments are available in a timely fashion both to students to inform their study and to faculty to inform their teaching and course design. 
  • A description of the ways advice/support is given to students and anonymous survey of students regarding their perceptions of this process. 
  • Evidence that feedback is not only timely, but descriptive and specific, allowing students to identify strengths and weaknesses and act upon them. 
  • Sample copy of documentation/feedback given to learners in response to each assessment activity. 
  • Institutional policies or instructions that require the use of performance data in curriculum and staff development supported by surveys of students and faculty. 
  • Description of work/information flow of assessment data/analyses. o Evidence that students’ performance is collected, analysed and fed back to teachers and those responsible for curriculum development. 
  • Examples of how data has been used first to modify the course and then to measure any change which may have resulted from the modification. 
  • Anonymous survey of faculty regarding the timing and amount of feedback they provide. o Evidence that the timing of assessments supports the learning so that not only are assessments related to recent learning, but that subsequent assessment builds on prior learning and assessment to reinforce integration of knowledge into practice 
  • Evidence that the amount of assessment achieves its purpose/the outcomes. 
  • Assessment is not overwhelming for students and faculty (anonymous faculty and student surveys). 
  • A description of the remediation process and an anonymous survey of students who have required remediation and faculty who have been engaged with it. An evaluation report on the nature and effectiveness of the remediation program.
  • Policy statements, governance structure, and indication of how the process takes place, how many students are involved, and evidence that the support is effective. 
  • Evidence of a clear assessment process which is easily available to students and staff. 
  • Evidence of proactive methods in identifying students with difficulties. 
  • Evidence of clear responsibility within the School and appropriate training for those individuals.
These examples are provided by reviewers and are intended to be indicative rather than exhaustive. You may have other evidence that would be equally important and which support your case for excellence. 

Criterion 3

The assessment programme ensures the competence of students as they progress. 

Examples of evidence that might be provided: 

  • Copies of the guidelines that are shared with each group of stakeholders as well as an indication of when, where, and how they are shared; any evaluation reports from regulatory bodies or other internal/external groups. 
  • Policy documentation already mentioned above. 
  • Evidence that those few students who are judged unsuitable for a medical career are correctly identified and appropriate action taken. 
  • Description of the assessment program (above), description of the competencies that are valued, alignment of the two with details about the measures. 
  • Explicit blueprint documenting how the assessment program has been built to cover variety of competencies of interest/levels of Miller’s pyramid, etc. 
  • How does the school set the ‘cut-point?’ Details of how the School deals with the uncertainty around the ‘cut point’ 
  • Utility indicators (i.e., evidence of quality assurance analyses and continuous quality improvement efforts – reliability/ validity/ feasibility/ acceptability/ educational impact) for individual measures where appropriate as well as overall program (accompanied by some explicit statement about where/when/why compromises are made to prioritize different aspects of utility in different aspects of the assessment program). 
  • Specific evidence that, as far as possible, the assessments are ‘passing’ competent students and identifying and not allowing progression of those not yet competent. o Description of the appeals policies and process; summary of appeals over a period of time; data on recent outcomes. Should be in policy documents alluded to above. 
  • Evidence that the process of appeal is independent of the original decision. 
  • The use of exemplars could be used to strengthen this section. 
These examples are provided by reviewers and are intended to be indicative rather than exhaustive. You may have other evidence that would be equally important and which support your case for excellence. 

Criterion 4

The assessment programme is subject to a rigorous and continuous quality control process.

Examples of evidence which might be provided: 

  • Description of the process, examples of quality control output, evaluation reports, description of actions taken, and/or related policies. 
  • Evidence of a clear system for quality control and enhancement. o Evidence of how utility indicators improved with quality control. 
  • Description of all external reviews and copies of all external review reports.
  • Provision of reports conducted by external reviewers along with dates/description of process used. 
  • A list of all external reviews, the recommendations emanating from each, the responses to each, evaluation report after change. 
  • Narrative indicating how process was changed in response to external examiners recommendations (ideally with indication of whether or not changes were effective).
  • Evidence of feedback leading to change and further review. 
  • A curriculum for faculty training on assessment, a list of available faculty development workshops/educational experiences, the number of faculty participants, the intensity of faculty participation, the requirement for faculty participation. 
  • Description of faculty development offerings that focus on assessment along with indication of number/proportion of faculty who have taken advantage of their availability. 
  • Evidence of training programmes, which are congruent with the assessment processes. 
  • Evidence of the take up of such programmes particularly by staff that have assessment responsibilities. 
  • List of contributors to assessment, their relevant backgrounds, their roles, and their contributions.
These examples are provided by reviewers and are intended to be indicative rather than exhaustive. You may have other evidence that would be equally important and which support your case for excellence. 

Criterion 5

The assessment programme demonstrates a commitment to scholarship and innovation, including the dissemination of good practice. 

The panel takes a broad view of scholarship, recognising that an impact of ‘knowledge’ through educational research, publications and presentations can be challenging to achieve for some organisations. The panel encourage applicants to look how this activity can be evidenced in other ways - e.g. through the impact on ‘people’ (advisory and faculty development), improvements in ‘processes’ (e.g. assessment techniques or innovative uses of technology) and policies (e.g. contribution to work that enhances assessment policy more widely, such as leadership or membership of national or international groups). 

Examples of evidence that might be provided: 

  • List of innovations in assessment with associated evaluation reports (local or external). 
  • Description of what is new, different, unique about the institution’s approach to assessment. Explanation and evidence for these claims. 
  • Evidence of the adoption of newer, evidenced-based assessment methods to replace older traditional methods. 
  • Evidence that assessment methods are generally well supported by the assessment literature either as practical and effective processes or by good theoretical justification (this can be through the application of others’ work to justify the innovation in the applicant). 
  • Reports of impact, innovation and scholarship, evidence of uptake elsewhere in the institution (e.g. supporting innovation in other departments) or at other institutions. Evidence can include testimonials, successful grant funding for work in assessment, and indications that the work described in these outlets has been implemented locally. 
  • Evidence that a School is sufficiently confident in its processes as to be willing to share and debate them with others (e.g. providing support, guidance and critical friendship to other individuals and/or institutions). 

These examples are provided by reviewers and are intended to be indicative rather than exhaustive. You may have other evidence that would be equally important and which support your case for excellence. 

Ready to apply?

Before deciding to submit an application, we recommend that you spend some time discussing the application criteria and required evidence with your team. If you have any questions, please reach out to us prior to submitting your application.

Institutions may be helped in the preparation of their submission by reference to the latest literature such as those suggested here:

Dijkstra, J., Galbraith, R., Hodges, B. D., McAvoy, P. A., McCrorie, P., Southgate, L. J., Van Der Vleuten, C. P., Wass, V., & Schuwirth, L. W. (2012). Expert validation of fit-for-purpose guidelines for designing programmes of assessment. BMC Medical Education, 12(1), 20. https://doi.org/10.1186/1472-6920-12-20

Norcini, J., Anderson, M. B., Bollela, V., Burch, V., Costa, M. J., Duvivier, R., Hays, R., Palacios Mackay, M. F., Roberts, T., & Swanson, D. (2018). 2018 Consensus framework for good assessment. Medical Teacher, 40(11), 1102–1109. https://doi.org/10.1080/0142159X.2018.1500016

Pricing

The standard charge per submission is £2,500 for each Area of Excellence to be assessed. This is reduced to £2,000 per submission for two or more submissions in the same twelve-month period. The charge for institutions from emerging economies is £1,500 per submission, and £1,250 for two or more submissions in the same calendar year. View the list of emerging economies to see if your institution is eligible. Payment must be received before submissions are sent out for review. Resubmissions are accepted within three years of the original application, with a charge of £2,000 for a resubmission.

Standard Charge

£2,500

Emerging Economies Charge

£1,500

Multiple Standard Submissions

£2,000 per submission
for two or more submissions
in the same twelve-month period.

Multiple Emerging Economies Submissions

£1,250 per submission
for two or more submissions
in the same twelve-month period.

Request an invoice

Complete the form below to request an invoice.












Which ASPIRE Award(s) do you wish to apply for?









*Please note that to apply for the Inspirational and Innovative Approaches award, you must have submitted a letter of intent by Dec 18th and received an invitation to make a full application

Have you applied for an ASPIRE Award in the same area(s) in the last three years?