Criterion 8 – Output and Outcomes
Requirements for AUNQA Criterion 8
8.1 Pass and dropout rates
The pass rate, dropout rate, and average time to graduate are shown to be established, monitored, and benchmarked for improvement.
Diagnostic questions
- Does the programme have an efficient system to monitor the pass rates and dropout rates of students?
- What does the programme think of the pass rates? If not satisfactory, what measures are taken to improve the pass rates?
- What is the dropout rate? Are there explanations for the dropout rate?
- Does the department know where the dropout students go to?
- What does the department think of the average time to graduate?
- What measures have been taken to promote graduation and to shorten the average time to graduate?
- What effects do these measures have?
8.2 Employability
Employability as well as self-employment, entrepreneurship, and advancement to further studies, are shown to be established, monitored, and benchmarked for improvement.
Diagnostic questions
- What percentage of graduates find a job within six months of graduation over the past five years? What percentage of graduates found a job within one year of graduation?
- What percentage of graduates are still unemployed one year after graduation?
- Do the graduates get jobs easily? What are the career prospects of the graduates over the last five years?
8.3 Research and creative work
Research and creative work output and activities carried out by the academic staff and students, are shown to be established, monitored, and benchmarked for improvement.
Diagnostic questions
- What types of research activities are carried out by the students? Are these activities aligned to the expected learning outcomes and the vision and mission of the university and faculty?
- What types of research activities are carried out by academic staff? Are these activities aligned to the vision and mission of the university and faculty?
- What is the level of research grants and how is it utilised?
- What is the number of research papers published? Are the research papers published in national, regional, and/or international journals?
8.4 Outcomes achievement
Data are provided to show directly the achievement of the programme outcomes, which are established and monitored.
Diagnostic questions
- Is the quality of the graduates satisfactory?
- Do the achieved standards match the expected standards?
8.5 Stakeholders’ satisfaction
Satisfaction level of the various stakeholders are shown to be established, monitored, and benchmarked for improvement.
Diagnostic questions
- What mechanisms are available for staff to express their satisfaction or dissatisfaction about the programme, resources, facilities, processes, policies, etc?
- What indicators are used to measure and monitor the satisfaction level of staff?
- What initiatives are carried out to raise the satisfaction level of staff? Are they effective?
- Does the department know what students think about the courses, programme, teaching, examinations, etc?
- How does the department cope with the feedback and complaints from students?
- What is the opinion and feedback of the graduates about the competencies that they have acquired?
- How is feedback from the alumni used to improve the programme?
- Are employers satisfied with the quality of the graduates?
- Are there any specific complaints about the graduates
- Are specific strengths of the graduates appreciated by the employers?
Scoring for TRSU QA
| TRSU QA score | 1 | 2 | 3 | 4 | 5 |
| Items showing QA practice | 1 item | 2 items | 3 items | 4 items | 5 items |
AUNQA scoring rubrics
A seven-point rating scale used for AUNQA assessment is described below.
1. Absolutely inadequate
The QA practice to fulfil the criterion is not implemented.
There are no plans, documents, evidences or results available.
Immediate improvement must be made.
2. Inadequate and improvement is necessary
The QA practice to fulfil the criterion is still at its planning stage or is inadequate where improvement is necessary.
There is little document or evidence available.
Performance of the QA practice shows little or poor results.
3. Inadequate but minor improvement will make it adequate
The QA practice to fulfil the criterion is defined and implemented but minor improvement is needed to fully meet them. Documents are available but no clear evidence to support that they have been fully used. Performance of the QA practice shows inconsistent or some results.
4. Adequate as expected
The QA practice to fulfil the criterion is adequate and evidences support that it has been fully implemented. Performance of the QA practice shows consistent results as expected.
5. Better than adequate
The QA practice to fulfil the criterion is better than adequate. Evidence supports that it (the QA practice) has been efficiently implemented. Performance of the QA practice shows good results and positive improvement trend.
6. Example of best practice
The QA practice to fulfil the criterion is considered to be example of best practices in the field. Evidences support that it has been effectively implemented.
Performance of QA practice shows very good results and positive improvement trend.
7. Excellent (example of world-class or leading practice)
The QA practice to fulfil the criterion is considered to be excellent or is an example of world-class practices in the field. Evidences support that it has been innovatively implemented.
Performance of the QA practice shows excellent results and outstanding improvement trends.
Guide to writing a self-assessment report (SAR)
- The report is the account of the self-assessment. It is not only descriptive but also analytical. It identifies and evaluates the problems and also provides an indication of how the problems identified will be dealt with. (Use the diagnostic questions provided in each of the AUN-QA criteria to do this.)
- Illustrate clearly what, where, when, who, and how the QA mechanisms or instruments are implemented and managed to fulfil the criteria. This will help to piece all related information together.
- Focus on information and data (objective evidences) that directly address the criteria. The report has to be concise and factual. Provide trends and statistics to show achievement and performance.
What is the QA practice to fulfil the criterion?
Quality assurance practice should mean QA plan that evaluates and/or modifies organization’s procedures to ensure that they provide the desired results. The QA plan documents the planning, implementation and assessment procedures for a project, process or any QA activity.
The QA plan should provide information about some or all of the following.
- An overview of the project or process describing background, need, scope, activities, and deadlines;
- Quality objectives to be attained (for example, characteristics, effectiveness, cycle time, cost, etc.);
- Steps in the process that constitute the operating practice or procedures of the organization;
- Allocation of responsibilities, authority, and resources for different phases of the project/process;
- Specific document describing standards, practices, procedures, and instructions to be applied;
- Suitable testing, inspection, examination, and audit programs at appropriate stages;
- A documented procedure for changes and modifications to a quality plan as a process is improved;
- A method for measuring the achievement of the quality objectives;
(Source: https://asq.org/quality-resources/quality-plans)
Operational Result
8.1 The pass rate, dropout rate, and average time to graduate are shown to be established, monitored, and benchmarked for improvement.
…..
8.2 Employability as well as self-employment, entrepreneurship, and advancement to further studies, are shown to be established, monitored, and benchmarked for improvement.
……
8.3 Research and creative work output and activities carried out by the academic staff and students, are shown to be established, monitored, and benchmarked for improvement.
…..
8.4 Data are provided to show directly the achievement of the programme outcomes, which are established and monitored.
…….
8.5 Satisfaction level of the various stakeholders are shown to be established, monitored, and benchmarked for improvement.
…….
Evidence
| ID_Evidence | Name_Evidence |
| 8.1-1 | |
| 8.1-2 | |
| 8.2-1 |
Self-Assessment
| Requirements | Result | Score |
| 8.1 The pass rate, dropout rate, and average time to graduate are shown to be established, monitored, and benchmarked for improvement. | / | 1 |
| 8.2 Employability as well as self-employment, entrepreneurship, and advancement to further studies, are shown to be established, monitored, and benchmarked for improvement. | / | 1 |
| 8.3 Research and creative work output and activities carried out by the academic staff and students, are shown to be established, monitored, and benchmarked for improvement. | / | 1 |
| 8.4 Data are provided to show directly the achievement of the programme outcomes, which are established and monitored. | / | 1 |
| 8.5 Satisfaction level of the various stakeholders are shown to be established, monitored, and benchmarked for improvement. | / | 1 |
| Overall | 5 | |