Criterion 4 – Student Assessment

Criterion 4 – Student Assessment

AUNQA requirements for Criterion 4

TRSU QA uses each one of AUNQA criterion requirements below to assess the relevant QA practice of a program.

4.1 Assessment alignment

A variety of assessment methods are shown to be used and are shown to be constructively aligned to achieving the expected learning outcomes and the teaching and learning objectives.

Diagnostic questions
  • To what extent do the assessments and examinations cover the content of the courses and the programme (content validity)?
  • To what extent do the assessments and examinations cover the objectives of the courses and of the programme as a whole (construct validity)?
  • Are a variety of assessment methods used? What are they?
  • Are the assessment methods constructively aligned to achieving expected learning outcomes? How are the constructive alignment evaluated?
4.2 Assessment and appeal policies

The assessment and assessment-appeal policies are shown to be explicit, communicated to students, and applied consistently.

Diagnostic questions
  • Are there clear regulations for assessment or examination? How are they communicated to students?
  • Are they applied consistently?
  • Are the students satisfied with the assessment procedures? Do students have complaints?
  • What is the appeal procedure? Did the students appeal? What is the cause?
4.3 Assessment for completion

The assessment standards and procedures for student progression and degree completion, are shown to be explicit, communicated to students, and applied consistently.

Diagnostic questions
  • Is there an assessment for students to progress to a higher level? When and how is it conducted?
  • Is there an assessment for students to complete a degree and receive an award? How is it applied?
4.4 Assessment criteria

The assessments methods are shown to include rubrics, marking schemes, timelines, and regulations, and these are shown to ensure validity, reliability, and fairness in assessment.

Diagnostic questions
  • Is the assessment criterion-referenced?
  • Are all the courses required to have rubrics and marking scheme for the assessment?
  • How are validity, reliability and fairness assured in assessment?
  • Are there safeguards in place to ensure objectivity?
4.5 Measuring achievement

The assessment methods are shown to measure the achievement of the expected learning outcomes of the programme and its courses.

Diagnostic questions
  • What are the assessment methods for the achievement of course learning outcomes? How are the achievement measured?
  • What are the assessment methods for the achievement of program learning outcomes? How are the achievement measured?
  • Is there a relationship between the achievement of courses and program learning outcomes? How is this explained?
4.6 Assessment feedback

Feedback of student assessment is shown to be provided in a timely manner.

Diagnostic questions
  • Is feedback of student assessment required by every course? When and how is the feedback provided to students?
  • Does the feedback help improve student performance in the final assessment? Why or why not?
4.7 Assessment review

The student assessment and its processes are shown to be continuously reviewed and improved to ensure their relevance to the needs of industry and alignment to the expected learning outcomes.

Diagnostic questions
  • When is the student assessment and processes reviewed? What is the review procedure?
  • What aspects of student assessment are subject to review or improvement?
  • How is the student assessment considered relevant to the need of industry?
  • How is the alignment of student assessment to the ELOs evaluated? How might it be improved?
Scoring for TRSU QA
TRSU-QA score12345
Items showing
QA practice
1 item2-3 items4-5 items6 items6 items +4.7
AUNQA scoring rubrics

A seven-point rating scale used for AUNQA assessment is described below.

1. Absolutely inadequate

The QA practice to fulfil the criterion is not implemented
There are no plans, documents, evidences or results available. 
Immediate improvement must be made.

2. Inadequate and improvement is necessary

The QA practice to fulfil the criterion is still at its planning stage or is inadequate where improvement is necessary. 
There is little document or evidence available. 
Performance of the QA practice shows little or poor results.

3. Inadequate but minor improvement will make it adequate

The QA practice to fulfil the criterion is defined and implemented but minor improvement is needed to fully meet them. Documents are available but no clear evidence to support that they have been fully used. Performance of the QA practice shows inconsistent or some results.

4. Adequate as expected

The QA practice to fulfil the criterion is adequate and evidences support that it has been fully implementedPerformance of the QA practice shows consistent results as expected.

5. Better than adequate

The QA practice to fulfil the criterion is better than adequate. Evidence supports that it (the QA practice) has been efficiently implemented. Performance of the QA practice shows good results and positive improvement trend.

6. Example of best practice

The QA practice to fulfil the criterion is considered to be example of best practices in the field. Evidences support that it has been effectively implemented
Performance of QA practice shows very good results and positive improvement trend.

7. Excellent (example of world-class or leading practice)

The QA practice to fulfil the criterion is considered to be excellent or is an example of world-class practices in the field. Evidences support that it has been innovatively implemented. 
Performance of the QA practice shows excellent results and outstanding improvement trends.

Guide to writing a self-assessment report (SAR)
  • The report is the account of the self-assessment. It is not only descriptive but also analytical. It identifies and evaluates the problems and also provides an indication of how the problems identified will be dealt with. (Use the diagnostic questions provided in each of the AUN-QA criteria to do this.)
  • Illustrate clearly what, where, when, who, and how the QA mechanisms or instruments are implemented and managed to fulfil the criteria. This will help to piece all related information together.
  • Focus on information and data (objective evidences) that directly address the criteria. The report has to be concise and factual. Provide trends and statistics to show achievement and performance.
What is the QA practice to fulfil the criterion?

Quality assurance practice should mean QA plan that evaluates and/or modifies organization’s procedures to ensure that they provide the desired results. The QA plan documents the planning, implementation and assessment procedures for a project, process or any QA activity.
The QA plan should provide information about some or all of the following.

  • An overview of the project or process describing background, need, scope, activities, and deadlines;
  • Quality objectives to be attained (for example, characteristics, effectiveness, cycle time, cost, etc.);
  • Steps in the process that constitute the operating practice or procedures of the organization;
  • Allocation of responsibilities, authority, and resources for different phases of the project/process;
  • Specific document describing standards, practices, procedures, and instructions to be applied;
  • Suitable testing, inspection, examination, and audit programs at appropriate stages;
  • A documented procedure for changes and modifications to a quality plan as a process is improved;
  • A method for measuring the achievement of the quality objectives;

    (Source: https://asq.org/quality-resources/quality-plans)

Operational Result

4.1 A variety of assessment methods are shown to be used and are shown to be constructively aligned to achieving the expected learning outcomes and the teaching and learning objectives.


The assessments in this course are designed to align perfectly with our established objectives and learning outcomes. These outcomes have been carefully defined to ensure that students acquire the necessary knowledge, skills, and competencies to succeed in the subject matter. The instructors have developed a variety of assessment tasks that target different aspects of the subject matter, allowing us to comprehensively evaluate students’ understanding and application of the key concepts.

Each assessment task has been meticulously aligned with the corresponding learning outcomes. For instance, our written exams evaluate students’ theoretical knowledge and analytical skills, while our formative assessments and classroom activities assess their ability to apply concepts in real-world scenarios. This targeted approach ensures that every assessment provides valuable insights into students’ progress towards achieving the intended learning outcomes.

Alignment of the assessments with the objectives and expected learning outcomes along with the evidences are given in the table below:

ObjectivesExpected Learning OutcomeAssessmentsEvidence
O1-To produce graduates capable of being responsible, moral and ethical aviation and support operators, and well adapted to international cultures.   O2-Be virtuous and ethical in life have professional ethics. Responsibility towards the profession, society and environmentHave morals and ethics, Discipline in the study and life. Responsibility towards oneself and society Good personalities and able to express themselves appropriatelyClassroom Participation   Submission of Assignments on time   Group Discussion   Class Attendance   Roleplays          Google Classroom   MIS attendance     Roleplay Report  
O3-To produce graduates with knowledge and understanding of the operation of important systems in aircraft. flight control systems, various systems in airports, aircraft communication systems, and modern technology in aircraft and aviationHave basic knowledge of mathematics and basic science including starting to learn about the basic rules of aviation, airports.   Have additional basic knowledge of air navigation and air traffic, Aircraft structure and materials, aviation regulations.   Able to apply basic knowledge of human factors in aviation, flight safety   Knowledge of various systems of the plane and human factors affecting flight   Have knowledge and understanding of aviation accident investigation principles, and learn various systems of aircraftAssignments   Quizzes   Class Tests   Mid-Term Exam   Final Exam   ProjectsTQF-03 Assessment plan   Google Classroom     Project Reports
O4- To produce graduates with the ability to adapt to rapidly changing technologies. can be learned according to the needs of the aviation industry and able to adapt to various societies and culturesHave knowledge and skills, good human relations high responsibility, professional ethics, have a high level of English language skills and practice to take the exam and become a pilot Air Cargo Aviation Support Officer or related businesses.   Have sufficient knowledge and skills for further study at a higher levelGroup Presentation   Projects based on online scientific toolsStudent Presentation     Airline Dispatch Project      
O5- To produce graduates with the ability to use the English language. This is the language that is set to be the main language of communication in the international aviation industry for efficient and effective communicationBe able to search for information and knowledge. Able to present or communicate in English.    Group Presentation      Student Presentation    
O6- Be able to perform various tasks in the aviation industryProfessional knowledge in the aviation industry, aviation regulations and safety   Have in-depth knowledge and skills in specific professional subjects and air navigation management such as meteorology, aircraft components and systems, flight performance aircraft performance control. Preparation of aviation information and airport managementProjects     Internship Presentation    Internship presentation

4.2 The assessment and assessment-appeal policies are shown to be explicit, communicated to students, and applied consistently.

Our institution recognizes the significance of clear and transparent assessment and assessment-appeal policies in fostering a fair and supportive learning environment. We have developed comprehensive policies that outline the procedures, expectations, and avenues for addressing any concerns related to assessments. We have employed simple language and structured the policies in a logical manner, making them easily comprehensible for students, faculty, and administrators. This logical structure allows readers to effortlessly find relevant information within the policies, making the document user-friendly and time-efficient.

Our policies contain detailed information on the different types of assessments used, including their respective weighting and criteria for evaluation. We have also included explicit instructions on assessment submission procedures, deadlines, and guidelines for ensuring adherence. Furthermore, our assessment-appeal policies provide a step-by-step process for students to challenge assessment outcomes if they believe there are grounds for review.

The assessment and assessment-appeal policies are clearly stated, easily accessible and effectively communicated to the students through the college website. The students are also encouraged by the teachers to read and understand the academic policies and regulations that are mentioned in the college website and students’ handbook which covers the information about admission, attendance, evaluation rules and regulations. The teachers ensure that the students understand both the assessment and assessment appeal policies for the transparency, equity and reliability of the assessments.

We are committed to ensuring the accessibility of our assessment and assessment-appeal policies. These policies are made readily available through our institution’s website, included in course materials, and shared through online platforms. We have taken measures to ensure that students, faculty, and administrators can easily access and refer to the policies whenever needed.

During the lecturer’s orientation and student orientation the assessment and assessment policies mentioned in the students handbook are discussed. Moreover, each teacher communicates their assessment method to the students during their orientation class and ask the students to follow them. 

The assessments methods also include class participation of the students, assignments, quizzes, individual and group presentations and projects.

Comprehensive procedures for assessment-appeal policies are clearly defined including the grounds for appeal, timelines, responsibility and guidelines for fairness and transparency.

4.3 The assessment standards and procedures for student progression and degree completion, are shown to be explicit, communicated to students, and applied consistently.

At our institution, we recognize the crucial role of clear assessment standards and procedures in guiding students’ progression and facilitating successful degree completion. We are committed to providing transparent information and guidelines to ensure students have a clear understanding of the expectations and requirements.

We have compiled all the assessment standards and procedures in comprehensive documents, including student handbooks and website. These resources serve as a central reference point, providing students with the necessary information on how their progression and degree completion will be assessed.

Our assessment standards set clear expectations for student progression and degree completion. These standards encompass criteria such as grade requirements, minimum credit hour thresholds, and demonstration of specific competencies or skills. By clearly defining these standards, students can track their progress and understand the milestones they need to achieve.

Our assessment procedures outline the step-by-step process that students must follow to progress and successfully complete their degrees. These procedures encompass submitting assignments by specified deadlines, taking scheduled exams, participating in practical or experiential components, and fulfilling any other requirements relevant to their chosen programs

We employ multiple communication channels to ensure that the assessment standards and procedures are effectively conveyed to students. These channels include online platforms where students can access relevant documents, official emails providing timely updates, and direct interactions with academic advisors who can provide personalized guidance.

We prioritize the accessibility of our assessment standards and procedures, ensuring that students can easily access and refer to them whenever needed. These documents are available online through our institution’s website and student portals, allowing students to review the information at their convenience.

4.4 The assessments methods are shown to include rubrics, marking schemes, timelines, and regulations, and these are shown to ensure validity, reliability, and fairness in assessment.

At our institution, we recognize the critical role of assessment methods in evaluating student performance. We have implemented a range of assessment techniques, such as rubrics, marking schemes, timelines, and regulations, to uphold the principles of validity, reliability, and fairness.

We utilize rubrics as a standardized assessment method to evaluate students’ work. These rubrics outline the criteria and performance levels that students are expected to meet. By providing clear guidelines, rubrics enable consistent and fair evaluation of student performance across different assessors and assignments

Our assessment methods include marking schemes, which provide a structured framework for assigning grades or scores to student assessments. These marking schemes are designed to ensure consistency and objectivity in the grading process, allowing students to understand how their work is evaluated.

We have established timelines and regulations that govern assessment-related activities. These guidelines define the deadlines for submission, specify the procedures for assessment-related tasks, and outline any additional requirements. Adhering to these timelines and regulations ensures the integrity and fairness of the assessment process.

We prioritize the validity of our assessment methods by aligning them with the intended learning outcomes of our programs. We carefully select and develop assessment tools that effectively measure students’ knowledge, skills, and abilities. Our assessments undergo rigorous review by subject matter experts to ensure their validity..

To promote reliability, we employ consistent and standardized assessment procedures across different assessors and assignments. We implement multiple markers or assessors to ensure independent and reliable evaluation. Clear guidelines for scoring and interpretation are provided to enhance the consistency and dependability of assessment results.

The teacher sets the questions for both the Mid-term and final examinations based on Bloom’s taxonomy focusing mainly on application, analysis, evaluation and creation to test and improve the intellectual and cognitive skills of the students. Each Exam paper then undergoes rigorous scrutiny done by the major Head and Dean-BBA to review for the validity, reliability and fairness of the questions and feed backs are provided to the teacher to update the questions.

We are dedicated to fair assessment practices that provide equitable opportunities for all students. Our assessment methods are designed to minimize bias and ensure fairness. We implement appropriate accommodations to address the diverse needs of our student population, promoting inclusivity and equal opportunities.

The program committee also reviews the examination papers after the declaration of results in terms of cognitive learning outcomes, rubrics, assessment methods and provide feedback to the teacher to improve the course next time in the future when the teacher handles it.

4.5 The assessment methods are shown to measure the achievement of the expected learning outcomes of the programme and its courses.

The assessment methods employed in our program and courses are carefully designed to align with the expected learning outcomes. We recognize that assessment serves as a critical tool to measure students’ achievement of these outcomes.

Our assessment methods utilize direct measures to evaluate students’ performance and mastery of the knowledge, skills, and competencies outlined in the program’s learning outcomes. These methods emphasize the assessment of students’ actual demonstration of their learning.

We employ a range of assessment methods, including exams, projects, presentations, and assignments, that have been carefully designed to align with the program’s learning outcomes. These methods enable us to assess students’ achievement of the desired knowledge, skills, and competencies.

Our assessment methods are accompanied by clear assessment criteria that directly correspond to the program’s learning outcomes. These criteria serve as benchmarks against which students’ performance and progress are evaluated and measured.

To ensure the validity of our assessment methods, they undergo rigorous validation processes. We carefully review and align them with the intended learning outcomes. Additionally, we employ reliability measures, such as multiple assessors, standardized scoring, and inter-rater reliability checks, to enhance the consistency and dependability of the assessment results.

Our assessment methods provide valuable evidence that informs decision-making processes at various levels. The assessment data we collect allows us to identify areas of strength within our program and courses, as well as areas that may require enhancement. This information guides curriculum development, instructional strategies, and overall program improvement.

 To assess the alignment between the assessment methods and learning outcomes, the following steps were undertaken:

  1. Review of Learning outcomes: The learning outcomes of each topic of all the courses are reviewed to reflect the knowledge, twenty first century skills and competencies that students are expected to acquire upon completion of the program and are proved to be meeting the program outcome but improvement can be done in the future since it is continuing process as the requirement of the industry changes dynamically.
  2. Evaluation of Assessment methods: The assessment methods employed within the institution were evaluated to determine how effectively they measured the achievement of the learning outcomes. These methods included exams, assignments, projects, presentations, and class participation used to gauge student performance.
  3. A detailed analysis was carried out throughout the academic year to assess the degree of alignment between the assessment methods and the course learning outcomes. This is done by examining the specific assessment tasks, criteria, and standards used to evaluate student performance and comparing them to the intended course learning outcomes by the program committee.

As a result of the analysis done, the mapping of the learning outcome of each topic aligned with the course learning outcome and program learning outcome has to be done and the teachers are advised to update their approach towards preparing their course plan and assessment plan in TQ3. A workshop was conducted to guide the teachers to improve their TQF3 by including the gaps that are found during the analysis. The teachers have prepared their TQF3 for the upcoming semester as per the guidelines given by the program committee.

The alignment between the assessment methods and learning outcomes ensures that students’ progress and attainment are accurately assessed. The major’s commitment to use diverse assessment formats, clear assessment criteria, and comprehensive coverage of the learning outcomes contributes to the effectiveness and validity of the assessment process. Continual monitoring and evaluation of the alignment between assessment methods and learning outcomes will further enhance the institution’s ability to measure student achievement and ensure the quality of education provided.

4.6 Feedback of student assessment is shown to be provided in a timely manner.

We recognize the importance of timely feedback in supporting student learning and growth. By providing feedback promptly, we ensure that students receive valuable insights into their performance, enabling them to make timely adjustments and enhance their learning experience.

Feedback for assignments and assessments is typically provided within a week, allowing students to receive valuable input promptly and make informed decisions about their learning.

We utilize a range of feedback delivery methods to ensure timely communication with our students. These methods include in-person discussions during office hours, written comments on assignments, or electronic feedback tools integrated into our Management Information system, Google Classroom and Line Groups. Such methods enable us to provide timely feedback that students can readily access and review. The feedback to the students were given to the students face to face to improve their attitude towards the learning participation, assignments and quizzes.

The students who complete their assignments, quizzes on time were assessed and appreciated by the teachers in their classes. The feedback to the students were given to the students face to face to improve their attitude towards the learning participation, assignments and quizzes.

The teachers assess each student through mid-term examination in the 8th week of each semester and evaluate their answers and provide feedback during their first meeting in the class after the mid-term exams on how they have done their examination and their expectation to improve the students grades in the final examination which is conducted in the 16th week of the semester. The students are also told to follow the rules and regulations of the examination which are mentioned in the student handbook. The students followed the teacher’s guidelines and feedback to progress positively and score good grades in their final examinations.

4.7 The student assessment and its processes are shown to be continuously reviewed and improved to ensure their relevance to the needs of industry and alignment to the expected learning outcomes.

At our institution, we place a strong emphasis on continuous improvement. We understand the dynamic nature of the industry and the importance of ensuring that our assessments are consistently relevant to industry needs and aligned with the expected learning outcomes. To achieve this, we regularly review and improve our student assessment practices.

Our assessment review process involves a collaborative effort from our faculty members, subject matter experts, and industry professionals. Through regular meetings, workshops, and consultations, we review the existing assessment methods to identify areas for improvement. This collaborative approach allows us to incorporate industry perspectives and ensure the ongoing relevance of our assessments.

We recognize that our students’ success in the industry relies on their ability to meet evolving demands. To address this, our assessment review process actively engages with industry partners and advisory boards. Their feedback and insights are invaluable in helping us identify and address any gaps in our assessment methods. We utilize this input to continuously improve our assessments and ensure they remain relevant and responsive to industry needs.

We ensure that our students are keeping up and continuously improving their knowledge and skills necessary for professional success and give significance to be able to meet the industry demands. In some of the courses, major learning outcomes are found to be not aligned with the industry requirements and improvement is needed.

The needs of the aviation industry were discussed by the teacher with the industry experts when the teacher have visited the industry to monitor the students’ internship. Based on this discussion the questions papers were prepared by the teachers for assessing the junior students in mid-term and final examinations.

The program committee reviews the exam paper prepared by the teacher for the questions and gave feedback to include application-oriented questions to make sure that students are exposed to real problems in the industry, so the students can give solutions to them by using their acquired knowledge and cognitive skills.

Evidence

ID_EvidenceName_Evidence
4.14.1.1. O1 & O2
4.1.1.1. Submission of Students work in Google Classroom
4.1.1.2. MIS-Attendance
4.1.1.3. Moral and ethics
4.1.1.4. Roleplays
4.1.2. O3
4.1.2.1. TQF-03 
4.1.2.2. Formative Assessment in Google Classroom
4.1.2.3. Sample Continuous Assessment Score
4.1.2.4. Project Reports
4.1.3. O4
4.1.3.1. Student Presentation
4.1.3.2. Airline Dispatch Project
4.1.4. O5
4.1.4.1. Student Presentation
4.1.5. O6
4.1.5.1. Airline Dispatch Project
4.1.5.2. Internship Presentation Report
4.2 4.2.1. Website link – Assessment and Assessment appeal procedures
4.2.2. Student Handbook
4.34.3.1. Student Handbook
4.3.2. Website link- Regarding Assessment Standards
4.3.3. Management Information System of Lecturer – Advisor portal
4.3.4. Advisor Report
4.3.5. Lecturer communication with students regarding Assessment Standards
4.3.6. Register office – Student communication
4.3.7. STIC Facebook Page
4.44.4.1. Sample rubrics & Marking Schemes
4.4.2. Assessment Guidelines and Policies
4.4.3. KM workshop on Linking Assessment with Teaching Plans
4.4.4. TQF-03 & TQF-05 Review sample 
4.4.5. Verification of Learning Outcomes Guidelines
4.54.5.1. Learning Outcome Alignment with Assessment Methods
4.5.2. TQF-03- Section 3
4.5.3. Sample Rubrics and scoring criteria
4.5.4. Project evaluation reports
4.5.5. Internship Evaluation Reports
4.5.6. Employer survey
4.5.7. TQF-05 sample
4.5.8. Student’s sample Continuous Assessment Score
4.5.9. Verification of Learning Outcomes
4.64.6.1. Feedback of the lecture given in Google Classroom
4.6.2. Sample Continuous Assessment Score
4.6.3. Results of Feedback (Mid-Term & Final Score)
4.74.7.1. TQF-3 & 5 reviews
4.7.2. Exam paper review
4.7.3. Student Course Evaluation
4.7.4. Lecturer Evaluation by Students
4.7.5. Meeting with stakeholders
4.7.6. Internship supervisor evaluation report

Assessment scores

RequirementsSelf scoreAssessors’
4.1 A variety of assessment methods are shown to be used and are shown to be constructively aligned to achieving the expected learning outcomes and the teaching and learning objectives.1
4.2 The assessment and assessment-appeal policies are shown to be explicit, communicated to students, and applied consistently.1
4.3 The assessment standards and procedures for student progression and degree completion, are shown to be explicit, communicated to students, and applied consistently.1
4.7 The student assessment and its processes are shown to be continuously reviewed and improved to ensure their relevance to the needs of industry and alignment to the expected learning outcomes. 1
4.4 The assessments methods are shown to include rubrics, marking schemes, timelines, and regulations, and these are shown to ensure validity, reliability, and fairness in assessment.1
4.5 The assessment methods are shown to measure the achievement of the expected learning outcomes of the programme and its courses.1
4.6 Feedback of student assessment is shown to be provided in a timely manner.1
Overall5

Leave a Reply