Component 4: Indicator 4.1 Measurement, Analysis (Measurement, Analysis, and Improvement)

Component 4 Knowledge Management

Indicator 4.1 Measurement, Analysis (Measurement, Analysis, and Improvement)

MHESI IQA (Items 1-8) assessment is indicated in the table below

1 mark2 marks3 marks 4 marks 5 marks
1 item2 items 3-4 items 5-6 items 7-8 items

According to EdPEx standard, the total score to assess items 1-6 is 40 marks, the factors used to evaluate the process are ADLI.

Performance

1. Performance Measurement (Performance Measures). How does the dean track data and information on daily operations and overall organizational performance?

The Faculty chooses performance indicators from each key strategic component including graduate production, research and innovation, academic service, art and culture, and administration and management, whereby the Faculty has defined key performance indicators as follows:

Component

Strategic Objective

Performance Indicators

Graduate production ( Curricular, instructors, students)

Both curricula develop lecturers who can elevate teaching quality in line with productive learning management.

– Number of students’ productive work

– Number of KM work

Research and innovation

Encourage faculty members to produce research work for publication.

– Number of published research articles

– Number of research articles citation

– Research fund

Academic service /  Community service

Cooperate with collaborators to develop and convey missions in a practical way to the local communities in a concrete way.

– Application of KM topic for academic services

– Feedback on community service outputs (video clips)

Art and culture

Encourage students to realize the value of different cultures

– Number of students participate in art and culture events

Administration and management

Develop a management system that supports learning and enhances work efficiency for the sustainable development of the Faculty

– Results of IQA 3 years back

The follow-up is of two types: daily and quarter. For the former, the Dean checks the timeline of the project and assigns the secretary to keep following the operation with the project-responsible faculty member. The latter is executed every quarter by requesting the project-responsible faculty members to submit the project summaries which will be submitted to the Department of Research and Planning.

หลักฐาน

4.1.1.1 ชิ้นงานนักศึกษา

4.1.1.2 ผลงาน KM

4.1.1.3 จำนวนงานวิจัยตีพิมพ์ 

4.1.1.4 ทุนวิจัย 

4.1.1.5 จำนวนอ้างอิงงานวิจัย

4.1.1.6 บริการวิชาการ 

4.1.1.7 คลิป วิดีโอ Nakon nayok channel

4.1.1.8 ชุมชนเข้มแข็ง ยอดวิว

4.1.1.9 จำนวนนศ เข้าร่วมกิจกรรม art and culture

4.1.1.10 ผล IQA ย้อนหลัง 3 ปี

2. Performance Measurement (Comparative Data). How does the dean select comparative data and information to support fact-based decision making?

The Faculty considers the Faculty of Education (B.Ed) of St. Theresa International College to be the comparative partner based on the reason that both Faculties are in the same contexts. In details, both Faculties produce students with English major, operate under the same rules and regulations, provide students with equal facilities, have almost the same number of lecturers teaching English.

The Faculty specifies benchmarking issues as indicators in 3 areas to achieve its vision, namely 1) create the curriculum that integrates various sciences that meet the needs of quality learners so that they can construct the body of knowledge beneficial for their future career, 2) develop faculty members’ research competency so that they can produce research work for their own benefits, Faculty, and College, 3) develop information systems so that the Faculty will be more competent to supervise, follow up and report results in timely manner.

The results gained from the comparison will be used as information for strategic planning in the next year.

หลักฐาน

4.1.2.1 คำสั่งปรับหลักสูตร

4.1.2.2 คะแนน IQA เอก Eng ศึกษาศาสตร์ปีที่แล้ว

4.1.2.3 จำนวนงานวิจัยตีพิมพ์ศึกษาศาสตร์

3. Performance Measurement (Measurement Agility). How do you ensure that your performance measurement system can respond to rapid or unexpected organizational or external changes and provide timely data?

The Faculty follows up on the results of Implement indicators according to the strategic plan and as stated in the projects on a quarterly basis with indicators that can be tracked closely in response to changes, such as monitoring the assessment of teaching and learning management through ‘peer observation’, TQF 5, and advisors. All projects are summarized when they are completely done. The project summaries initially are submitted to the Dean for inspection if all projects are executed as planned. When some changes occur, the responsible person reports to the Dean.

For external changes such as the new policy or requirement from the Office of the Higher Education Commission, or the change of day and time for academic service at the target school/community, the Faculty acknowledges the changes as quickly as possible and considers the way to handle the changes. Recognizing and dealing with changes in a timely manner enables the Faculty to respond appropriately.

4. Performance Analysis and Review. How does the faculty review your organization’s performance and capabilities?

The Faculty has a method for reviewing performance and capacities as follows:

  1. Appointing various boards of the committee to supervise, monitor, and follow up on the mission they are responsible for
  2. Transferring the strategic objectives of both long-term and short-term plans to both Program Heads so that they ensure that the operation of the program leads to achievement.
  3. Appointing project-responsible persons to operate the projects until finished and report the project summaries to Dean
  4. Calling for a small meeting to handle changes that occur
  5. Reviewing all results, reports, and project summaries every quarter
  6. Submitting project summaries to the Department of Research and Planning
  7. Analyzing results of all plans and projects to find the advantages and disadvantages to be served as sources to determine the plan for the next year
  8. All operations are reported at the end of the year for the IQA.
  9. The results of the IQA are adopted for the improvement of the operation next year.

From performance analysis and review, the Faculty comes up with certain best practices judged by the quality assurance committee as followed:

  1. The Faculty creates an academic network with universities abroad which enhances the chance for students to experience learning English in the country speaking English as L1.
  2. The Faculty succeeds in developing a productive learning approach as evident in a number of students’ productive work.
  3. The Faculty arranges academic services that meet the needs of the local communities.

หลักฐาน

4.1.4.1 คำสั่งแต่งตั้งคณะกรรมการต่างๆ

4.1.4.2 สรุปผลโครงการ และ การรายงานทุกไตรมาส

4.1.4.3 ผล IQA ของคณะแสดงจุดเด่น

4.1.4.4 ผล IQA ของหลักสูตร 3 ปีย้อนหลัง

5. Performance Improvement (Future Performance). How does the faculty project your organization’s future performance?

Based on performance analysis and review, IQA results, and comparative data, the Faculty determines future performance relying on the following operations:

  1. Reviewing the five-year plan: The old one covers the academic years 2020 – 2024 and the revised one covers 2022 – 2026 covering the timeline for personnel development.
  2. Reviewing the action plan executed via the 46 annual projects most of which will be continued, but with some adjustments regarding the objectives, budget, procedures, and the target community/school served as collaborators.
  3. Bringing the comparative data from the Faculty of Education (Ed. E. Program) into consideration regarding the students’ sense of unity with the faculty and College, and TOEIC scores.

The Faculty prioritizes missions that require continuous improvement and innovation opportunities, namely: 1) produce graduates in both BE and CA programs to be able to integrate all bodies of knowledge gained from all studied subjects and transfer theoretical knowledge into practice, 2) focus on developing research work and encourage innovation creation, 3) collaborate with local communities regarding academic services and community services, and 4) manage the Faculty towards internationalization to achieve the organization’s vision. 

The Faculty passes these improvement plans through faculty meetings to the Program Heads and all faculty members who will be assigned responsibility for the plans.

หลักฐาน

4.1.5.1 แผน 5 ปี (2020 – 2024 and 2022 – 2026)

4.1.5.2 สรุป โครงการ

4.1.5.3 รายงาน IQA ของหลักสูตร Ed.E. ของคณะศึกษาศาสตร์

6. Performance Improvement (Continuous Improvement and Innovation). How does the faculty use findings from performance reviews to develop priorities for continuous improvement and opportunities for innovation?

As already mentioned in item 5, the Faculty prioritizes 4 main missions to be operated continuously into the future. Not only the main objectives of the missions; but the related risks are also included. The Faculty transfers the missions and projected risk to all faculty members at faculty meetings and assigns them with responsibility. All missions and risks cannot be completed within a short period of time; thus, a long-term plan for each mission is required.

  1. In producing graduates to meet the characteristics stated in the faculty vision, an integrated curriculum: content-, student-, and environment based, needs to be developed.
  2. Research and innovation, the Faculty urgently urges the faculty members with no research or innovative work to produce such work that will be beneficial to the Faculty and to their self-promotion.
  3. In Collaboration with the local community, the Faculty has the academic service committee brainstorm for the content and activity to be provided, or for a specific community that needs our service to help promote their value, culture, or economy.
  4. As for the Internationalization mission, the name ‘St. Theresa International College’ explicitly conveys the idea of ‘internationalization’. Thus, the Faculty needs to serve the College’s identity, and also the Ministry of Higher Education, Science, Research and Innovation by equipping students with the characteristics of internationalized individuals.

7. Collecting, analyzing, and managing information obtained from student and graduate satisfaction.

At the end of the academic year, the Faculty gathers information regarding the satisfaction of current students in all years and graduates using various sets of questionnaires as follows:

  1. Students fill out the questionnaire by rating their satisfaction levels on different categories reflecting the desirable graduate characteristics
  2. Students fill out the questionnaire by rating their satisfaction levels towards curriculum and educational management
  3. Students fill out the questionnaire by rating their satisfaction levels on the pedagogical quality of the lecturers teaching them.
  4. Graduates and their supervisors are requested to fill out the questionnaire by rating their satisfaction levels on the graduates’ desirable qualities for work.

The data from all questionnaires are categorized and analyzed to be served as sources for improvement.

หลักฐาน

4.1.7.1 ผลการประเมินผลลัพธ์ผู้เรียน (คุณลักษณะบัณฑิต)

4.1.7.2 ผลการประเมินความพึงพอใจต่อหลักสูตรและการสอน

4.1.7.3 สรุปผลการประเมินอาจารย์ของนักศึกษา

4.1.7.3 ผล IQA ย้อนหลั 3 ปี ของคณะและทั้งสองหลักสูตร

8. Collecting, analyzing, and managing information obtained from graduate users.

As mentioned in the former section, the Faculty gathers the evaluation information from students using various sets of questionnaires. One set of information is obtained from the graduate users during the internship. Toward the end of the internship period, the supervisors or mentors at the workplace where the students do the internship are requested to complete a questionnaire asking if the students possess the desirable knowledge, skills, and qualities that meet the needs of the workplace. Aside from the questionnaire, a telephone interview is arranged to gain more in-depth information.

After the internship, the internship seminar is held to provide the students with an opportunity to present the results of their internship to other students in their junior years.

The Faculty gathers and analyzes all information from the questionnaire, interview, and seminar with the aim of improvement and adjustment. This year, the Faculty has found that 1) it is better for the students to do their internship in the first semester of the fourth year, a

nd 2) based on the suggestion of the graduate users, the students should know about the workplace they are doing the internship in details.

หลักฐาน

4.1.8.1 รายงานการฝึกงาน

4.1.8.2 การประเมินนักศึกษาที่ฝึกงานโดยสถานประกอบการ

Self-Assessment

Goal

Performance

Qualitative indicators

(indicated items)

Self-Assessment

5 items 

IQA (1-8)

1,2,3,4,5,6,7,8

 8 items

 5 marks

EdPEx (1-6)

1,2,3,4,5,6

Percentage 10

4.5 marks

Evidence

Evidence No.List of evidences
4.1.1 4.1.1.2 ผลงาน KM
4.1.1.3 จำนวนงานวิจัยตีพิมพ์ 
4.1.1.4 ทุนวิจัย 
4.1.1.5 จำนวนอ้างอิงงานวิจัย
4.1.1.6 บริการวิชาการ 
4.1.1.7 คลิป วิดีโอ Nakon nayok channel
4.1.1.8 ชุมชนเข้มแข็ง ยอดวิว
4.1.1.9 จำนวนนศ เข้าร่วมกิจกรรม art and culture
4.1.1.10 ผล IQA ย้อนหลัง 3 ปี
4.1.2 4.1.2.1 คำสั่งปรับหลักสูตร
4.1.2.2 คะแนน IQA เอก Eng ศึกษาศาสตร์ปีที่แล้ว
4.1.2.3 จำนวนงานวิจัยตีพิมพ์ศึกษาศาสตร์
4.1.3
4.1.4 4.1.4.1 คำสั่งแต่งตั้งคณะกรรมการต่างๆ
4.1.4.2 สรุปผลโครงการ และ การรายงานทุกไตรมาส
4.1.4.3 ผล IQA ของคณะแสดงจุดเด่น
4.1.4.4 ผล IQA ของหลักสูตร 3 ปีย้อนหลัง
4.1.5.1 4.1.5.1 แผน 5 ปี (2020 – 2024 and 2022 – 2026)
4.1.5.2 สรุป โครงการ
4.1.5.3 รายงาน IQA ของหลักสูตร Ed.E. ของคณะศึกษาศาสตร์
4.1.6
4.1.7 4.1.7.1 ผลการประเมินผลลัพธ์ผู้เรียน (คุณลักษณะบัณฑิต)
4.1.7.2 ผลการประเมินความพึงพอใจต่อหลักสูตรและการสอน
4.1.7.3 สรุปผลการประเมินอาจารย์ของนักศึกษา
4.1.7.3 ผล IQA ย้อนหลั 3 ปี ของคณะและทั้งสองหลักสูตร
4.1.8 4.1.8.1 รายงานการฝึกงาน
4.1.8.2 การประเมินนักศึกษาที่ฝึกงานโดยสถานประกอบการ