2010年-世界发展银行全球_International_Experience_for_Assessing_the_Quality_of_Educational_Services_at_Higher_Education_Institutions_42页_638kb

Summary of "International Experience for Assessing the Quality of Educational Services at Higher Education Institutions"

Core Content

This policy note provides an analysis of international experiences in the assessment of the quality of educational services at higher education institutions (HEIs), with a particular focus on postgraduate courses and training. It is intended to support the Government of Poland in selecting an appropriate quality assurance (QA) system for its higher education sector.

Main Objectives

The primary aim of the note is to:

• Examine the aims and methods of QA processes in higher education,
• Identify key criteria for evaluating the effectiveness of QA systems,
• Compare international strategies for QA in HEIs, especially in OECD countries and other innovative systems.

Key Views and Findings

1. Nature and Challenges of Quality Assurance in Higher Education

• QA in higher education is still evolving and varies significantly across countries.
• The concept of "quality" in HE is complex and not easily measurable due to:
  • The diverse and intangible nature of inputs (students and teachers),
  • The difficulty in quantifying outputs and their societal impact,
  • The lack of a universally accepted production function for HE.

2. Why HEIs May Not Focus on Quality

• HEIs operate within complex and often contradictory systems of incentives and constraints.
• Public HEIs face limited autonomy and insufficient mechanisms for rewarding or sanctioning performance.
• Private HEIs may prioritize cost-saving over quality, especially in competitive environments.

3. Role of QA in HEIs

• HEIs should develop a culture of quality improvement, aligning with their missions, visions, and strategies.
• QA systems must ensure that HEIs are held accountable for their performance, particularly in the absence of effective internal mechanisms.

QA Methods and Tools

1. Minimum Standard Accreditation

• Ensures institutions meet a baseline quality standard.
• Aims to protect students from substandard programs.
• Involves evaluation and potential non-accreditation for institutions that fail to meet standards.

2. Accreditation of Excellence

• Focuses on identifying institutions that have reached a high standard of excellence.
• Provides a label that can enhance institutional reputation and attract students.
• Requires peer evaluation and adherence to predefined quality criteria.

3. Supportive Evaluation

• Encourages continuous improvement rather than mere certification.
• Useful for institutions that are proactive in enhancing their educational services.
• Often implemented by HEIs with a strong internal quality culture.

4. Audit of Internal QA Processes

• Ensures that internal QA mechanisms are effective and contribute to quality improvement.
• Can be formative (helping institutions improve) or summative (sanctioning institutions for poor QA practices).
• Necessary even for institutions with high autonomy to maintain accountability.

5. Comparative Evaluation of Disciplines

• Focuses on the relative strength of academic disciplines across institutions.
• Useful for formulating national science and research policies.
• Not directly relevant to teaching and learning assessment in this context.

6. Benchmarking Between Institutions

• Helps institutions understand differences in resources and outcomes.
• Often used by research-intensive HEIs.
• Mainly focuses on research performance rather than teaching and learning.

7. Rankings (League Tables)

• Primarily based on research output and impact.
• Provide a measure of research-intensive universities.
• Not considered a useful tool for assessing teaching and learning quality.

Key Criteria for Evaluating QA Systems

The note proposes the following criteria for comparing QA systems:

• Relevance: Does the system address the core aspects of teaching and learning?
• Efficacy: Does it contribute to quality improvement?
• Cost-effectiveness: Is the system affordable and efficient in terms of time and financial resources?
• Transparency and Objectivity: Are the evaluation criteria clear, verifiable, and fair?
• Adaptability: Can the system evolve with changing educational and societal needs?
• Accountability: Does it ensure that HEIs are responsible for their performance?

Recommendations

• Governments and independent agencies should ensure HEIs take quality seriously, especially in the absence of strong internal QA mechanisms.
• HEIs should be encouraged to develop their own internal quality cultures, but must be supported by external audits and evaluations.
• QA systems should be flexible and adaptable, avoiding the risk of freezing institutional change.
• There is a need to focus on teaching and learning quality, rather than solely on research metrics.

Conclusion

The complexity and diversity of higher education systems make the establishment of an effective QA framework challenging. However, by learning from international experiences and applying a set of well-defined criteria, Poland can develop a QA system that supports both the improvement and accountability of its HEIs, particularly in postgraduate education.