2023年成人技术技能调查（英）_499页_11mb

Summary of the Survey of Adult Skills 2023 Technical Report

Core Content

The Survey of Adult Skills 2023 Technical Report is a comprehensive document detailing the design, implementation, and analysis methodologies of the Programme for International Assessment of Adult Competencies (PIAAC), specifically focusing on the second cycle of the survey. The report is part of the OECD Skills Studies and serves as a technical reference for researchers, policymakers, and stakeholders interested in understanding the structure and operation of the PIAAC survey.

The survey assesses three key cognitive domains: literacy, numeracy, and Adaptive Problem Solving (APS). These domains are designed to measure the foundational skills required for success in personal and societal contexts, emphasizing real-world applications and information-processing strategies rather than specialized knowledge.

The report outlines the survey design, including sampling methods, assessment instruments, data collection procedures, and statistical tools used to analyze the results. It also discusses the technical aspects of scaling and interpreting the data, as well as the quality control mechanisms and data validation processes.

Main Viewpoints

• The PIAAC is an international comparative survey that aims to provide baseline profiles of adult skills in participating countries, supporting policy development and education system evaluation.
• The 2023 Survey of Adult Skills is the second cycle of the PIAAC, with data collected in 2022-23.
• The survey assesses three domains: literacy, numeracy, and Adaptive Problem Solving (APS), with the latter being a new domain introduced in this cycle.
• The assessment design includes adaptive and linear paths, digital and paper-based formats, and multi-stage approaches to ensure a comprehensive and efficient evaluation of skills.
• The survey design is based on cognitive processes, content types, and contextual factors that define the tasks and their relevance to real-life situations.
• The data collection process involves sampling frames, field operations, interviewer training, and response rate monitoring.
• Statistical methods such as weighting, variance estimation, plausible values, and scaling techniques are used to ensure reliable and comparable results across countries.
• The reporting system includes data analysis tools, translation processes, and public-use datasets for transparency and accessibility.

Key Information

Survey Design

• PIAAC Cycle 2 includes adaptive and linear assessments for literacy and numeracy, as well as APS.
• Sampling design involves registry-based and screening-based approaches, with stratification and weighting procedures to ensure representativeness.
• Field trial and main study are conducted to refine and validate the assessment items and response formats.

Assessment Instruments

• The literacy and numeracy assessments focus on reading and interpreting texts and mathematical information respectively.
• Adaptive problem solving (APS) is a new domain that evaluates the ability to solve problems in technology-rich environments.
• Cognitive processes are categorized as accessing, understanding, and evaluating texts or information.
• Content types include digital texts, mathematical representations, and real-world contexts.
• Text formats and mathematical content are carefully selected to reflect modern information environments.

Data Collection and Analysis

• Data collection involves interviewers, online tools, and field operations with monitoring and quality control mechanisms.
• Weighting and variance estimation are used to adjust for sampling bias and non-response.
• Plausible values are employed to account for measurement error and estimate proficiency levels.
• Scaling methods are applied to convert raw scores into proficiency scales for international comparisons.
• Derived variables and background questionnaire (BQ) data are used to link skill levels to socio-economic outcomes.

Quality and Validity

• Quality control (QC) procedures are implemented throughout the survey operations.
• Non-coverage rates, response rates, and non-response error susceptibility (NES) are reported to assess survey reliability.
• Translation and adaptation of test and survey materials are carefully managed to ensure cross-cultural validity.
• Validation processes include interviewer productivity, data cleaning, and falsification detection.

Technical Tools and Systems

• The PIAAC Portal, iCMS (International Case Management System), and iCMA (International Case Management Application) are used for survey management, case tracking, and data handling.
• Data analysis tools and methodologies are provided to support international comparisons and research applications.
• KPIs (Key Performance Indicators) are tracked and reported using dashboard tools and data visualization.

Conclusion

The Survey of Adult Skills 2023 Technical Report provides a detailed overview of the design, implementation, and analysis of the PIAAC survey. It emphasizes the importance of foundational skills in literacy, numeracy, and adaptive problem solving, and highlights the technical rigor and international comparability of the assessment. The report is a valuable resource for understanding the methodological underpinnings of the survey and its policy implications.