Does Higher Education Teach Students to Think Critically?
There is a discernible and growing gap between the qualifications that a university degree certifies and the actual generic, 21st-century skills with which students graduate from higher education. By generic skills, it is meant literacy and critical thinking skills encompassing problem solving, anal...
Autor principal: | |
---|---|
Autor Corporativo: | |
Formato: | Libro electrónico |
Idioma: | Inglés |
Publicado: |
Paris :
Organization for Economic Cooperation & Development
2022.
|
Edición: | 1st ed |
Materias: | |
Ver en Biblioteca Universitat Ramon Llull: | https://discovery.url.edu/permalink/34CSUC_URL/1im36ta/alma991009704711906719 |
Tabla de Contenidos:
- Intro
- Foreword
- Acknowledgements
- Executive summary
- Part I Assessing students' generic learning outcomes
- 1 Do higher education students acquire the skills that matter?
- Introduction
- Qualifications versus skills
- Transparency and information asymmetry
- Distrust
- Changing skill demand
- Assessing generic skills
- Developments in assessing higher education learning outcomes
- Methodological issues
- References
- 2 The Collegiate Learning Assessment - a performance-based assessment of generic skills
- Introduction
- CLA+
- CLA+ Scoring
- Scoring process
- CLA+ psychometrics
- Test design
- Reliability
- SRQ reliability
- PT reliability
- Correlations between scale scores
- Computing scale scores
- Establishing mastery levels
- References
- Annex 2.A. Linear equating procedure
- 3 CLA+ International
- Introduction
- CLA+ International recruitment
- CLA+ International collaborators
- CLA+ International assessment development and administration
- Performance Task (PT) and Selected-Response Question (SRQ) selection
- Translation and adaptation
- Cognitive labs
- Test administration and associated activities
- Important milestones and activities
- Administration
- Scoring process
- Scoring and equating
- Reporting
- References
- 4 Ensuring cross-cultural reliability and validity
- Introduction
- Theoretical background
- Performance tasks and scoring
- Cross-cultural challenges in PT scoring
- Method
- CLA+
- United States context
- Finnish context
- PTs
- SRQs
- Translation and adaptation
- Scoring equivalency case study
- Results
- Scoring equivalency case study
- Relative Quality of Scores: How well does a translated and culturally adapted performance-based assessment requiring students to generate a written response get scored across countries and languages?.
- Absolute Quality of Scores: Can equivalency be established across the two forms of the assessment?
- Conclusion
- Acknowledgements
- References
- Part II CLA+ International Database
- 5 General CLA+ International results
- Introduction
- Mastery levels
- CLA+ total scores
- CLA+ subscores
- Student self-reported effort and engagement
- Summary
- Reference
- 6 CLA+ International demographic variables
- Primary language
- Gender
- 7 Predictive validity of CLA+
- Introduction
- Study 1: CLA+ Predictive Validity of Post-Higher Education Outcomes
- Method
- Participants
- Data sources and materials
- CLA+
- Survey #1
- Results
- Race/Ethnicity by generic skills by institution competitiveness (Figure 7.1)
- Study 2: CLA+ Predictive Validity of Employers' and Advisors' Assessments
- Method
- Participants
- Analysis
- Data sources and materials
- Survey #2
- Results
- Importance of CLA+ skills
- CLA+ scores predicting participants' workplace or graduate school performance
- Conclusion
- References
- 8 Fields of study
- Instructional format
- Fields of study for international students
- Fields of study for U.S. students
- Conclusion
- Annex 8.A. International sample: Instructional format by fields of study
- 9 Benchmarking countries
- Introduction
- Mastery levels by country
- Summary statistics
- Conclusion
- Part III The CLA+ assessment in participating countries
- 10 CLA+ in the United States
- Introduction
- Policy context
- Process of implementation of the CLA+
- Results
- Total CLA+ scores and section scores among entering and exiting students
- CLA+ mastery levels and score distributions
- CLA+ subscores
- Self-reported effort and engagement
- CLA+ section scores, by effort and engagement
- Policy implications and lessons learnt
- Next steps
- Next Step Platform
- SSA+
- Prospects.
- References
- Note
- 11 Assessing university students' learning outcomes: The Italian experience with TECO
- Introduction
- Policy context
- Reasons for TECO
- The Italian experiment with the CLA+ (TECO 2013-2015)
- 2013 testing
- 2015 testing
- 2013 and 2015 critical issues
- Redefining the TECO
- TECO-T and transversal skills
- TECO-D and disciplinary skills
- TECO-T and TECO-D (2016-2019)
- TECO 2016
- TECO 2018
- TECO 2019
- TECO 2020
- Delivering TECO during the COVID-19 pandemic
- Possible next steps and prospects
- References
- Notes
- 12 Assessing the generic skills of undergraduate students in Finland
- The Finnish higher education system
- The policy context for the assessment of generic skills
- Implementation of the CLA+ International in Finland
- Project aims and co-ordination
- Translation, adaptation and verification of the CLA+ International
- Test administration
- Data sampling
- Data collection
- Data analyses
- Reports to students and higher education institutions
- Main results
- Levels and mastery of generic skills
- Main factors associated with the level of generic skills
- Main factors explaining the level of generic skills among Finnish higher education students
- Implications and lessons learned
- Next steps and prospects
- References
- 13 Using CLA+ in a pilot in England for measuring learning gain
- Introduction
- Policy context for CLA+
- Process of implementation CLA+
- Project delivery
- Adaption of CLA+ to CLA+ International
- CLA+ as a diagnostic tool
- Student recruitment and testing
- Main results
- Testing numbers and student recruitment
- Performance data
- Demographic data and CLA+ performance
- Using the CLA+ for learning and teaching enhancement
- Student perceptions of CLA+: Findings from our cross-sectional focus groups.
- Continuing our philosophy of student partnership: Working with student interns
- Policy implications and lessons learned
- Next steps and prospects
- References
- 14 Mexico: an innovative focus on evaluation of learning outcomes
- Mexican higher education: Socio-economic and cognitive disparities
- Digital realities exacerbate disparity
- Higher education in Mexico: a complex system
- Building access to and quality of higher education
- Evaluating learning outcomes
- Implementing the CLA+ testing
- Some results: Defiant disparities, once again
- Method of analysis
- Main conclusions about these findings
- What we learned from the CLA+ results
- References
- 15 CLA+ in Latin America: application and results
- Chile
- CLA+ outreach process in Latin America and Spain
- Policy context for CLA+
- University W
- University X
- University Y
- University Z
- Process of implementation of the CLA+
- University W
- University X
- University Y
- University Z
- Main results
- University W
- University X
- University Y
- University Z
- Policy implications and lessons learnt
- Another aspect is the length of the decision process in joining the study
- Next steps and prospects
- References
- 16 Assessing students' generic learning outcomes in Australia and New Zealand
- Introduction
- Policy context
- Technical and vocational education and training sector initiatives
- Higher education sector policy initiatives
- Qualification relevance to employability under question
- What about secondary school curriculum?
- COVID-19 impacts on policy
- Next steps and prospects
- Conclusion
- References
- Notes
- 17 Conclusions and prospects
- Introduction
- Feasibility of critical-thinking skill assessment in higher education
- Do students learn to think critically at university?.
- Do background variables influence critical thinking skill development?
- Do students demonstrate different levels of critical thinking by field of study and type of instruction?
- Differences between countries
- Experiences in individual countries
- Lessons learnt in participating countries
- Prospects.