Development of an assessment toolkit to measure higher order thinking skills among secondary school learners

• المؤلفون الرئيسيون: Loh, S.C., Loo, C.K., Mamauag, M.F.M., Arosh, S.G.
• التنسيق: Conference or Workshop Item
• اللغة: English
• منشور في: 2017
• الموضوعات: L Education (General); LB1603 Secondary Education. High schools; QA75 Electronic computers. Computer science
• الوصول للمادة أونلاين: http://eprints.um.edu.my/18971/1/Development_of_an_assessment_toolkit_to_measure_higher_order_thinking_skills.pdf; http://eprints.um.edu.my/18971/; http://conferences.cseap.edu.my/medc2017/

Higher order thinking skills (HOT) emerged as the focus of student development across the primary to post-secondary levels since the publication of the Malaysian Education Blueprint (2013-2025). This blueprint outlines the need for thinking skills encompassing creativity, innovation, critical thinking, and logical reasoning for students to adapt within the ever-changing technological landscape of the new millennia (Ministry of Education, 2013). Despite MOE's effort to implement PT3 (Form 3 Assessment) and HOTS questions in national school-leaving examinations, it apparently failed to accurately measure the levels of HOTS independent of content knowledge among Malaysian students. This study, therefore, was conceived to address the need for a more valid and reliable measurement of HOTS contextualized in a Malaysian setting. This theoretical paper is an attempt to set a framework by which HOTS' underlying measurement is anchored on. Based on a review of literature, operational definitions of the constructs on critical thinking, problem-solving, and creativity were derived. Three types of measures were developed, namely: (a) syllogisms, (b) situational judgment test (SJT), and (c) creativity. Thirty (30) syllogisms items to measure critical thinking, while 50 items of situational judgment tests to measure problem-solving were generated. The creativity test is adapted from an existing measure. Translated into Bahasa Malaysia, the first two tests are currently undergoing expert review prior to pilot-testing. These tests will be standardized using modern Item Response Theory (IRT) techniques, like Rasch modeling. The essential steps moving towards the full development of the HOTS assessment toolkit for the millennials in Malaysia are further discussed.