EVALUATING THE COMPUTER BASE NATIONAL SCIENCE OLYMPIAD IMPLEMENTATION AT SENIOR HIGH SCHOOL LEVEL: A CIPP MODEL ANALYSIS
Isi Artikel Utama
Abstrak
The digital transformation in education has encouraged changes in national evaluation systems and academic competitions, including the implementation of the online-based National Science Olympiad (OSN). This study aims to evaluate the implementation of the online National Science Olympiad at the senior high school level using the CIPP (Context, Input, Process, Product) evaluation model. The study employed a mixed methods approach by collecting data through questionnaires, interviews, observations, and documentation studies. The participants consisted of student contestants, supervising teachers, school operators, and school management representatives. The findings indicate that, from the context aspect, the program is relevant to the needs of educational digitalization and implementation efficiency. From the input aspect, disparities were still found in infrastructure, internet network quality, and digital competencies among schools. From the process aspect, the program implementation generally ran well despite several technical constraints and variations in supervision quality. From the product aspect, the program improved accessibility and efficiency; however, it also generated perceptions of unfairness among some participants. The study concludes that the implementation of the online OSN is relatively effective, but it still requires improvements in infrastructure, technical standardization, and the integrity of the evaluation system. These findings contribute to the development of fairer and more sustainable digital academic competition policies.
Rincian Artikel
Artikel ini berlisensiCreative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright (c) STMIK TIMEReferensi
[1] T. Bates and L. Vancouver, “Teaching in a Digital Age-Second Edition Guidelines for designing teaching and learning,” 2019. [Online]. Available: https://pressbooks.bccampus.ca/teachinginadigitalagev2/
[2] C. Redecker, Digital Competence of Educators DigCompEdu. Publications Office of the European Union, 2017. doi: https://doi.org/10.2760/159770.
[3] Charles Hodges, Stephanie Moore, Barb Lockee, Torrey Trust, and Aaron Bond, “The Difference Between Emergency Remote Teaching and Online Learning,” EDUCAUSE.
[4] B. Williamson, R. Eynon, and J. Potter, “Pandemic politics, pedagogies and practices: digital technologies and distance education during the coronavirus emergency,” Apr. 02, 2020, Routledge. doi: 10.1080/17439884.2020.1761641.
[5] F. J. García-Peñalvo, A. Corell, V. Abella-García, and M. Grande, “Online assessment in higher education in the time of COVID-19,” Education in the Knowledge Society, vol. 21, 2020, doi: 10.14201/eks.23013.
[6] J. Heil and D. Ifenthaler, “Online Assessment in Higher Education: A Systematic Review,” 2023, The Online Learning Consortium. doi: 10.24059/olj.v27i1.3398.
[7] Neil Selwyn, Education and Technology Key Issues and Debates. London : Continuum International Publishing Group , 2011.
[8] Randy Elliot Bennett, “The changing nature of educational assessment. Review of Research in Education,” 2015, pp. 370–407.
[9] DANIEL L. STUFFLEBEAM and CHRIS L. S. CORYN, Evaluation theory, models, and applications, SECOND EDITION. San Francisco: Jossey-Bass, 2014.
[10] Michael Howlett and M. Ramesh, The policy cycle: Policy subsystems and policy processes. Oxford University Press, 2014.
[11] OECD, Education responses to COVID-19: Embracing digital learning and online collaboration. . OECD Publishing, 2020.
[12] Florence Martin, Elife Ceviker, and Tuba Gezer, “From digital divide to digital equity: Systematic review of two decades of research on educational digital divide factors, dimensions, and interventions,” Journal of Research on Technology in Education, vol. 58, no. 2, 2026.
[13] Y. Assefa, M. M. Gebremeskel, B. T. Moges, S. A. Tilwani, and Y. A. Azmera, “Rethinking the digital divide and associated educational in(equity) in higher education in the context of developing countries: the social justice perspective,” The International Journal of Information and Learning Technology, vol. 42, no. 1, pp. 15–32, Jan. 2025, doi: 10.1108/IJILT-03-2024-0058.
[14] D. G. Balash, R. A. Fainchtein, E. Korkes, M. Grant, M. Sherr, and A. J. Aviv, “Educators’ Perspectives of Using (or Not Using) Online Exam Proctoring,” Feb. 2023, [Online]. Available: http://arxiv.org/abs/2302.12936
[15] S. Messick, “Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning.,” American Psychologist, vol. 50, no. 9, pp. 741–749, Sep. 1995, doi: 10.1037/0003-066X.50.9.741.
[16] M. T. Kane, “Validating the Interpretations and Uses of Test Scores,” J. Educ. Meas., vol. 50, no. 1, pp. 1–73, Mar. 2013, doi: 10.1111/jedm.12000.
[17] G. Rusak and L. Yan, “Unique Exams: Designing assessments for integrity and fairness,” in SIGCSE 2019 - Proceedings of the 50th ACM Technical Symposium on Computer Science Education, Association for Computing Machinery, Inc, Feb. 2019, pp. 253–259. doi: 10.1145/3287324.3287483.
[18] G. Zhang et al., “Using the Context, Input, Process, and Product Evaluation Model (CIPP) as a Comprehensive Framework to Guide the Planning, Implementation, and Assessment of Service-learning Programs Introduction and Review of Literature,” 2011.
[19] A.-L. Marian, R. Apostolache, and C. M. Ceobanu, “Toward Sustainable Technology Use in Education: Psychological Pathways and Professional Status Effects in the TAM Framework,” Sustainability, vol. 17, no. 15, p. 7025, Aug. 2025, doi: 10.3390/su17157025.
[20] N. Magfirah, Anisa, H. Hambali, R. Thahir, and Nurdiyanti, “Digital Literacy in Indonesian Biology Education (2020–2025): A Research Synthesis Over One Lustrun, Methodological Critique, and Strategic Roadmap,” Jurnal Penelitian Pendidikan IPA, vol. 11, no. 8, pp. 12–23, Aug. 2025, doi: 10.29303/jppipa.v11i8.12068.
[21] P. Rambe, H. Y. Daulay, P. S. Ritonga, T. T. Wijaya, and S. W. Putri, “Artificial Intelligence (AI)-Based Digital Learning: The Impact on Students’ Learning Motivation and Digital Literacy in Riau,” AL-ISHLAH: Jurnal Pendidikan, vol. 18, no. 1, Apr. 2026, doi: 10.35445/alishlah.v18i1.9083.