Content Validity Analysis of Multitier Diagnostic Test Instruments for Measuring Junior High School Disaster Literacy

Authors

  • Apriyani Apriyani Science Education, Universitas Bengkulu, Bengkulu, Indonesia
  • Henny Johan Science Education, Universitas Bengkulu, Bengkulu, Indonesia
  • Rahmawati Rahmawati Master of Elementary Education, Universitas Muhammadiyah Makassar, Makassar, Indonesia
  • Muchammad Farid Geophysics, Universitas Bengkulu, Bengkulu, Indonesia
  • Sutarno Sutarno Science Education, Universitas Bengkulu, Bengkulu, Indonesia
  • Aprina Defianti Science Education, Universitas Bengkulu, Bengkulu, Indonesia

Keywords:

four-tier diagnostic test, disaster literacy, content validity, Content Validity Ratio, Content Validity Index

Abstract

Background: Disaster literacy is an essential competency for students in disaster-prone areas such as Bengkulu Province. However, conventional school assessments cannot adequately measure students’ conceptual understanding, misconceptions, and disaster literacy. Moreover, no validated four-tier diagnostic instrument is available for vibration and wave topics.

Methods: This study used the ADDIE R&D model, with research limited to the development phase. Five experts validated the 32-item instrument. Two university lecturers and three junior high school teachers served as experts. The Content Validity Ratio (CVR) and Content Validity Index (CVI) were used to assess content validity.

Results: The CVR values for all 32 test items ranged from 0.81 to 1.00. Based on Lawshe's criteria, 18 items met the minimum CVR requirement, while the remaining 14 were revised per the validators' recommendations. The Content Validity Index (CVI) was 1.00 for the knowledge and attitude aspects and 0.96 for the skills aspect, yielding an overall CVI of 0.972, indicating excellent content validity. The revised instrument was then deemed ready for implementation with junior high school students to collect empirical response data for subsequent validity and reliability analyses.

Conclusion: The developed disaster-literacy-based four-tier diagnostic test demonstrated excellent content validity following expert validation and revision. This study contributes a validated four-tier instrument for assessing disaster literacy and students’ conceptual understanding in vibration and wave topics. Despite the challenges of developing coherent four-tier items, the instrument was considered suitable for empirical testing with junior high school students.

References

Almanasreh, E., Moles, R., & Chen, T. F. (2018). Research in social and administrative pharmacy evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 1–8. https://doi.org/10.1016/j.sapharm.2018.03.066

Amelia, R. N., Hasmawati, & Aswan, M. (2023). Model learning by doing terhadap kemampuan literasi bencana konteks gempabumi di mts negeri 1 pulau morotai. Jurnal Spatial Wahana Komunikasi dan Informasi Geografi, 23(2), 161–169. https://doi.org/10.21009/spatial.232.08

Anisah, N. (2019). Model sekolah aman bencana dalam upaya mewujudkan pendidikan karakter di MIN 1 Bantul. Literasi: Jurnal Ilmu Pendidikan, X(1), 9–20. https://doi.org/10.21927/literasi.2019.10(1)

Berlianawati, A. W., Prasetya, S. P., Marzuqi, M. I., & Prasetyo, K. (2025). Efektivitas dan kelayakan LKPD kebencanaan untuk meningkatkan literasi kebencanaan siswa SMPN 4 Sidoarjo. Jurnal Dialektika Pendidikan IPS, 5(1), 285–292. https://ejournal.unesa.ac.id/index.php/PENIPS/index

Branch, R. M. (2009). Instructional design-the ADDIE approach. New York: Springer.

Febriana, H., & Margereta, S. (2026). Pengembangan instrumen four tier diagnostic test untuk mengidentifikasi profil miskonsepsi mahasiswa pada materi biologi sel. Jurnal edu research Indonesian Institute for Corporate Learning and Studies (IICLS), 7(1), 3802–3812. https://doi.org/10.47827/jer.v7i1.2514

Fiskawarni, T. H., Rahmawati, Widiasih, & Saad, R. (2024). The design and validation of the four tier test instrument for energy literacy using the rasch model analysis. JIPF (Jurnal Ilmu Pendidikan Fisika), 9(1), 74–87. https://doi.org/10.26737/jipf.v9i1.4717

Halik, M. F. Al, & Septiana, L. (2022). Analisa data untuk prediksi daerah rawan bencana alam di jawa barat menggunakan algoritma k-means clustering. Journal of Information System, Applied, Management, Accounting and Research, 6(4), 856–870. https://doi.org/10.52362/jisamar.v6i4.939

Handayani, E. P., Kustati, M., Amelia, R., & Gusmirawati. (2024). Program pelatihan satuan pendidikan aman bencana (spab). Jurnal Pengabdian Kepada Masyarakat, 2(1), 82–92. https://journal.staittd.ac.id/index.php/inv/article/view/177

Hilft, B. E. (2023). World Risk Report 2023. Berlin: Bündnis Entwicklung Hilft.

Islami, M., Utaya, S., & Purwanto. (2025). Model guided inquiry learning terhadap kemampuan berpikir spasial siswa sebagai penguat literasi kebencanaan. Journal of Education Action Research, 9(1), 87–95. https://doi.org/10.23887/jear.v9i1.90623

Johan, H., Mayub, A., & Wardana, R. W. (2021). Integrasi pendidikan mitigasi dalam konten pembelajaran sains sebagai upaya membangun kesadaran mitigasi dari jenjang sekolah. Jurnal Ilmiah Pengembangan Dan Penerapan IPTEKS, 19(01), 186–196. https://doi.org/10.33369/dr.v19i1.13790

Junianto, D., & Hendriani, D. (2024). Pengaruh model simulasi bencana terhadap nilai sikap kesiapsiagaan siswa pada mata pelajaran ilmu pengetahuan sosial. CENDEKIA : Jurnal Penelitian Dan Pengkajian Ilmiah, 1(1), 45–52. https://doi.org/10.62335/k0zhsw43

Lawshe, C. H. (1975). A quantitative approach to content validity. Phrsonnhl Psychology, 28(1), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x

Nainggolan, Y. A., Wahyudi, R., & Januar. (2026). Teori validasi model dan instrumen penelitian pengembangan. Jurnal Edu Research Indonesian Institute For Corporate Learning And Studies (IICLS) Page, 7(2), 2682–2695. https://doi.org/10.47827/jer.v7i2.2870

Polit, D. F., & Beck, C. T. (2006). The content validity index : are you sure you know what’s being reported ? critique and recommendations. Researchin Nursing & Health, 29, 489–497. https://doi.org/10.1002/nur

Priyasmika, R., & Sholichah, N. (2022). Analisis miskonsepsi pada materi hidrolisis garam menggunakan instrumen tes diagnostik four tier. Jurnal Riset Teknologi Dan Inovasi Pendidikan (Jartika), 5(1), 19–28. https://journal.rekarta.co.id/index.php/jartika

Putri, D. T., Umah, A. M., Fadilah, A. A., Cahya, E. D., Ristanti, A. N., & Susilo, A. (2025). Dampak literasi kebencanaan terhadap kesiapsiagaan peserta didik dalam mitigasi bencana banjir: Studi di MTSN 4 Magetan. Jurnal Pendidikan Geografi Undiksha, 13(1), 78–86. https://doi.org/10.23887/jjpg.v13i1.81752

Putri, R. E., & Subekti, H. (2021). Analisis miskonsepsi menggunakan metode four-tier certainty of response index: studi eksplorasi di SMP Negeri 60 Surabaya. Pensa E-Jurnal: Pendidikan Sains, 9(2), 220–226. https://doi.org/10.26740/pensa.v9i2.38279

Rahmawati, Widiasih, Marisda, D. H., & Riskawati. (2023). Using four-tier test to identify prospective elementary teacher students’’ misconception on electricity topic. Jurnal Penelitian Pendidikan IPA, 9(10), 7793–7802. https://doi.org/10.29303/jppipa.v9i10.3272

Ramadhan, H., Basri, I. Y., Maksum, H., & Rifdarmon. (2026). Pengembangan e-book pada mata kuliah teknologi sensor dan kontrol elektronik otomotif. Tsaqofah: Jurnal Penelitian Guru Indonesia, 6(4), 3434–3448. https://doi.org/https://doi.org/10.58578/tsaqofah.v6i4.10553

Safitra, L., Susiyanto, Rifa’i, Yuliani, H., & Ayu, E. T. (2023). Penguatan modal sosial keluarga dalam kegiatan mitigasi bencana di kelurahan Malabero kecamatan Teluk Segara Kota Bengkulu. JAMS: Jurnal Abdimas Serawai, 3(3), 139–151. https://doi.org/10.36085/jams.v3i3.5897

Sudrajat, & Wibowo, S. (2016). Pemahaman tentang manajemen bencana alam siswa sekolah menengah pertama. JIPSINDO (Jurnal Pendidikan Ilmu Pengetahuan Sosial Indonesia), 3(2), 168–189. https://doi.org/10.21831/jipsindo.v3i2.11697

Susmita, A. R., Darmawi, E., & Suri, E. W. (2023). Analisis pendekatan mitigasi bencana alam di badan nasional penanggulangan bencana kota Bengkulu. Jurnal Ilmiah Administrasi Publik, 1(2), 9–18. https://dx.doi.org/10.32663/md.v1i2.3812

Tahmidaten, L., & Krismanto, W. (2019). Implementasi pendidikan kebencanaan di Indonesia (sebuah studi pustaka tentang problematika dan solusinya). Lectura: Jurnal Pendidikan, 10(2), 136–154. https://doi.org/10.31849/lectura.v10i2.3093

Uswatun, & Mubarak, S. (2024). Pengembangan instrumen tes diagnostik four-tier untuk mengidentifikasi miskonsepsi materi konsep mol dan stoikiometri. Al Kawnu: Science And Local Wisdom Journal, 4(1), 34–49. https://doi.org/10.18592/ak.v4i1.13838

Downloads

Published

07-09-2026

How to Cite

Apriyani, A., Johan, H., Rahmawati, R., Farid, M., Sutarno, S., & Defianti, A. (2026). Content Validity Analysis of Multitier Diagnostic Test Instruments for Measuring Junior High School Disaster Literacy. JOURNAL OF SCIENCE EDUCATION AND PRACTICE, 10(2), 255–268. Retrieved from https://jsep-pasca.unpak.ac.id/index.php/jsep/article/view/54

Issue

Vol. 10 No. 2 (2026): Article in press

Section

Articles

License

Copyright (c) 2026 Apriyani Apriyani, Henny Johan, Rahmawati Rahmawati, Muchammad Farid, Sutarno Sutarno, Aprina Defianti

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.