Assistance in Preparing Engineering Prompts for Muhammadiyah School Teachers to Optimize the Use of ChatGPT in the World of Education
Pendampingan Penyusunan Prompt Engineering Bagi Guru Sekolah Muhammadiyah Untuk Mengoptimalkan Pemanfaatan ChatGPT Di Dunia Pendidikan
Abstract
ChatGPT, a widely used Large Language Model (LLM), enhances productivity in various sectors, including education. However, its extensive usage often lacks proficiency in writing effective prompts, resulting in less optimal, biased, and hallucinated outputs. This community service initiative by Universitas Muhammadiyah Malang (UMM) aims to educate teachers on prompt engineering, enabling them to (i) write effective prompts to utilize ChatGPT's potential, (ii) educate about potential biases and hallucinations of ChatGPT, and (iii) integrate ChatGPT into educational practices with integrity. Partnering with three Muhammadiyah Schools, the program trains 7-8 teachers from each institution. The training covers five key areas: (a) prompt engineering introduction, (b) building optimal prompts, (c) leveraging ChatGPT in teaching and learning, (d) prompt engineering for educational material creation, and (e) ethics of LLM usage in professional and academic settings. The effectiveness of this program is evaluated through pre-test and post-test questionnaires. Results indicate a significant improvement in prompt engineering proficiency, rising from 35.3% (pre-test) to 87.5% (post-test), and in the utilization of ChatGPT for learning support, increasing from 23.5% (pre-test) to 81.3% (post-test).
Downloads
References
Chen, B., Zhang, Z., Langrené, N., & Zhu, S. (2023). Unleashing the potential of prompt engineering in Large Language Models: a comprehensive review. 1–25. http://arxiv.org/abs/2310.14735
Cheng, K., Li, Z., Li, C., Xie, R., Guo, Q., He, Y., & Wu, H. (2023). The Potential of GPT-4 as an AI-Powered Virtual Assistant for Surgeons Specialized in Joint Arthroplasty. 51, 1366–1370. https://doi.org/10.1007/s10439-023-03207-z
Hariri, W. (2023). Unlocking the Potential of ChatGPT: A Comprehensive Exploration of its Applications, Advantages, Limitations, and Future Directions in Natural Language Processing. http://arxiv.org/abs/2304.02017
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 1–12. https://doi.org/10.1016/j.lindif.2023.102274
Liu, V., & Chilton, L. B. (2022). Design Guidelines for Prompt Engineering Text-to-Image Generative Models. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3491102.3501825
Neumann, M., Rauschenberger, M., & Schon, E. M. (2023). “We Need To Talk About ChatGPT”: The Future of AI and Higher Education. Proceedings - 2023 IEEE/ACM 5th International Workshop on Software Engineering Education for the Next Generation, SEENG 2023, March, 29–32. https://doi.org/10.1109/SEENG59157.2023.00010
Raj, R., Singh, A., Kumar, V., & Verma, P. (2023). Analyzing the potential benefits and use cases of ChatGPT as a tool for improving the efficiency and effectiveness of business operations. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 3(3), 100140. https://doi.org/10.1016/j.tbench.2023.100140
Ray, P. P. (2023). ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope. Internet of Things and Cyber-Physical Systems, 3(April), 121–154. https://doi.org/10.1016/j.iotcps.2023.04.003
Sok, S., & Heng, K. (2023). ChatGPT for Education and Research: A Review of Benefits and Risks. SSRN Electronic Journal, January. https://doi.org/10.2139/ssrn.4378735
Yu, W., Zhu, C., Fang, Y., Yu, D., Wang, S., Xu, Y., Zeng, M., & Jiang, M. (2022). Findings of the Association for Computational Linguistics Dict-BERT: Enhancing Language Model Pre-training with Dictionary. Findings of the Association for Computational Linguistics, 1907–1918.
