A Pilot Study of Using ChatGPT as a Teaching Tool for Software Engineering Education
2023-09-13, 09:00– (Asia/Tokyo), Terrsa Hall A

The aim of this study is to investigate the efficacy of using ChatGPT to support teaching in software engineering education, focusing on its impact on both the efficiency and effectiveness of teaching. The study will employ a mixed-method research design, collecting and analysing both qualitative and quantitative data related to students' academic performance, educators' preparation of teaching and learning material, and students' perceptions of the teaching methods.

The participants of this investigation will consist of higher diploma students in software engineering at the Hong Kong Institute of Vocational Education. These students will be allocated randomly to one of two groups: control group shall be provided with human-created learning content, while the experimental group will receive teaching material and interim feedback generated by ChatGPT.

ChatGPT-generated teaching and learning materials will encompass a variety of resources to support instruction, such as lecture presentations, tutorial notes, assignments and assessments, and marking schemes. These resources will be thoroughly validated and moderated by the lecturer to ensure alignment between the two groups.

Using ChatGPT as a pedagogical tool is expected to amplify the efficiency in teaching software engineering, leading to superior performance by the experimental group over the control group. A supplementary objective of the study is to assess and scrutinise the feasibility of relieving teachers from the burden in preparing instructional materials with the assistance of ChatGPT. The study's results will exemplify the value and usefulness of employing ChatGPT to assist teaching.

This research will contribute to the growing body of knowledge on the use of artificial intelligence in education and has implications for the broader field of teaching and learning. Future research can explore the use of ChatGPT in teaching other subjects and investigate students' perceptions of using ChatGPT as a teaching and learning tool.


This study aims to examine the impact of using ChatGPT as a teaching tool on the efficiency and effectiveness of teaching software engineering students. The research design employs a mixed-method approach, including both qualitative and quantitative data collection and analysis methods. The study participants are higher diploma students in software engineering at the Hong Kong Institute of Vocational Education, randomly divided into two groups. The study aims to investigate if ChatGPT improves academic performance, reduces the workload of educators in preparing teaching and learning material, and improves student perceptions of the teaching methods. The study hypothesises that ChatGPT as a teaching tool will enhance the efficiency and effectiveness of teaching software engineering students.


Keywords

ChatGPT, teaching tool, EdTech tool, software engineering education, artificial intelligence-assisted teaching, teaching efficiency, teaching effectiveness

See also: Full Paper

Yu Ho Kwok is a Senior Lecturer at the Information Technology Department of the Hong Kong Institute of Vocational Education, where he is currently the Programme Leader for the Higher Diploma in AI and Mobile Application Development. With over 13 years of experience in teaching and programme development, he is responsible for daily operations, programme development, quality assurance, R&D, and industrial collaboration.

Mr Kwok has taught modules at both degree and sub-degree levels, specialising in artificial intelligence application and mobile application development. He is also the Chief Expert for the WorldSkills competition and has received several certifications and awards, including HCIA-AI instructor, Apple Distinguished Educator (Class of 2019), and the Apple Certified Trainer (ACT).

Mr Kwok's research interests include mobile application innovation, developing education software to enhance teaching and learning, and technology-enhanced learning using artificial intelligence.

This speaker also appears in:

Alexander Wong is a Senior Project Officer at the Centre for Learning and Teaching, Vocational Training Council (VTC), Hong Kong. With over a decade of experience in teaching and designing curriculum, he currently focuses on teacher training for the 13 member institutions of VTC. Recently, he established the Artificial Intelligence in Education Series, which aims to equip teaching and instructing staff with the necessary knowledge and skills to integrate A.I. technologies into their teaching practices.

Alexander has received several international awards in the areas of communication design, interactive and interaction design, including the Red Dot Award, A'Design Award, Golden Pin Design Award, and The IDA International Design Award.

Prior to joining VTC, Alexander worked as a new media artist and interactive technologist with an interest in harnessing creativity through technology. He believes that science and art should combine to explore potential possibilities, and that research findings, techniques, and creativity should be able to provide solutions applicable in the community and to address practical problems in society.

His current research interests include technology-enhanced teaching and learning, artificial intelligence in education, community-based service learning, blended learning and video-based learning.