The Impact of AI Tools on Assessment Data

Assessment practices must now consider the impact of student use of AI. Understanding how AI tools like Chat-GPT and GitHub Copilot can solve many engineering and programming problems will allow us to design and deploy more effective assessment instruments and collect more meaningful data. This presentation will consider example instruments used by various programs, e.g., computer science, electrical engineering, and mechanical engineering, and demonstrate how the increasing student use of AI tools could mislead as to the perceived degree of student outcome attainment. General suggestions for improving the design and deployment of assessment instruments will be offered, as well as specific examples of improvement efforts made by the presenter’s program to address these AI challenges. Active discussions will be invited during the Q&A portion to facilitate knowledge transfer among attendees.