AI-Driven Control of a Robotic Arm in Virtual Reality

The AI+X Extended Major Program heralds a new era in engineering education. However, the integration of Artificial Intelligence (AI) into Mechanical Engineering (ME) instruction presents practical challenges. One significant hurdle is providing hands-on experiences due to the need for direct interaction with complex physical systems (e.g. controlling a robotic arm). To address this, this project will reinforce one ME course while revitalizing two others, fusing theoretical instruction with practical VR simulations utilizing Matlab, Unity Engine and Oculus VR into one unified platform. Students will take the theory learnt in class and delve into data-driven methodologies within a virtual, risk-free setting, concentrating on supervised learning to render abstract AI principles into concrete applications. This VR platform and, the proposed companion education methodology, will enable both “Action Research Approach” for iterative studying, and "Learning by Failure Approach” for releasing creativity. Designed to expand into broader ME applications, this project not only solidifies the theoretical and practical aspects of the data-driven approach in ME but also equips students with the necessary skills to tackle future industry challenges