Many universities worry that AI tools like chatbots might hurt learning, especially when they are one-size-fits-all or centrally designed. This study tested a different approach: letting individual instructors create their own AI tools tailored to their specific classes and students.
The researchers ran a large randomized trial across 7,200 students at 19 universities. Instructors designed diverse AI innovations, from personalized tutors and coaching agents to interactive simulations that let students role-play with AI personas. The tools were used in real classes over three semesters.
The main finding was that student learning improved by about a third of a standard deviation, measured by proctored exams. Student engagement and satisfaction did not change. This suggests that AI can enhance learning when frontline instructors are empowered to design solutions for their own classrooms.
