I always find that whenever such topics come up for discussion Ted Gray had the best take - https://theodoregray.com/BrainRot/.

With AI and specifically LLMs, I feel many of the points raised here about 25 years ago still stands. Any LLM based learning isn't meant to push students into thinking about the problem or even guiding students along the path to the correct answer. It's mostly about returning some answer -- mostly right but not really of a good quality. As pointed out in Ted Gray's article, any assisted learning mechanism should work towards making the student think about the problem at hand and reason their way through it. It's an aide to the human teacher because, it being a machine and most importantly software, can adapt to each and every single student's ability and work at the student's pace instead of 3 periods of an hour each per week. An LLM by definition is the opposite. It gives you the next most probable character without any idea of what it's saying. There is a lot of work being done on this ofc, but what's available today isn't a reasoning aide/teacher.