dent is trying to learn a difficult topic, like advanced calculus. The teacher (the optimizer in our case) is there to guide the student (the model) through the learning process. 

In traditional methods, the teacher gives detailed feedback on every single problem the student works on. This is effective but requires a lot of time and energy from the teacher (akin to high memory usage in model training).

Now, imagine if the teacher could give equally effective guidance but without having to spend as much ti