Gradient Starvation

[MichielStock]

No description provided.

[MichielStock]

• $log$ => $\log$, and put Utility and other words in \text when in math mode

Looks promising. Make it easy for yourself and just copy a 2d example of a neural network/curve fitting and show learning progress using GD and with the spectral decoupling. With Flux it should be easy to more or less reproduce the example of the blog post.

[CeriAnneLaureyssens]

Hey Peter, very nice and detailed project! 😄

The plots are a great asset in your notebook. They helped me understand some parts of the text better! Maybe it would be handy to mention which function from your src folder you used to generate the moon plots.

Another small remark, you wrote "refered" somewhere instead of "referred".

[EngelsI]

Hello Peter,

First of all, nice job with your project. While I was reading through it, I thougth that it was a research paper instead of a task a student made. The information was wel structured and detailed, which made the content understandable for someone whom is not familiar with the subject. The plots were very helpfull too.
I also took a look at your code, which is great. Only comment on this is that I would have liked to see it in the Pluto Notebook itself. So, I could see how you implemented what you wrote in your code. This was now difficult to find which part of the code belonged to which part of the notebook.

[ppm1337]

Thanks for all of your feedback, very much appreciate it and applied most of your suggestions!