📄️ Reminders
Suppose $f:K \rightarrow \mathbb R$
Optimization is a theoretical methodology framework to find the minimum of a function. When you know that, you can understand that is really important in ML where your work is to find extrema, particularly the risk ones. Optimization is a field in its own right. Therefore, I will only provide an introduction and will not go into more detail than is necessary for ML.
Suppose $f:K \rightarrow \mathbb R$