why does optimisers exist in feed-forward networks(FFNs)? (based on my answer that is to update weights) why does so many optimisers exist, if all that they need to do is to update weights, why does so many exist?

Question

Accepted Answer

Optimizers exist in FFNs to update weights, but many exist due to different optimization techniques and trade-offs.

Different optimizers use different optimization techniques such as momentum, adaptive learning rates, and regularization.
Optimizers have different trade-offs such as convergence speed, generalization, and robustness to noisy data.
The choice of optimizer depends on the specific problem and data set.
Examples of optimizers include SGD, Adam, Adagrad, and RMSprop.

why does optimisers exist in feed-forward networks(FFNs)? (based on my answer that is to update weights) why does so many optimisers exist, if all that they need to do is to update weights, why does so many exist?

Popular interview questions of RND Engineer