Deep Learning Intermediate
optimizer
A specific implementation of the gradient descent algorithm.
Plain English Explanation
A specific implementation of the gradient descent algorithm. Popular optimizers include: - AdaGrad, which stands for ADAptive GRADient descent. - Adam, which stands for ADAptive with Momentum.
How is it used?
Practitioners refer to optimizer when building, training, or evaluating machine learning systems. It appears in research papers, product documentation, and technical discussions about AI capabilities and limitations.