Google Cloud Professional Machine Learning Engineer — Question 115

During batch training of a neural network, you notice that there is an oscillation in the loss. How should you adjust your model to ensure that it converges?

Answer options

• A. Decrease the size of the training batch.
• B. Decrease the learning rate hyperparameter.
• C. Increase the learning rate hyperparameter.
• D. Increase the size of the training batch.

Correct answer: B

Explanation

The correct approach is to decrease the learning rate hyperparameter, as a lower learning rate can help stabilize the training process and reduce oscillations in the loss. Decreasing the size of the training batch (option A) may not directly address the convergence issue, while increasing the learning rate (option C) could exacerbate the problem. Increasing the size of the training batch (option D) is unlikely to resolve the oscillation either.