Hyperparameter Tuning - When to tune hyperparameters?

It is recommended to modify hyperparameters after developing a model architecture (as in artificial neural networks) or after identifying a 'suitable' model for your goal. This verifies that the model is capable of producing predictions with a suitable level of accuracy.