The learning rate and the tree depth are settings you choose before training. Their best values hide on a narrow ridge. Search with a neat grid, scatter random tries, or zoom in near the best, and see which finds the ridge with the same nine tries. Then search the learning rate in plain steps. This lesson needs JavaScript.