The blue line could be an example of overfitting a linear function due to random noise. Settling on a bad, overly sophisticated concept gerrymandered to fit all of the past training data is recognized as overfitting.

By iterative optimisation of an objective function, supervised le