" What I like about stochastic gradient descent is how nuts it sounds. Imagine, for instance, that the president of the United States made decisions without any kind of global strategy; rather, the nations chief executive is surrounded by a crowd of shouting subordinates, each hollering for policy to be tweaked in a way that suits their own particular interest. And the president, every day, chooses one of those people at random to listen to, and changes course accordingly. That would be a ridiculous way for a person to run major world government, but it works pretty well in machine learning! "

― Jordan Ellenberg , Shape: The Hidden Geometry of Information, Biology, Strategy, Democracy, and Everything Else