A Theoretically Beautiful Algorithm 🎆 Pre 1980s, almost all learning methods learned linear decision surfaces, and they have nice theoretical properties. In 1980s, decision trees and neural networks have allowed efficient learning of non-linear decision surfaces, but has little theoretical basis and suffer from local minima. …