The Bitter Lesson (or general learning is better than specific)

The lesson from the last several decades is that when it comes to AI, general learning approaches are superior - esp when you take into account that compute gets cheaper over time.