What Could Stop AI Scaling?

(The Information) So far, many of the improvements in large language models’ capabilities have stemmed from a surprisingly simple concept: scaling laws. Essentially, researchers have noticed that the more computing power and data you use to train AI models, the better they perform. 

Read more here.