AI and Compute

"Improvements in compute have been a key component of AI progress" – with compute capacity used by AI doubling every 3.5 months for the last 16 years
Since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.5 month doubling time (by comparison, Moore’s Law had an 18 month doubling period).