"Improvements in compute have been a key component of AI progress" – with compute capacity used by AI doubling every 3.5 months for the last 16 years
https://rob.al/2Lc2G9S?
https://rob.al/2Lc2G9S
Since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.5 month doubling time (by comparison, Moore’s Law had an 18 month doubling period).
AI and Compute
Published