"Improvements in compute have been a key component of AI progress" – with compute capacity used by AI doubling every 3.5 months for the last 16 years https://blog.openai.com/ai-and-compute/? https://blog.openai.com/ai-and-compute/ Since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.5 month doubling time (by comparison, Moore’s Continue reading →
A future of truly intelligent machines requires causal reasoning, not simply "nontrivial curve fitting" (the probabilistic association of cause and effect), argues Judea Pearl. Development of true reasoning – why a given action has a certain outcome, not just that they're correlated – would allow machines to "ask counterfactual questions" – in effect, to predict Continue reading →
Although Apple seems to be moving their focus for marketing the Watch towards health conscious consumers, there's a significant number of people who find wearing the device at work absolutely necessary to stay in touch. Many service industry workers are prohibited from checking phones during the workday or while on shift, but checking a watch Continue reading →
I have to admit – Instagram's switch from chronological to algorithmic content sequencing has left me feeling like i'm missing something if I stop browsing for a minute – but the main culprit for that is bad user interface design (the app instantly swings back to the top of the feed when it relaunches if Continue reading →
I remember years ago hearing someone describe Google's biggest rival not as another search engine, but Amazon – people "view Google as a tool to research products, while Amazon is the place they go to buy". While it seems likely that Google's Shopping Actions programme will drive business, I do not see how this will Continue reading →
While I admire Elon Musk's ability to launch big idea after big idea, I have to agree with Schmidt and Zuckerberg – his concerns about AI stink of moral panic. Yes, we need to have the difficult debates around misuse and fairness, but these debates will only be triggered by continuing to explore the possibilities, Continue reading →
How do you ensure your technically interesting project is truly a force for good, not merely further entrenching existing biases, stereotypes, and social problems? This great set of rules, based on experiences working on AI solutions in low-income countries, can help, regardless of where you're working: 1. Ask who's not at the table – are Continue reading →
I find it fascinating that there are companies out there large enough, and with specific enough use cases, to justify creating custom hardware to solve their problems. Facebook's recently confirmed that they're working on chips dedicated to analyzing live video, to allow them to respond more quickly to unacceptable or inappropriate content (such as suicide Continue reading →
Further demonstrating that just having the technology isn't enough – you have to keep innovating to stay relevant – Stitch Fix first started using AI and machine learning back in 2011, and it's given them a significant "first mover advantage" – but the commoditisation of these capabilities means that the things they once held as Continue reading →
While "replacing 300 CPU-only servers on deep learning training" is hardly a benchmark, 15,500 images per second on ResNet-50 is – just a couple of years ago, training throughput would be 1-2 orders of magnitude slower. Also of interest is the approach that Nvidia is taking here – a single compute "node" will be capable Continue reading →
I’m rob. I spend my time exploring the world, playing board games with my family, solving complex technical problems, and learning new things. Sometimes i write about them here, or code them on GitHub. I believe a few things that guide what I do and how I do it: