We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less…
While there is much talk about the future of AI in gaming and the myriad of potential implementations, the current usage of AI in the game industry is not nearly as some make it out to be, nor is it really a massive focus for game developers. That …
This is the April 2020 edition of the gwern.net newsletter; previous, March 2020 (archives).
I spent the last month becoming a connoisseur of digital contact tracing approaches since this seems like something where I might be able to help. Many other people have been thinking along similar lines (great), but I also see several misconceptions that even smart and deeply involved people are making. For the following a key …
Continue reading “Critical issues in digital contract tracing”
We’ve contributed to a multi-stakeholder report by 58 co-authors at 30 organizations, including the Centre for the Future of Intelligence, Mila, Schwartz Reisman Institute for Technology and Society, Center for Advanced Study in the Behavioral Sciences…
We’re introducing OpenAI Microscope, a collection of visualizations of every significant layer and neuron of eight vision “model organisms” which are often studied in interpretability. Microscope makes it easier to analyze the features that form inside…
Technological trends have a great impact on the business processes and this is mainly due to the constant evolution in technology. Therefore, businesses have taken conscious steps towards adopting these latest technological trends for numerous positive…
[Updated on 2023-01-27: After almost three years, I did a big refactoring update of this post to incorporate a bunch of new Transformer models since 2020. The enhanced version of this post is here: The Transformer Family Version 2.0. Please refer to t…
A Google interview candidate recently asked me: “What are three big science questions that keep you up at night?” This was a great question because one’s answer reveals so much about one’s intellectual interests – here are mine:
Q1: Can we imitate “th…