Attention and Augmented Recurrent Neural Networks
A visual overview of neural attention, and the powerful extensions of neural networks being built on top of it.
Uncategorised
Research
Infrastructure for deep learning
Deep learning is an empirical science, and the quality of a group’s infrastructure is a multiplier on progress. Fortunately, today’s open-source ecosystem makes it possible for anyone to build great deep learning infrastructure.
Company
Machine Learning Unconference
The latest information about the Unconference is now available at the Unconference wiki, which will be periodically updated with more information for attendees.
Machine Learning, python
Model evaluation, model selection, and algorithm selection in machine learning
In this second part of this series, we will look at some advanced techniques for model evaluation and techniques to estimate the uncertainty of our…
Company
Special projects
Impactful scientific work requires working on the right problems—problems which are not just interesting, but whose solutions matter.
Safety & Alignment
Concrete AI safety problems
We (along with researchers from Berkeley and Stanford) are co-authors on today’s paper led by Google Brain researchers, Concrete Problems in AI Safety. The paper explores many research problems around ensuring that modern machine learning systems opera…
Company
OpenAI technical goals
OpenAI’s mission is to build safe AI, and ensure AI’s benefits are as widely and evenly distributed as possible.
Research
Generative models
This post describes four projects that share a common theme of enhancing or using generative models, a branch of unsupervised learning techniques in machine learning. In addition to describing our work, this post will tell you a bit more about generati…
Machine Learning, python
Model evaluation, model selection, and algorithm selection in machine learning
Machine learning has become a central part of our life — as consumers, customers, and hopefully as researchers and practitioners! Whether we are applying…