Research

Scaling Kubernetes to 7,500 nodes

We’ve scaled Kubernetes clusters to 7,500 nodes, producing a scalable infrastructure for large models like GPT-3, CLIP, and DALL·E, but also for rapid small-scale iterative research such as Scaling Laws for Neural Language Models.

ai, Software

This Is The Year To Use JavaScript For Machine Learning, Here’s Why

With 2020 fading over the horizon, we can finally reflect on ‘what was’ versus ‘what could have been.’ It was undoubtedly the year of many upended plans, with countless surprises and course-changes along the way. But there’s one resounding takeaway from the last twelve months. And it’s unlikely to change this year: JavaScript has grown […]

Artykuł This Is The Year To Use JavaScript For Machine Learning, Here’s Why pochodzi z serwisu DLabs.AI.

Uncategorised

December newsletter

December 2020 gwern.net newsletter with links on AI and technology; major new site feature: fully-generalized recursive popups.

Research

CLIP: Connecting text and images

We’re introducing a neural network called CLIP which efficiently learns visual concepts from natural language supervision. CLIP can be applied to any visual classification benchmark by simply providing the names of the visual categories to be recognize…

Scroll to Top