Understanding Reasoning LLMs
In this article, I will describe the four main approaches to building reasoning models, or how we can enhance LLMs with reasoning capabilities. I hope this…
ai, deep-learning, llm, Machine Learning
Machine Learning
ai, deep-learning, llm, Machine Learning
Noteworthy LLM Research Papers of 2024
This article covers 12 influential AI research papers of 2024, ranging from mixture-of-experts models to new LLM scaling laws for precision.
ai, deep-learning, llm, Machine Learning
Implementing A Byte Pair Encoding (BPE) Tokenizer From Scratch
This is a standalone notebook implementing the popular byte pair encoding (BPE) tokenization algorithm, which is used in models like GPT-2 to GPT-4, Llama…
ai, deep-learning, llm, Machine Learning
LLM Research Papers: The 2024 List
I want to share my running bookmark list of many fascinating (mostly LLM-related) papers I stumbled upon in 2024. It’s just a list, but maybe it will come…
ai, community, computer-vision, Google AI, LiteRT, Machine Learning, On-device AI, Person Detection, Research, TensorFlow Lite
Introducing Wake Vision: A High-Quality, Large-Scale Dataset for TinyML Computer Vision Applications
Posted by Colby Banbury, Emil Njor, Andrea Mattia Garavagno, Vijay Janapa Reddi – Harvard University
TinyML is an exciting frontier in machine learning, enabling models to run on extremely low-power devices such as microcontrollers and edge dev…
ai, community, data-engineering, Deployment, Machine Learning, Model Development, Monitoring & Maintenance, Optimization, SocratiQ, Systems Engineering
MLSysBook.AI: Principles and Practices of Machine Learning Systems Engineering
Posted by Jason Jabbour, Kai Kleinbard and Vijay Janapa Reddi (Harvard University)
Everyone wants to do the modeling work, but no one wants to do the engineering.
If ML developers are like astronauts exploring new frontiers, ML systems enginee…
ai, deep-learning, llm, Machine Learning
Understanding Multimodal LLMs
There has been a lot of new research on the multimodal LLM front, including the latest Llama 3.2 vision models, which employ diverse architectural…
ai, deep-learning, llm, Machine Learning
Building A GPT-Style LLM Classifier From Scratch
This article shows you how to transform pretrained large language models (LLMs) into strong text classifiers. But why focus on classification? First…
ai, deep-learning, llm, Machine Learning
Building LLMs from the Ground Up: A 3-hour Coding Workshop
This tutorial is aimed at coders interested in understanding the building blocks of large language models (LLMs), how LLMs work, and how to code them from…
ai, deep-learning, llm, Machine Learning
New LLM Pre-training and Post-training Paradigms
There are hundreds of LLM papers each month proposing new techniques and approaches. However, one of the best ways to see what actually works well in…