Beyond Fear: My Life in Cloud Engineering
Continue reading on Medium »
Artificial Intelligence, data-engineering, devops, Machine Learning, software-engineering
data-engineering
data-engineering, data-science, Machine Learning, programming, Technology
Part 18: Data Manipulation in Performance Optimization
How Memory, Data Types, and Efficiency Techniques Enable Scalable SystemsWhen you are working with datasets containing millions of rows, performance becomes more than a convenience. It becomes a necessity. I have spent years working with large-scale fi…
data-engineering, data-science, Machine Learning, programming, Technology
Part 17: Data Manipulation in Advanced Filtering and Conditional Logic
How Complex Business Rules Reshape Analytical OutcomesI’ve spent years working with datasets where the real challenge wasn’t handling missing values or merging tables. It was translating messy business logic into precise filtering operations. You know …
Artificial Intelligence, data-engineering, data-science, Machine Learning, software-engineering
Building ML in the Dark: A Survival Guide for the Solo Practitioner
Photo by Boitumelo on UnsplashNo GPU cluster. No data team. No ML platform. Here’s what actually ships.Most ML content is written for teams that have things. A labelled dataset. An MLOps platform. A data engineer who answers Slack messages. A GPU budge…
Customers, data-engineering
How MakeMyTrip Achieved Millisecond Personalization at Scale with Databricks
Delivering Real-Time Personalization at ScaleEvery millisecond counts when travelers search for hotels, flights…
Artificial Intelligence, data-engineering, data-science, product-management, Technology
Datalutionary
How data evolved from human memory to real-time systems — and why metadata is the next frontierContinue reading on Medium »
analytics, Artificial Intelligence, data-engineering, data-pipeline, leadership
The Dashboard is a Lie
How Broken Data Pipelines Are Bleeding Thousands of Engineering Hours — and Slowing InnovationContinue reading on Medium »
Artificial Intelligence, career-advice, data-engineering, faang, interview-questions
The Data Engineering Interview Is Dead. Here’s What Replaced It.
I’ve been interviewing FAANG data engineers for 8 years. I’ve personally crammed hundreds of toy problems to land offers; I’ve also sat…Continue reading on Medium »
apache-spark, data-engineering, databricks
Spark Shuffle: Under the Hood
A deep dive into Spark’s shuffle internalsContinue reading on Towards AI »
Artificial Intelligence, data-engineering, JavaScript, startup, web-development
Google’s TurboQuant is a state-of-the-art AI compression algorithm developed by Google Research…
The Math of TurboQuant: Combining PolarQuant and QJL for Lossless Vector SearchContinue reading on Medium »