DEV Community

Deep Learning

This tag is for discussing, sharing articles, and asking questions primarily on deep learning - a subfield of machine learning.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
From Attention to 3-Bit Caches: How LLMs Learned to Remember Less (MHA, GQA, MLA, MoE, Quantisation Explained)

From Attention to 3-Bit Caches: How LLMs Learned to Remember Less (MHA, GQA, MLA, MoE, Quantisation Explained)

6
Comments
22 min read
Oracle and DeepLearning.AI Launch New Agent Memory Course for AI Developers

Oracle and DeepLearning.AI Launch New Agent Memory Course for AI Developers

Comments
25 min read
From Lab to Code #4: Exploring Neural Network Efficiency with Python and PyTorch

From Lab to Code #4: Exploring Neural Network Efficiency with Python and PyTorch

Comments
12 min read
Batch normalization, visually: the reset that keeps deep networks steady

Batch normalization, visually: the reset that keeps deep networks steady

Comments
5 min read
The Shift to Test-Time Compute: Why AI is Learning to "Think" Before it Speaks

The Shift to Test-Time Compute: Why AI is Learning to "Think" Before it Speaks

Comments
3 min read
Deep Learning vs Machine Learning: Which Does Your Project Actually Need?

Deep Learning vs Machine Learning: Which Does Your Project Actually Need?

Comments
4 min read
Weight-Space Programming: When LLMs Learn to Read and Rewrite Neural Network Weights

Weight-Space Programming: When LLMs Learn to Read and Rewrite Neural Network Weights

Comments
5 min read
How to Test the Best Image Annotation Service Providers

How to Test the Best Image Annotation Service Providers

Comments
7 min read
Beyond Static Layers: The Architecture of Mixture-of-Depths (MoD)

Beyond Static Layers: The Architecture of Mixture-of-Depths (MoD)

Comments
3 min read
BudgetMix RL: What Multi-Turn Reinforcement Learning Really Improves in LLM Agents

BudgetMix RL: What Multi-Turn Reinforcement Learning Really Improves in LLM Agents

Comments
4 min read
Research Synthesis: Inside the Architectures of Open-Source LLMs: Attention, MoE, Hybrid Layers and Quantization

Research Synthesis: Inside the Architectures of Open-Source LLMs: Attention, MoE, Hybrid Layers and Quantization

Comments
2 min read
Warmup Did Nothing for My Learning Rate — Then It Fully Rescued the Wrong One

Warmup Did Nothing for My Learning Rate — Then It Fully Rescued the Wrong One

Comments
4 min read
My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay

My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay

Comments
4 min read
Own GPU vs rented GPU vs hosted API: a comparison you can redo in an afternoon

Own GPU vs rented GPU vs hosted API: a comparison you can redo in an afternoon

Comments
3 min read
The Shift to Test-Time Compute: Why AI is Learning to "Think" Before it Speaks

The Shift to Test-Time Compute: Why AI is Learning to "Think" Before it Speaks

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.
⌂ 换网址