DEV Community

#llm

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
I Autoscaled My LLM on Queue Depth. It Scaled Down Under Full Load.

I Autoscaled My LLM on Queue Depth. It Scaled Down Under Full Load.

4
Comments 3
10 min read
Showing my work: the four artifacts behind an AI judge for generated courses (part 1)

Showing my work: the four artifacts behind an AI judge for generated courses (part 1)

1
Comments
8 min read
Los ataques ya apuntan al propio modelo de IA: un reto abierto para romper un kernel de seguridad, con 4.500 dólares en premios

Los ataques ya apuntan al propio modelo de IA: un reto abierto para romper un kernel de seguridad, con 4.500 dólares en premios

Comments
4 min read
NUMALLAMA: fast LLM inference on multi-socket CPU servers

NUMALLAMA: fast LLM inference on multi-socket CPU servers

Comments
3 min read
Living in the Terminal with your LLM

Living in the Terminal with your LLM

Comments
11 min read
We ran a 5-model, 24-question study for $0.87 — and published the receipt

We ran a 5-model, 24-question study for $0.87 — and published the receipt

Comments
2 min read
The Stronger the Large Model, the More “Redundant” Data Governance? A Question qData Data Middle Platform Must Answer Directly

The Stronger the Large Model, the More “Redundant” Data Governance? A Question qData Data Middle Platform Must Answer Directly

Comments
6 min read
My local LLM suggested 27 references. Only 7 passed verification.

My local LLM suggested 27 references. Only 7 passed verification.

Comments
3 min read
You're Learning LLMs in the Wrong Order

You're Learning LLMs in the Wrong Order

Comments
11 min read
Shipping a real on-device LLM app on Android: 5 LiteRT-LM production bugs nobody warns you about

Shipping a real on-device LLM app on Android: 5 LiteRT-LM production bugs nobody warns you about

Comments
3 min read
Zero-Server AI: Running LLMs and Vector Search Inside the Browser with WebGPU

Zero-Server AI: Running LLMs and Vector Search Inside the Browser with WebGPU

Comments
11 min read
OpenAI’s GPT-6.2 Astra and Sol: What Developers Should Know

OpenAI’s GPT-6.2 Astra and Sol: What Developers Should Know

Comments
4 min read
The History of MOPD(Multi-Teacher On-Policy Distillation) | MOPD(多教师在线策略蒸馏)起源与发展历史

The History of MOPD(Multi-Teacher On-Policy Distillation) | MOPD(多教师在线策略蒸馏)起源与发展历史

Comments
1 min read
Gemini 4 Neon Fiyatlandırması: 3 Dolar Girdi, 15 Dolar Çıktı ve Bir API Çağrısının Gerçek Maliyeti

Gemini 4 Neon Fiyatlandırması: 3 Dolar Girdi, 15 Dolar Çıktı ve Bir API Çağrısının Gerçek Maliyeti

Comments
10 min read
Gemini 4 Neon Pricing: $3 Input, $15 Output and What a Call Really Costs

Gemini 4 Neon Pricing: $3 Input, $15 Output and What a Call Really Costs

Comments
8 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.
⌂ 换网址