Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
modeldistillation
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Model Distillation & Quantization: Running 8B Parameter Models at a Fraction of Cloud Cost
Muhammad Tahir
Muhammad Tahir
Muhammad Tahir
Follow
Oct 12
Model Distillation & Quantization: Running 8B Parameter Models at a Fraction of Cloud Cost
#
modeldistillation
#
quantization
#
vllm
#
awq
Comments
Add Comment
10 min read
Moderation
Deploying SLMs in Production: Fine-Tuning vs Context Engineering
Muhammad Tahir
Muhammad Tahir
Muhammad Tahir
Follow
Sep 12
Deploying SLMs in Production: Fine-Tuning vs Context Engineering
#
peft
#
smalllanguagemodels
#
onnxruntime
#
modeldistillation
1
 reaction
Comments
Add Comment
10 min read
Moderation
AI Reasoning Leak: Extracting Models' Inner Thoughts
LuckyTaorem
LuckyTaorem
LuckyTaorem
Follow
Aug 13
AI Reasoning Leak: Extracting Models' Inner Thoughts
#
security
#
aisecurity
#
modeldistillation
#
reasoningleak
Comments
Add Comment
7 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
⌂ 换网址
