DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Kaggle Benchmarking Challenge

Kaggle Benchmarking Challenge Submission

Kaggle Benchmarking Challenge

Comments
7 min read
RetryBudget-24: When the Right Retry Decision Still Fails the JSON Contract

Kaggle Benchmarking Challenge Submission

RetryBudget-24: When the Right Retry Decision Still Fails the JSON Contract

Comments 1
5 min read
ContractClarity: Benchmarking LLMs on Contract Understanding

Kaggle Benchmarking Challenge Submission

ContractClarity: Benchmarking LLMs on Contract Understanding

Comments
3 min read
FairHire-ES: Maternity-gap lines move Spanish résumé scores more than names (256 twin cases)

Kaggle Benchmarking Challenge Submission

FairHire-ES: Maternity-gap lines move Spanish résumé scores more than names (256 twin cases)

Comments
5 min read
Day 5: Professor Oakenscroll or: How I Hashed Every Line on My Laptop and Cut It Down to One Stranger's Photo, and... It Doesn't Matter

Day 5: Professor Oakenscroll or: How I Hashed Every Line on My Laptop and Cut It Down to One Stranger's Photo, and... It Doesn't Matter

Comments
6 min read
Cash Evidence Boundaries: Correct JSON Is Part of the Answer

Kaggle Benchmarking Challenge Submission

Cash Evidence Boundaries: Correct JSON Is Part of the Answer

Comments
4 min read
Benchmarking Bare-Metal Tool Use: Do LLMs Understand Apple Silicon L1 Cache?

Kaggle Benchmarking Challenge Submission

Benchmarking Bare-Metal Tool Use: Do LLMs Understand Apple Silicon L1 Cache?

Comments
4 min read
Phish or Legit: Do LLMs Know When NOT to Cry Wolf?

Kaggle Benchmarking Challenge Submission

Phish or Legit: Do LLMs Know When NOT to Cry Wolf?

Comments 1
3 min read
MyanmarChemCalc-Bench: Do LLMs Do Chemistry Better in English Than in Burmese?

Kaggle Benchmarking Challenge Submission

MyanmarChemCalc-Bench: Do LLMs Do Chemistry Better in English Than in Burmese?

Comments
3 min read
Reward Evidence: an AI can track the money and still misread the opportunity

Kaggle Benchmarking Challenge Submission

Reward Evidence: an AI can track the money and still misread the opportunity

Comments
6 min read
'No peanuts' became include_ingredients: ["peanuts"]: a benchmark for tool calls a validator cannot catch

Kaggle Benchmarking Challenge Submission

'No peanuts' became include_ingredients: ["peanuts"]: a benchmark for tool calls a validator cannot catch

Comments 1
11 min read
Same Score, Different Failure: Fechamento BR

Kaggle Benchmarking Challenge Submission

Same Score, Different Failure: Fechamento BR

Comments
8 min read
Day 3: The benchmark caught me too.

Day 3: The benchmark caught me too.

Comments
6 min read
I asked AI to undo its work. One model broke 7 of 12 already-correct records.

Kaggle Benchmarking Challenge Submission

I asked AI to undo its work. One model broke 7 of 12 already-correct records.

Comments
7 min read
FrameFlip48: four models, one frame switch, two kinds of failure

Kaggle Benchmarking Challenge Submission

FrameFlip48: four models, one frame switch, two kinds of failure

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
⌂ 换网址