DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
PennyWise Economic Decisions: Benchmarking Frontier LLMs on Financial Reasoning Efficiency

Kaggle Benchmarking Challenge Submission

PennyWise Economic Decisions: Benchmarking Frontier LLMs on Financial Reasoning Efficiency

Comments 2
2 min read
Python Reliability Benchmark: Testing AI Models Beyond Correct Answers

Python Reliability Benchmark: Testing AI Models Beyond Correct Answers

Comments 1
2 min read
KEMT: Benchmarking AI Translation Across Five Kenyan Languages

Kaggle Benchmarking Challenge Submission

KEMT: Benchmarking AI Translation Across Five Kenyan Languages

1
Comments 3
12 min read
It scored 100%. Its note scored 0%

Kaggle Benchmarking Challenge Submission

It scored 100%. Its note scored 0%

6
Comments 2
7 min read
Can a Better Model Be a Worse Thinking Partner?

Kaggle Benchmarking Challenge Submission

Can a Better Model Be a Worse Thinking Partner?

4
Comments 2
10 min read
A sharper eye did not make a more careful model.

Kaggle Benchmarking Challenge Submission

A sharper eye did not make a more careful model.

14
Comments 4
10 min read
7 LLMs reconciled 73 Pix statements: 99.6% correct order links, zero invented orders observed, and the hard part was the clock

Kaggle Benchmarking Challenge Submission

7 LLMs reconciled 73 Pix statements: 99.6% correct order links, zero invented orders observed, and the hard part was the clock

Comments 5
10 min read
Keep the number you wrote: 40 beach plans, 8 models, and where the knots went

Kaggle Benchmarking Challenge Submission

Keep the number you wrote: 40 beach plans, 8 models, and where the knots went

1
Comments 2
5 min read
Promise Is Not Payment: Verification Errors That Amount Accuracy Misses

Kaggle Benchmarking Challenge Submission

Promise Is Not Payment: Verification Errors That Amount Accuracy Misses

Comments 2
6 min read
Same Kind of Bug Isn't the Same Bug: Where AI Models Get Fooled

Kaggle Benchmarking Challenge Submission

Same Kind of Bug Isn't the Same Bug: Where AI Models Get Fooled

1
Comments 2
14 min read
Give an LLM no facts and ask for a job ad. What does it commit to?

Kaggle Benchmarking Challenge Submission

Give an LLM no facts and ask for a job ad. What does it commit to?

Comments
7 min read
12 of 13 AI models knew the new name and still wrote the old one

Kaggle Benchmarking Challenge Submission

12 of 13 AI models knew the new name and still wrote the old one

27
Comments 17
11 min read
Chain-of-Thought Faithfulness: Toggling 'Reasoning Mode' Made One Model 5x More Likely to Follow Its Own Mistakes

Kaggle Benchmarking Challenge Submission

Chain-of-Thought Faithfulness: Toggling 'Reasoning Mode' Made One Model 5x More Likely to Follow Its Own Mistakes

63
Comments 36
5 min read
Breaking Character: How "Thinking" AI Survives Villain Roleplay Traps

Breaking Character: How "Thinking" AI Survives Villain Roleplay Traps

Comments
2 min read
Where Did My Data Go? Benchmarking LLMs as Data Pipeline Detectives

Kaggle Benchmarking Challenge Submission

Where Did My Data Go? Benchmarking LLMs as Data Pipeline Detectives

12
Comments 6
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
⌂ 换网址