DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
MY Edit or Abstain: AI Code-Repair Decision Benchmark
rajab_baig_a3929cefc3758b profile

MY Edit or Abstain: AI Code-Repair Decision Benchmark

#devchallenge #kagglechallenge #ai #machinelearning
Comments
3 min read
I put one wrong test in the file. Most models sided with the test.

Kaggle Benchmarking Challenge Submission
anaalkmim profile

I put one wrong test in the file. Most models sided with the test.

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
6 min read
Only What I Asked
akj1608 profile

Only What I Asked

#kagglechallenge #ai
Comments
3 min read
Hook constraint benchmark kaggle-challenge DONE !!!

Kaggle Benchmarking Challenge Submission
shahzeen_anwar_75143f6785 profile

Hook constraint benchmark kaggle-challenge DONE !!!

#devchallenge #kagglechallenge #ai #machinelearning
Comments
3 min read
Small AI Models Can See the Trap. They Fall In Anyway

Kaggle Benchmarking Challenge Submission
mujohn26 profile

Small AI Models Can See the Trap. They Fall In Anyway

#devchallenge #kagglechallenge #ai #machinelearning
1
Comments
5 min read
Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

Kaggle Benchmarking Challenge Submission
tdealer01crypto profile

Can an AI Agent Know When Not to Act? A Fail-Closed Reliability Benchmark Across Six Models

#devchallenge #kagglechallenge #ai #machinelearning
Comments
4 min read
Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

Kaggle Benchmarking Challenge Submission
ridhoajaaa profile

Do LLMs Actually Check Their Tools? I Built a Benchmark That Lies to Them

#devchallenge #kagglechallenge #ai #machinelearning
2
Comments 5
8 min read
100% vuln detection wasn't enough: measuring whether AI respects the patch

Kaggle Benchmarking Challenge Submission
unit_500_c36d1b1011fdf39c profile

100% vuln detection wasn't enough: measuring whether AI respects the patch

#devchallenge #kagglechallenge #ai #machinelearning
7
Comments 4
6 min read
Green Tests, Broken Architecture: Four Models Review TypeScript Diffs

Kaggle Benchmarking Challenge Submission
pavel_kkkkazantsev profile

Green Tests, Broken Architecture: Four Models Review TypeScript Diffs

#devchallenge #kagglechallenge #ai #machinelearning
11
Comments 2
4 min read
I Gave 15 AI Models Proof Their Hacking Target Was a Real Company. 73% of the Ones That Noticed Told No One.

Kaggle Benchmarking Challenge Submission
soumyadeepdey profile

I Gave 15 AI Models Proof Their Hacking Target Was a Real Company. 73% of the Ones That Noticed Told No One.

#devchallenge #kagglechallenge #ai #machinelearning
91
Picked as gem Comments 67
44 min read
LAW-N Real-World Data Layer
peacebinflow profile

LAW-N Real-World Data Layer

#devchallenge #kagglechallenge #ai #machinelearning
3
Comments
8 min read
Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

Kaggle Benchmarking Challenge Submission
kakarotdev profile
Axel

Don't Take Orders From the Internet: Benchmarking 5 LLMs Against Indirect Prompt Injection

#kagglechallenge #ai #llm #programming
Comments
7 min read
A CSV benchmark with two zero scores and a useful diagnostic

Kaggle Benchmarking Challenge Submission
simon_levy_e0b34a39073843 profile

A CSV benchmark with two zero scores and a useful diagnostic

#devchallenge #kagglechallenge #ai #machinelearning
Comments 1
7 min read
I Surveyed 123 People in India to Benchmark Frontier AI

Kaggle Benchmarking Challenge Submission
kakeroth profile

I Surveyed 123 People in India to Benchmark Frontier AI

#devchallenge #kagglechallenge #ai #machinelearning
26
Comments
5 min read
DarijaBench: Do AI Models Actually Understand Moroccan Darija?

Kaggle Benchmarking Challenge Submission
soufianezaari profile

DarijaBench: Do AI Models Actually Understand Moroccan Darija?

#kagglechallenge #llm #ai
1
Comments 2
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.