Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Oct 6

LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

#llm #ai #evaluation #calibration

5 min read

Oct 6

Sorry, That Was For Another Chat

#ai #agents #evaluation #claude

8 min read

orca forge

Oct 2

Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

#llm #ai #evaluation #japanese

12 min read

Oct 5

Done Is Testimony. Terminal State Is the Grade.

#ai #agents #evaluation #testing

4 min read

Artyom Kornilov

Oct 1

Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements

#encryption #security #cryptography #evaluation

12 min read

RESK

Oct 2

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Reverse Engineering Benchmark

#llm #evaluation #benchmark #reverseengineering

4 min read

Priyansh Kansara

Oct 3

I rejected a model that passed everyone else's benchmark

#machinelearning #deepfake #evaluation #python

5 min read

RESK

Sep 30

Election Forecasting Benchmarks: How LFORLA Scores Political Bias in LLMs

#llm #benchmark #politics #evaluation

4 min read

Jason Lau

Sep 24

Your Agent Has Observability. It Doesn't Have Evals.

#agents #observability #evaluation #llm

10 min read

Modusensus

Sep 25

Cosine Gating Won't Save You From Sycophancy: A Self-Refutation Observed by Three Judges

#ai #oss #evaluation #llm

5 min read

Sep 17

My local 7B thinks "kill a Python process" is a violent crime — and my regex beat it

#ai #security #evaluation #llm

4 min read

saaro

Sep 17

RAG Evaluation 2026: The Four Core Metrics and How to Read Them Diagnostically

#rag #ai #evaluation #metrics

4 min read

Sep 17

Using Execution Traces to Evaluate AI Agent Behavior

#ai #opensource #evaluation

5 min read

Debashish Ghosal

Sep 24

7 Agent Eval Mistakes That Cost Me Weeks (And the One-Line Fixes That Ended Them)

#ai #evaluation #llm #programming

5 min read

Cristian Gormaz

Sep 7

El modelo encontró evidencia relevante y aun así falló: por qué “alucinación” se me quedó corta

#ai #testing #llm #evaluation

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.