← All case studies
✦AI & tech design · ADAData & AI 2023–Present

A judgment framework for AI categorization

Why yes/no questions turned out smarter than asking AI to just “pick a category.”

1 → 10+clients on the framework
Millionsof SKUs to classify
Yes / noone decision at a time
3+“complete nutritionfor children 3–10”AI model“pick a category”Infantrun 1Childrenrun 2Infant?run 3?!same product, different answers3+Q1Edible?nonot foodyesQ2Dairy / milk?nonot dairyyesQ3Mostly under 5?yesInfant / toddlernoQ4For ages 5+?noGeneralyesChildren’snutritionone clear decision at a time
ask AI to “pick a category” and it changes its mind
!The problem

AI can’t agree with itself.

Brands have hundreds of products in category trees. Milk alone splits into:

InfantChildrenAdultSpecialty

Across millions of SKUs, the obvious move is to let AI place each one. But on anything ambiguous, it’s inconsistent. Is PediaSure® 3+, for children aged 3 to 10, infant or children’s nutrition? One run said one thing, the next said another. My own team couldn’t agree either.

✦What I did

Turn one big question into small ones.

Instead of one-shot placement, I redesigned the task as a questionnaire of yes/no questions, with “so-so” routing to a follow-up. Yes/no is far easier to judge than “which category,” and each step gives the model one clear decision.

The best part: people from totally different teams helped shape the questions. Some knew these products from their own families, which turned out to be real domain knowledge.

✓What happened

It gets better with every pass.

The same yes/no path now runs unattended across a much bigger, messier catalog, and gets more accurate with every pass instead of drifting. It went from 1 client to 10+, doing three jobs:

Category flaggingPack-size differentiationBundling
Built with
LLMsPrompt designDecision frameworksQA