Search Jury Open the report

Your results
have something
to confess.

LLM judges expose relevance gaps before launch.

Open the report
  • LLM judges
    grade real results
  • Find relevance
    gaps fast
  • Ship with
    confidence

Clear intent:
user wants shoes for
flat feet—not a general list.

The top result
misses intent

Search: best running shoes for flat feet

Evaluated Apr 24, 2026
# Result Score Intent Key takeaway
1 The 10 Best Running Shoes of 2024 General roundup across all foot types. 42 Low Covers many use cases but misses flat-feet specifics.
2 Best Running Shoes for Flat Feet In-depth guide with expert picks. 88 High Directly addresses the query and customer need.
3 Stability Running Shoes for Overpronation Explains fit and stability features. 76 High Strong technical coverage for a narrower intent.
4 How to Choose Running Shoes for Flat Feet Buying advice and fit considerations. 71 Medium Useful guidance, but fewer product recommendations.

Jury verdict

The top result fails to satisfy the core intent.

The highest-ranked page is broad rather than specific. Customers are likely to keep searching—a relevance gap worth fixing before launch.

Works with your search stack

Bring the results. Keep your existing stack.

  • Elastic
  • Algolia
  • Coveo
  • Constructor
  • + Your provider

How it works

Test before you ship.

  1. 01

    Import results

    Upload a query set and pull results from your existing search provider.

  2. 02

    Let the jury score

    Evaluate relevance, intent, quality, diversity, and commercial fit.

  3. 03

    Act on the verdict

    Send clear findings to search teams and merchandisers before launch.

Evaluation

What the jury sees.

A multi-dimensional evaluation of each search result.

Relevance78Is the result about the query?
Intent match42Does it answer the specific need?
Result quality83Is the content deep and accurate?
Diversity69Does the set cover different needs?
Commercial fit75Does it support business goals?

Jury note: Strong topical relevance, but low intent match.

Relevant isn’t always right.

Actions

From verdict to action.

Turn unbiased analysis into measurable improvements.

For search teams

  1. Tune ranking rulesAdjust signals based on jury feedback.
  2. Compare algorithm versionsSee which version delivers better results.
  3. Catch regressions before launchIdentify issues before customers do.

For merchandisers

  1. Spot assortment gapsFind missing products and content.
  2. Improve promoted resultsProtect relevance and commercial fit.
  3. Prioritize high-impact fixesFocus on changes that drive results.

Business outcome

Better search earns the click.

More relevant results lead to more clicks, more conversions, and happier customers.

Higher relevance Higher CTR Higher conversion

Before

  1. The 10 Best Running Shoes of 202442
  2. Best Running Shoes for Flat Feet88
  3. Stability Running Shoes76

After optimization

  1. Best Running Shoes for Flat Feet92
  2. Stability Running Shoes86
  3. Best Stability Shoes78
  • Measure impactSee how improvements affect CTR and conversion.
  • Track every verdictKeep a record of evaluations over time.
  • Launch with confidenceValidate changes before they go live.

Put your next
search on trial.

See what your users see. Find what you’re missing.

Get expert LLM judgments before you launch.

Run a search audit