Particular Audience Particular Audience
Talk to us

The retail operating system

One engine for every retail decision.

Most retailers run four or five separate tools.

Search in one tool, pricing in another, ads bolted on top — nobody owns the order shoppers see, and margin leaks between them. The Unified Decision Engine governs relevance, inventory, margin and sponsored demand in one pass, on every surface, including the AI assistants now doing the shopping.

Start with one surface. Leave the rest of your stack untouched.

Need one thing first? Start with our AI product recommendation engine or AI site search.

LLM-as-a-Judge Search Evaluation — Objective Site Search Testing | Particular Audience

An objective, catalogue-grounded evaluation of your site search: real shopper queries, every engine graded by an LLM judge on a published 0–4 rubric. USD $2,000 plus applicable taxes.

An objective, catalogue-grounded evaluation of your site search: real shopper queries, every engine graded by an LLM judge on a published 0–4 rubric. USD $2,000 plus applicable taxes.

Site search quality is high-dimensional and often hidden: query types, modifiers, brand versus type, category mix, the store's own catalogue, page depth, merchandising rules and evolving intent all interact.

Method: Real shopper queries — Your top search terms, plus targeted modifier queries (dietary, size, format). Every engine's results — The full first page from each engine — including your incumbent — captured for every term. Catalogue answer pool — Every engine's results plus catalogue recall candidates, scoped to what the store stocks. The catalogue is the ground truth, not any engine. LLM judge grades 0–4 — Each product graded from the shopper's perspective against a published rubric. Qualified queries are graded on the modifier. Standard metrics — nDCG, precision, exact-match share, recall and MRR — at the top of the page (@10) and the full page (@60).

Rubric: 4 Exact match; 3 Right brand and type; 2 Right type, other brand; 1 Related; 0 Irrelevant. Relevant means grade 2 or higher.

Anonymised evaluation: A top-tier US grocery retailer, one store's live catalogue; 667 real search terms, 19,000+ products graded, 7 engines. +0.057 nDCG@10 vs incumbent (best first impression); +0.103 nDCG@60 vs incumbent (best full first page); ~59 / 60 products filled per page (vs ~44 for the incumbent); 9 severe misses in 667 (vs 43 for a global-merchandising setup).

Merchandising applied globally helped about 125 terms and hurt about 272; it should be applied per term.

Deliverables: Executive summary and a clear engine recommendation; Full leaderboard at @10 and @60; Per-term commentary: what happened, for every query; Every engine's full page, per term; Per-term merchandising guidance; Modifier-query deep dive; One-page summary and slide outline for your team. Price: USD $2,000 plus applicable taxes.

Adaptive Transformer Search · Universal Search · Book an evaluation