Use cases / Knowledge Base promotion

Promote the next Knowledge Base change with candidate-vs-live evidence.

BedrockOps helps teams compare a candidate Knowledge Base against the live KB under a shared probe set, capture before/after quality snapshots, and record audit-logged promotion declarations with rollback visibility.

This use case starts when a Knowledge Base change looks ready, but the team wants evidence against live before promoting it.

A candidate KB change needs evidence vs. live
Promotion needs a reversible, audited record
Rollback decisions need before/after snapshots
Retrieval quality must not silently regress after a swap

Candidate-vs-live evidence for Knowledge Base changes.

Candidate vs. Live

Compare a candidate Knowledge Base against the live KB under the same probe set — per-probe chunk overlap, top-score delta, latency delta, and zero-result delta.

Quality Snapshots

Capture before and after retrieval-quality snapshots from the scorecard, so a promotion ships with evidence instead of a guess.

Audit-Logged Promotion

Record who promoted, when, and the snapshots behind it through the standard audit middleware. The KB swap itself happens on your side — BedrockOps records the declaration.

Rollback Visibility

See a promotion flagged as a rollback when a previous configuration is restored within 14 days, and track rollback rate over time.

CANDIDATE vs LIVE · 50-query probe set

Example readout from a shared probe set

EXAMPLE
Live top-score
0.62
Candidate top-score
0.71
Chunk overlap
78%

From candidate Knowledge Base to a confident, audit-logged promotion.

The team designates which Knowledge Base is the candidate and which is live.
BedrockOps runs the shared probe set against both and computes per-probe deltas.
The team reviews score, latency, overlap, and zero-result deltas with before/after snapshots.
The promotion is declared — audit-logged, with rollback visibility — or held.

Fewer retrieval surprises after a swap.

Evidence before promoting a Knowledge Base change
A reversible, audit-logged promotion record
Faster, clearer rollback decisions
Less retrieval-quality regression reaching users

Put candidate-vs-live evidence in front of the next Knowledge Base promotion.

Start in AWS Marketplace, connect AWS with a read-only role, and compare candidate and live Knowledge Bases with your own probe set before declaring a promotion.

Start 7-Day Trial On AWS Marketplace