PromptLock — clean run

all 50 cases hold.

pass
50
drift
0
fail
0
median drift
0.0175 / 0.025
judge calls
0
total cost
$0.08299
0.0000.0340.0690.1030.138t001: drift 0.0235, threshold 0.12 (PASS)t002: drift 0.026, threshold 0.12 (PASS)t003: drift 0.0176, threshold 0.12 (PASS)t004: drift 0.0376, threshold 0.12 (PASS)t005: drift 0.0, threshold 0.12 (PASS)t006: drift 0.0, threshold 0.12 (PASS)t007: drift 0.0, threshold 0.12 (PASS)t008: drift 0.0, threshold 0.12 (PASS)t009: drift 0.0, threshold 0.12 (PASS)t010: drift 0.0, threshold 0.12 (PASS)t011: drift 0.0259, threshold 0.12 (PASS)t012: drift 0.0393, threshold 0.12 (PASS)t013: drift 0.0179, threshold 0.12 (PASS)t014: drift 0.0, threshold 0.12 (PASS)t015: drift 0.0178, threshold 0.12 (PASS)t016: drift 0.013, threshold 0.12 (PASS)t017: drift 0.0, threshold 0.12 (PASS)t018: drift 0.0, threshold 0.12 (PASS)t019: drift 0.0174, threshold 0.12 (PASS)t020: drift 0.0197, threshold 0.12 (PASS)t021: drift 0.0, threshold 0.12 (PASS)t022: drift 0.0, threshold 0.12 (PASS)t023: drift 0.0201, threshold 0.12 (PASS)t024: drift 0.0, threshold 0.12 (PASS)t025: drift 0.018, threshold 0.12 (PASS)t026: drift 0.0, threshold 0.12 (PASS)t027: drift 0.0, threshold 0.12 (PASS)t028: drift 0.0171, threshold 0.12 (PASS)t029: drift 0.0126, threshold 0.12 (PASS)t030: drift 0.0199, threshold 0.12 (PASS)t031: drift 0.0223, threshold 0.12 (PASS)t032: drift 0.0, threshold 0.12 (PASS)t033: drift 0.0213, threshold 0.12 (PASS)t034: drift 0.0268, threshold 0.12 (PASS)t035: drift 0.0301, threshold 0.12 (PASS)t036: drift 0.0376, threshold 0.12 (PASS)t037: drift 0.0186, threshold 0.12 (PASS)t038: drift 0.0, threshold 0.12 (PASS)t039: drift 0.0192, threshold 0.12 (PASS)t040: drift 0.0, threshold 0.12 (PASS)t041: drift 0.0314, threshold 0.12 (PASS)t042: drift 0.0, threshold 0.12 (PASS)t043: drift 0.0262, threshold 0.12 (PASS)t044: drift 0.0137, threshold 0.12 (PASS)t045: drift 0.0, threshold 0.12 (PASS)t046: drift 0.0, threshold 0.12 (PASS)t047: drift 0.05, threshold 0.12 (PASS)t048: drift 0.0373, threshold 0.12 (PASS)t049: drift 0.0495, threshold 0.12 (PASS)t050: drift 0.0194, threshold 0.12 (PASS)suite median 0.0175suite median 0.0175case 1case 50
Each dot is one case's drift; the grey tick beside it is that case's own threshold, measured from its own noise at record time. A dot below its tick is within noise. Colour is the verdict.
● pass ● drift ● fail ─ per-case threshold
●t0010.02350.12
verdict: PASSdrift 0.0235 vs threshold 0.12noise floor 0.0294judge: not calledcost $0.001800

Baseline

{"category": "billing", "urgency": "medium", "summary": "i was charged twice for my invoice this month, please refund the"}

Current

{"category": "billing", "urgency": "medium", "summary": "i was charged twice for my invoice this month, please refund the"}
●t0020.0260.12
verdict: PASSdrift 0.026 vs threshold 0.12noise floor 0.0326judge: not calledcost $0.001839

Baseline

{"category": "billing", "urgency": "low", "summary": "my card was declined but the subscription still shows active. what happened?"}

Current

{"category": "billing", "urgency": "low", "summary": "my card was declined but the subscription still shows active. what happened?"}
●t0030.01760.12
verdict: PASSdrift 0.0176 vs threshold 0.12noise floor 0.022judge: not calledcost $0.001653

Baseline

{"category": "billing", "urgency": "low", "summary": "can you explain the price increase on my last invoice?"}

Current

{"category": "billing", "urgency": "low", "summary": "can you explain the price increase on my last invoice?"}
●t0040.03760.12
verdict: PASSdrift 0.0376 vs threshold 0.12noise floor 0.047judge: not calledcost $0.001764

Baseline

{"category": "billing", "urgency": "low", "summary": "i need a refund for the annual payment, i cancelled two days"}

Current

{"category": "billing", "urgency": "low", "summary": "i need a refund for the annual payment, i cancelled two days"}
●t0050.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001620

Baseline

{"category": "billing", "urgency": "low", "summary": "the invoice pdf shows the wrong billing address."}

Current

{"category": "billing", "urgency": "low", "summary": "the invoice pdf shows the wrong billing address."}
●t0060.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001680

Baseline

{"category": "billing", "urgency": "low", "summary": "why was i billed in usd when my account currency is eur?"}

Current

{"category": "billing", "urgency": "low", "summary": "why was i billed in usd when my account currency is eur?"}
●t0070.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001680

Baseline

{"category": "billing", "urgency": "low", "summary": "please send me all invoices for the last financial year."}

Current

{"category": "billing", "urgency": "low", "summary": "please send me all invoices for the last financial year."}
●t0080.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001620

Baseline

{"category": "billing", "urgency": "low", "summary": "i upgraded mid-cycle and the charge looks wrong."}

Current

{"category": "billing", "urgency": "low", "summary": "i upgraded mid-cycle and the charge looks wrong."}
●t0090.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001770

Baseline

{"category": "billing", "urgency": "high", "summary": "subscription renewed even though i cancelled. need this refunded asap."}

Current

{"category": "billing", "urgency": "high", "summary": "subscription renewed even though i cancelled. need this refunded asap."}
●t0100.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001680

Baseline

{"category": "billing", "urgency": "low", "summary": "do you support payment by bank transfer instead of card?"}

Current

{"category": "billing", "urgency": "low", "summary": "do you support payment by bank transfer instead of card?"}
●t0110.02590.12
verdict: PASSdrift 0.0259 vs threshold 0.12noise floor 0.0323judge: not calledcost $0.001731

Baseline

{"category": "bug", "urgency": "medium", "summary": "the export button crashes the whole page with a 500 error every"}

Current

{"category": "bug", "urgency": "medium", "summary": "the export button crashes the whole page with a 500 error every"}
●t0120.03930.12
verdict: PASSdrift 0.0393 vs threshold 0.12noise floor 0.0491judge: not calledcost $0.001680

Baseline

{"category": "bug", "urgency": "medium", "summary": "uploading a csv over 10mb fails silently, nothing happens."}

Current

{"category": "bug", "urgency": "medium", "summary": "uploading a csv over 10mb fails silently, nothing happens."}
●t0130.01790.12
verdict: PASSdrift 0.0179 vs threshold 0.12noise floor 0.0223judge: not calledcost $0.001638

Baseline

{"category": "bug", "urgency": "low", "summary": "dark mode is broken on safari, the text is invisible."}

Current

{"category": "bug", "urgency": "low", "summary": "dark mode is broken on safari, the text is invisible."}
●t0140.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001635

Baseline

{"category": "bug", "urgency": "low", "summary": "app freezes when i open the settings panel on mobile."}

Current

{"category": "bug", "urgency": "low", "summary": "app freezes when i open the settings panel on mobile."}
●t0150.01780.12
verdict: PASSdrift 0.0178 vs threshold 0.12noise floor 0.0222judge: not calledcost $0.001668

Baseline

{"category": "bug", "urgency": "low", "summary": "i get an exception trace whenever i try to share a report."}

Current

{"category": "bug", "urgency": "low", "summary": "i get an exception trace whenever i try to share a report."}
●t0160.0130.12
verdict: PASSdrift 0.013 vs threshold 0.12noise floor 0.0163judge: not calledcost $0.001719

Baseline

{"category": "other", "urgency": "low", "summary": "search returns no results even for documents i can see in the"}

Current

{"category": "other", "urgency": "low", "summary": "search returns no results even for documents i can see in the"}
●t0170.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001740

Baseline

{"category": "other", "urgency": "low", "summary": "the webhook fires twice for every event, causing duplicate records."}

Current

{"category": "other", "urgency": "low", "summary": "the webhook fires twice for every event, causing duplicate records."}
●t0180.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001710

Baseline

{"category": "other", "urgency": "low", "summary": "timestamps display in the wrong timezone after the last update."}

Current

{"category": "other", "urgency": "low", "summary": "timestamps display in the wrong timezone after the last update."}
●t0190.01740.12
verdict: PASSdrift 0.0174 vs threshold 0.12noise floor 0.0217judge: not calledcost $0.001713

Baseline

{"category": "other", "urgency": "high", "summary": "everything is down, the dashboard will not load at all. urgent."}

Current

{"category": "other", "urgency": "high", "summary": "everything is down, the dashboard will not load at all. urgent."}
●t0200.01970.12
verdict: PASSdrift 0.0197 vs threshold 0.12noise floor 0.0247judge: not calledcost $0.001578

Baseline

{"category": "other", "urgency": "low", "summary": "pagination skips the last row on every page."}

Current

{"category": "other", "urgency": "low", "summary": "pagination skips the last row on every page."}
●t0210.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001740

Baseline

{"category": "feature_request", "urgency": "low", "summary": "would be nice if you could add bulk delete for archived items."}

Current

{"category": "feature_request", "urgency": "low", "summary": "would be nice if you could add bulk delete for archived items."}
●t0220.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001560

Baseline

{"category": "feature_request", "urgency": "low", "summary": "please add support for sso with okta."}

Current

{"category": "feature_request", "urgency": "low", "summary": "please add support for sso with okta."}
●t0230.02010.12
verdict: PASSdrift 0.0201 vs threshold 0.12noise floor 0.0251judge: not calledcost $0.001578

Baseline

{"category": "other", "urgency": "low", "summary": "any chance of a dark mode for the mobile app?"}

Current

{"category": "other", "urgency": "low", "summary": "any chance of a dark mode for the mobile app?"}
●t0240.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001650

Baseline

{"category": "feature_request", "urgency": "low", "summary": "i wish there was a way to schedule reports weekly."}

Current

{"category": "feature_request", "urgency": "low", "summary": "i wish there was a way to schedule reports weekly."}
●t0250.0180.12
verdict: PASSdrift 0.018 vs threshold 0.12noise floor 0.0225judge: not calledcost $0.001623

Baseline

{"category": "feature_request", "urgency": "low", "summary": "suggestion: let us tag teammates in comments."}

Current

{"category": "feature_request", "urgency": "low", "summary": "suggestion: let us tag teammates in comments."}
●t0260.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001650

Baseline

{"category": "feature_request", "urgency": "low", "summary": "can you add a slack integration for notifications?"}

Current

{"category": "feature_request", "urgency": "low", "summary": "can you add a slack integration for notifications?"}
●t0270.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001710

Baseline

{"category": "other", "urgency": "low", "summary": "it would help a lot to have keyboard shortcuts for navigation."}

Current

{"category": "other", "urgency": "low", "summary": "it would help a lot to have keyboard shortcuts for navigation."}
●t0280.01710.12
verdict: PASSdrift 0.0171 vs threshold 0.12noise floor 0.0214judge: not calledcost $0.001653

Baseline

{"category": "feature_request", "urgency": "low", "summary": "please add an api endpoint for listing workspaces."}

Current

{"category": "feature_request", "urgency": "low", "summary": "please add an api endpoint for listing workspaces."}
●t0290.01260.12
verdict: PASSdrift 0.0126 vs threshold 0.12noise floor 0.0157judge: not calledcost $0.001719

Baseline

{"category": "account", "urgency": "low", "summary": "i am locked out after too many login attempts, please reset."}

Current

{"category": "account", "urgency": "low", "summary": "i am locked out after too many login attempts, please reset."}
●t0300.01990.12
verdict: PASSdrift 0.0199 vs threshold 0.12noise floor 0.0248judge: not calledcost $0.001638

Baseline

{"category": "account", "urgency": "low", "summary": "how do i change the email address on my account?"}

Current

{"category": "account", "urgency": "low", "summary": "how do i change the email address on my account?"}
●t0310.02230.12
verdict: PASSdrift 0.0223 vs threshold 0.12noise floor 0.0279judge: not calledcost $0.001560

Baseline

{"category": "account", "urgency": "high", "summary": "i lost my 2fa device and cannot sign in."}

Current

{"category": "account", "urgency": "high", "summary": "i lost my 2fa device and cannot sign in."}
●t0320.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001620

Baseline

{"category": "account", "urgency": "low", "summary": "please delete my account and all associated data."}

Current

{"category": "account", "urgency": "low", "summary": "please delete my account and all associated data."}
●t0330.02130.12
verdict: PASSdrift 0.0213 vs threshold 0.12noise floor 0.0266judge: not calledcost $0.001533

Baseline

{"category": "account", "urgency": "low", "summary": "my password reset email never arrives."}

Current

{"category": "account", "urgency": "low", "summary": "my password reset email never arrives."}
●t0340.02680.12
verdict: PASSdrift 0.0268 vs threshold 0.12noise floor 0.0335judge: not calledcost $0.001701

Baseline

{"category": "other", "urgency": "medium", "summary": "i need to transfer ownership of the workspace to a colleague."}

Current

{"category": "other", "urgency": "medium", "summary": "i need to transfer ownership of the workspace to a colleague."}
●t0350.03010.12
verdict: PASSdrift 0.0301 vs threshold 0.12noise floor 0.0376judge: not calledcost $0.001626

Baseline

{"category": "other", "urgency": "low", "summary": "can i merge two accounts that use different emails?"}

Current

{"category": "other", "urgency": "low", "summary": "can i merge two accounts that use different emails?"}
●t0360.03760.12
verdict: PASSdrift 0.0376 vs threshold 0.12noise floor 0.047judge: not calledcost $0.001635

Baseline

{"category": "account", "urgency": "low", "summary": "login redirects me in a loop and never completes."}

Current

{"category": "account", "urgency": "low", "summary": "login redirects me in a loop and never completes."}
●t0370.01860.12
verdict: PASSdrift 0.0186 vs threshold 0.12noise floor 0.0232judge: not calledcost $0.001668

Baseline

{"category": "other", "urgency": "low", "summary": "just wanted to say the new release is great, thanks team."}

Current

{"category": "other", "urgency": "low", "summary": "just wanted to say the new release is great, thanks team."}
●t0380.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001575

Baseline

{"category": "other", "urgency": "low", "summary": "do you have a status page i can subscribe to?"}

Current

{"category": "other", "urgency": "low", "summary": "do you have a status page i can subscribe to?"}
●t0390.01920.12
verdict: PASSdrift 0.0192 vs threshold 0.12noise floor 0.024judge: not calledcost $0.001608

Baseline

{"category": "other", "urgency": "low", "summary": "where can i find your data processing agreement?"}

Current

{"category": "other", "urgency": "low", "summary": "where can i find your data processing agreement?"}
●t0400.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001560

Baseline

{"category": "other", "urgency": "low", "summary": "are you hiring for backend roles right now?"}

Current

{"category": "other", "urgency": "low", "summary": "are you hiring for backend roles right now?"}
●t0410.03140.12
verdict: PASSdrift 0.0314 vs threshold 0.12noise floor 0.0392judge: not calledcost $0.001632

Baseline

{"category": "other", "urgency": "medium", "summary": "what is your uptime guarantee on the business plan?"}

Current

{"category": "other", "urgency": "medium", "summary": "what is your uptime guarantee on the business plan?"}
●t0420.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001530

Baseline

{"category": "other", "urgency": "low", "summary": "is there a student discount available?"}

Current

{"category": "other", "urgency": "low", "summary": "is there a student discount available?"}
●t0430.02620.12
verdict: PASSdrift 0.0262 vs threshold 0.12noise floor 0.0327judge: not calledcost $0.001695

Baseline

{"category": "billing", "urgency": "low", "summary": "the payment page throws an error when i try to update my"}

Current

{"category": "billing", "urgency": "low", "summary": "the payment page throws an error when i try to update my"}
●t0440.01370.12
verdict: PASSdrift 0.0137 vs threshold 0.12noise floor 0.0171judge: not calledcost $0.001749

Baseline

{"category": "billing", "urgency": "low", "summary": "i was charged but the app crashed before confirming, did it go"}

Current

{"category": "billing", "urgency": "low", "summary": "i was charged but the app crashed before confirming, did it go"}
●t0450.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001620

Baseline

{"category": "account", "urgency": "low", "summary": "login is broken after i changed my email address."}

Current

{"category": "account", "urgency": "low", "summary": "login is broken after i changed my email address."}
●t0460.00.12
verdict: PASSdrift 0.0 vs threshold 0.12noise floor 0.0judge: not calledcost $0.001725

Baseline

{"category": "other", "urgency": "low", "summary": "the export is so slow it is basically unusable, can you make"}

Current

{"category": "other", "urgency": "low", "summary": "the export is so slow it is basically unusable, can you make"}
●t0470.050.12
verdict: PASSdrift 0.05 vs threshold 0.12noise floor 0.0625judge: not calledcost $0.001539

Baseline

{"category": "billing", "urgency": "high", "summary": "my invoice download link returns a 500."}

Current

{"category": "billing", "urgency": "high", "summary": "my invoice download link returns a 500."}
●t0480.03730.12
verdict: PASSdrift 0.0373 vs threshold 0.12noise floor 0.0466judge: not calledcost $0.001665

Baseline

{"category": "billing", "urgency": "high", "summary": "cannot sign in and i am being billed for a seat i"}

Current

{"category": "billing", "urgency": "high", "summary": "cannot sign in and i am being billed for a seat i"}
●t0490.04950.12
verdict: PASSdrift 0.0495 vs threshold 0.12noise floor 0.0618judge: not calledcost $0.001722

Baseline

{"category": "billing", "urgency": "low", "summary": "there is no way to cancel a subscription in the ui, please"}

Current

{"category": "billing", "urgency": "low", "summary": "there is no way to cancel a subscription in the ui, please"}
●t0500.01940.12
verdict: PASSdrift 0.0194 vs threshold 0.12noise floor 0.0242judge: not calledcost $0.001593

Baseline

{"category": "other", "urgency": "low", "summary": "following up on my previous ticket, any update?"}

Current

{"category": "other", "urgency": "low", "summary": "following up on my previous ticket, any update?"}