Evaluation Workspace
Fraud fixture playground
Generate named pseudo datasets, isolate individual vectors, and inspect whether pass and fail cases behave correctly against the live deterministic engine.
Testset Builder
Generate fixture collections
Build pseudo applicant rows that intentionally pass or fail specific fraud vectors, then validate the results against the live rule engine.
Current Testset
MVP Fraud Vector Fixture Set
Regression Harness • Generated Jun 17, 2026, 5:32 PM
VectorAll seeded vectorsModePass + failSkipped1
Scenario Rows
20
Assertions Passing
20/20
Watchlist Entries
2
Vectors Covered
10
| Scenario | Target Vector | Expected | Applicant | Signals |
|---|---|---|---|---|
watchlist-pass Email is on the synthetic watchlist. | Watchlist Exact Match | pass | Nora Blackwell nora.blackwell@example.org 1993-04-13 | IP198.51.100.23Routing325081403DocumentUtility BillPayoutDirect Deposit |
watchlist-fail Email is similar-looking but not on the watchlist. | Watchlist Exact Match | fail | Nora Blackwell nora.blackwell+safe@example.org 1994-05-14 | IP198.51.100.24Routing325081403DocumentUtility BillPayoutDirect Deposit |
gift-card-tax-pass Digital gift card payout paired with tax-return documentation. | Digital Gift Card + Tax Return | pass | Talia Gordon talia.gordon@example.org 1995-06-15 | IP198.51.100.25Routing325081403DocumentTax ReturnPayoutDigital Gift Card |
gift-card-tax-fail Digital gift card payout with a utility bill should not match the tax-return vector. | Digital Gift Card + Tax Return | fail | Robin Alvarez robin.alvarez@example.org 1996-07-16 | IP198.51.100.26Routing325081403DocumentUtility BillPayoutDigital Gift Card |
gift-card-bank-pass Digital gift card payout paired with bank-statement documentation. | Digital Gift Card + Bank Statement | pass | Ari Bennett ari.bennett@example.org 1997-08-17 | IP198.51.100.27Routing325081403DocumentBank StatementPayoutDigital Gift Card |
gift-card-bank-fail Paper check payout should not hit the gift-card bank-statement vector. | Digital Gift Card + Bank Statement | fail | Samira Patel samira.patel@example.org 1998-01-18 | IP198.51.100.28Routing325081403DocumentBank StatementPayoutPaper Check |
direct-deposit-extreme-pass Direct deposit using routing 73972200 should match the extreme-risk vector. | Direct Deposit + Extreme Risk Routing | pass | Micah Reyes micah.reyes@example.org 1999-02-10 | IP198.51.100.29Routing73972200DocumentUtility BillPayoutDirect Deposit |
direct-deposit-extreme-fail Direct deposit using a low-risk routing number should not match the extreme-risk vector. | Direct Deposit + Extreme Risk Routing | fail | Keisha Fuller keisha.fuller@example.org 1990-03-11 | IP198.51.100.30Routing325081403DocumentUtility BillPayoutDirect Deposit |
high-risk-bank-statement-pass High-risk Go2Bank routing paired with bank-statement documentation. | Direct Deposit + High Risk Routing + Bank Statement | pass | Evan McBride evan.mcbride@example.org 1991-04-12 | IP198.51.100.31Routing124303162DocumentBank StatementPayoutDirect Deposit |
high-risk-bank-statement-fail Low-risk routing with bank-statement documentation should not match. | Direct Deposit + High Risk Routing + Bank Statement | fail | Hana Brooks hana.brooks@example.org 1992-05-13 | IP198.51.100.32Routing325081403DocumentBank StatementPayoutDirect Deposit |
high-risk-tax-return-pass High-risk routing with tax-return documentation. | Direct Deposit + High Risk Routing + Tax Return | pass | Leah Bishop leah.bishop@example.org 1993-06-14 | IP198.51.100.33Routing124303120DocumentTax ReturnPayoutDirect Deposit |
high-risk-tax-return-fail High-risk routing with a utility bill should not hit the tax-return vector. | Direct Deposit + High Risk Routing + Tax Return | fail | Noah Sanders noah.sanders@example.org 1994-07-15 | IP198.51.100.34Routing124303120DocumentUtility BillPayoutDirect Deposit |
high-risk-cell-bill-pass High-risk routing with cell-bill documentation. | Direct Deposit + High Risk Routing + Cell Bill | pass | Iris Coleman iris.coleman@example.org 1995-08-16 | IP198.51.100.35Routing124303162DocumentCell BillPayoutDirect Deposit |
high-risk-cell-bill-fail Cell-bill documentation without high-risk routing should not match. | Direct Deposit + High Risk Routing + Cell Bill | fail | Jules Mercer jules.mercer@example.org 1996-01-17 | IP198.51.100.36Routing325081403DocumentCell BillPayoutDirect Deposit |
wells-fargo-tax-pass Wells Fargo routing 121042882 paired with tax-return documentation. | Wells Fargo 121042882 + Tax Return | pass | Mila Rhodes mila.rhodes@example.org 1997-02-18 | IP198.51.100.37Routing121042882DocumentTax ReturnPayoutDirect Deposit |
wells-fargo-tax-fail Wells Fargo routing with a bank statement should not hit the tax-return vector. | Wells Fargo 121042882 + Tax Return | fail | Owen Whitaker owen.whitaker@example.org 1998-03-10 | IP198.51.100.38Routing121042882DocumentBank StatementPayoutDirect Deposit |
account-holder-mismatch-pass Direct-deposit account holder is materially different from the applicant name. | Direct Deposit Account Holder Mismatch | pass | Mila Rhodes zoe.ramirez@example.org 1999-04-11 | IP198.51.100.39Routing325081403DocumentUtility BillPayoutDirect Deposit |
account-holder-mismatch-fail Matching applicant and account holder names should not hit the mismatch vector. | Direct Deposit Account Holder Mismatch | fail | Leah Bishop maya.carter@example.org 1990-05-12 | IP198.51.100.40Routing325081403DocumentUtility BillPayoutDirect Deposit |
id-landlord-pass Driver's license with landlord-linked residency context should match the rule. | State ID / Driver's License + Lease / Landlord Letter | pass | Jordan Ellis jordan.ellis@example.org 1991-06-13 | IP198.51.100.41Routing325081403DocumentDriver's LicensePayoutDirect Deposit |
id-landlord-fail Utility bill without the ID-style document type should not match the rule. | State ID / Driver's License + Lease / Landlord Letter | fail | Avery Monroe avery.monroe@example.org 1992-07-14 | IP198.51.100.42Routing325081403DocumentUtility BillPayoutDirect Deposit |
Signal Coverage
Dataset fields exercised by this playground
These are the normalized fraud signals the fixture rows are already mapped to.
Similarity vectors remain listed as skipped until embedding search is wired.
applicant_nameemailip_addressphone_numberdate_of_birthstreet_addresspayment_methodaccount_holder_namerouting_numberaccount_number_hashdocument_typelandlord_namedevice_id