Order Fraud Review: Every Flagged Order Released or Cancelled on Its Evidence
Flagged orders are reviewed in one Kylon room against Stripe address and card checks, refunds and verification replies. Agents propose release, hold or cancel on each Attio order, and the fraud review lead approves every decision before it is written.
A flagged order waits while the evidence sits in three places
Every order the fraud screen flags waits for a person while the customer waits for a shipping email. The review is the same each time: look at the charge's address check and card security code result, see whether earlier charges on the same customer were refunded or disputed, check whether the customer has verified, then release, hold or cancel under the rule order. Speed matters, and so does being right in both directions.
Flagged orders are tracked in Attio, charges and refunds live in Stripe under the customer rather than the order, and the review policy and a generated worksheet sit in Google Drive. Customers answer verification requests by email, the payments team posts chargeback news, and the fraud lead occasionally moves the auto-cancel score line. When that line moves, every order in the queue has to be looked at again.
Who works in the room
People
Fraud review lead
Approves every release, hold and cancel decision, sets the auto-cancel score line and signs the close-out
Fraud analysts
Contact customers for verification and release or cancel orders in the store
Payments team
Processes chargebacks and confirms them on the shared thread
Agents

NovaOrder reviewer
Reads each flagged order in Attio, finds its charges in Stripe by customer id, checks address and card results, refunds and the verified flag, and proposes a decision under the rule order
Attio
Stripe
Google Drive
AdaWorksheet and customer contact
Checks the review worksheet against the approved decisions, drafts verification requests and the chargeback confirmation reply, and posts approved decisions for the analysts
Two agents share the fraud room. Nova is the default, so a question about any order's decision goes to it unnamed. Nova reads Stripe through a lasting grant the payments lead approved for this room, and looks up charges by each order's Stripe customer id, never by the order number. Ada owns the worksheet check and the customer contact. When an approved decision needs a customer to verify, Nova mentions Ada with the order and what is missing, and Ada drafts the request.
The review in seven steps
The rule order, the score line and the recording fields are in Google Drive and in the room guidelines. Each step ends with a person.
- Agent works
- Person decides
- Arrives or gets recorded
flowchart TD
flagged([The fraud screen flags an order])
decide["<b>Nova</b> checks the customer's Stripe<br>charges and proposes a decision"]
ok1["<b>Fraud review lead</b> approves<br>before Attio is written"]
sheet["<b>Ada</b> checks the worksheet against<br>the approved decisions"]
verify["<b>Nova</b> matches customer replies<br>and re-derives orders"]
cbreply["<b>Ada</b> drafts one reply listing<br>each chargeback cancellation"]
cardfix([A card check result<br>is corrected])
analyst["<b>Fraud analyst</b> confirms<br>each verification"]
cbsend["<b>Payments team</b> confirms,<br><b>fraud analyst</b> sends it"]
card["<b>Nova</b> re-derives that<br>customer's orders"]
score["<b>Nova</b> re-derives every in-scope<br>order under the new score line"]
sok["<b>Fraud review lead</b> approves<br>the changed decisions"]
close["<b>Nova</b> counts totals by decision<br>from current Attio records"]
sign["<b>Fraud review lead</b> signs off"]
flagged --> decide --> ok1 --> sheet
sheet --> verify & cbreply & cardfix
verify --> analyst
cbreply --> cbsend
cardfix --> card
analyst & cbsend & card --> score
score --> sok --> close --> sign
class decide,sheet,verify,cbreply,card,score,close agent
class ok1,analyst,cbsend,sok,sign person
class flagged,cardfix event
classDef agent fill:#FFFFFF,stroke:#DCD3C8,color:#1B1712
classDef person fill:#EEF0E3,stroke:#6E7447,color:#1B1712
classDef event fill:#F4ECDD,stroke:#F4ECDD,color:#564C42| Stage | What happens | Who acts | Who decides |
|---|---|---|---|
| Dispositions | Each flagged order is checked against its customer's Stripe charges for address and card results, refunds and the verified flag, and gets a decision | Nova | The fraud review lead approves before Attio is written |
| Worksheet review | The generated worksheet is compared with the approved decisions, and its flag is set only on orders it covers | Ada | The fraud review lead confirms the corrections |
| Verification replies | Customers' replies are matched to their orders, and those orders are re-derived | Nova, then Ada for any follow-up | An analyst confirms each verification |
| Chargeback cancellations | Orders with a processed chargeback are cancelled, and one reply on the payments thread lists every cancelled order | Nova, then Ada for the reply | The payments team confirms, and an analyst sends the reply |
| Card check correction | Orders whose card security result was corrected are re-derived under the full rule order | Nova | The fraud review lead approves any changed decision |
| Score line lowered | Every in-scope order is re-derived under the new line, not only those near it | Nova, checked by Ada | The fraud review lead approves |
| Close-out | Totals by decision are counted from the current Attio records | Nova | The fraud review lead signs off |
A lower score line means a full re-check
A lower auto-cancel line looks as if it only affects orders just above it. Because the score check sits inside the full rule order, Nova re-derives every order in scope from the top rather than filtering for scores near the line, and lists each decision that changed along with the rule that changed it. The fraud lead approves the set in one pass.
Corrections and replies are handled the same way. A corrected card check on one charge can change the decision on that customer's other flagged orders, so the re-derivation follows the customer, not the message. Every one of these turns is kept in the run history, so when a customer or the payments team asks why an order was cancelled, the answer is a record rather than a recollection.
What the checks catch
- A Stripe charge matched to an order by order number instead of customer id, which pulls in another customer's evidence
- A worksheet flag set on an order the worksheet never covered
- A lowered score line applied only to orders near the line, leaving the rest decided under the old one
- A verification reply matched to the wrong order when one customer has several flagged
- Two replies on the chargeback thread, or one that leaves out a cancelled order
What stays with people
- Approving every release, hold and cancel before Attio is written
- Releasing or cancelling the order in the store
- Sending verification requests and thread replies, which Ada prepares as drafts in Gmail
- Setting the auto-cancel score line
Integrations in this workflow
Kylon is not a fraud screening tool, and it does not replace the one that flags your orders. It sits across the records and payment data the review team already uses, so the coordination between them has one home.
- Attio tracks each flagged order with its score, decision, reason and worksheet flag
- Stripe provides each customer's charges with address and card check results, refunds and disputes
- Google Drive keeps the review policy, the rule order and the generated worksheet
- Gmail carries verification requests and the chargeback thread, and each message is a draft an analyst sends
- Slack is where the payments team posts processed chargebacks and analysts flag urgent orders
Where to start
Start with one day's flagged queue. Connect the Attio list of flagged orders and give the room a lasting grant on Stripe, then spell out one rule in the room guidelines: charges are found by customer id, every change to the score line re-derives the whole queue, and the fraud lead approves every decision before it is written.
“A flagged order gets the same full check whether it is first in the queue or fortieth.”
Set it up with your agent
Open a new Room, add your agent and paste this prompt. It connects the tools, builds the App with you and asks for your rules one step at a time, and nothing goes out until a person approves it.
Set up our order fraud review desk in this Room. Take it one step at a time and wait for my OK before you move on. 1. Connect Attio, Gmail, Google Drive, Slack and Stripe. The Stripe grant is lasting and covers the whole Room. Tell me which connections still need work. 2. Ask me who works this desk: the fraud review lead, the fraud analysts who contact customers and action orders in the store, and the payments team who post chargebacks and confirm them. Help me invite them to this Room. 3. Build a Fraud Queue App with Order, Score, Decision and Status, one record per flagged order. Fill it from the current flagged list in Attio. 4. For each order, find its customer's charges in Stripe by customer id, check the address result, the card security code result, any refunds or disputes, and the verified flag, then propose a decision and the rule that drives it. Show me every order where the evidence is missing or the decision is unclear. 5. Draft verification requests in Gmail and chargeback confirmation replies on the payments thread. Post approved decisions to Slack for the analysts. Hold every write to Attio and every send until the fraud review lead approves each release, hold and cancel decision and signs the close-out. 6. Write our rules, the score threshold we set, and who approves what into this Room's guideline so every flagged order follows the same steps. 7. After one clean day's queue, offer to turn the daily review into an Automation. Before you start, ask me for our rules one at a time.
Your first company harness. Where humans and agents run your business together.
More Use Cases
View allCard Chargebacks: Every Dispute Represented or Accepted on Its Evidence, Not Its Deadline
Each chargeback is represented, partly represented or accepted on what its Box evidence and Outlook refund history show, analysts are assigned by tier, and late evidence re-runs the rules. The disputes lead approves every status before Attio changes.
Crowdfunding Reward Fulfillment: Pledges Placed in Waves That Stay Right as Holds Clear
Backer pledges are walked into fulfillment waves or holds in one Kylon room, with shipping and add-on amounts on each Notion page. Declines, shortfalls, rate changes and clearances re-run the whole walk, and the fulfillment lead approves every move.





