Skip to main content
HOME>Use Cases>Order Fraud Review: Every Flagged Order Released or Cancelled on Its Evidence
Use Case7 min read

Order Fraud Review: Every Flagged Order Released or Cancelled on Its Evidence

Flagged orders are reviewed in one Kylon room against Stripe address and card checks, refunds and verification replies. Agents propose release, hold or cancel on each Attio order, and the fraud review lead approves every decision before it is written.

Get started
Kylon TeamProduct

A flagged order waits while the evidence sits in three places

Every order the fraud screen flags waits for a person while the customer waits for a shipping email. The review is the same each time: look at the charge's address check and card security code result, see whether earlier charges on the same customer were refunded or disputed, check whether the customer has verified, then release, hold or cancel under the rule order. Speed matters, and so does being right in both directions.

Flagged orders are tracked in Attio, charges and refunds live in Stripe under the customer rather than the order, and the review policy and a generated worksheet sit in Google Drive. Customers answer verification requests by email, the payments team posts chargeback news, and the fraud lead occasionally moves the auto-cancel score line. When that line moves, every order in the queue has to be looked at again.

Who works in the room

People

  • Fraud review lead

    Approves every release, hold and cancel decision, sets the auto-cancel score line and signs the close-out

  • Fraud analysts

    Contact customers for verification and release or cancel orders in the store

  • Payments team

    Processes chargebacks and confirms them on the shared thread

Agents

  • NovaOrder reviewer

    Reads each flagged order in Attio, finds its charges in Stripe by customer id, checks address and card results, refunds and the verified flag, and proposes a decision under the rule order

    AttioStripeGoogle Drive
  • AdaWorksheet and customer contact

    Checks the review worksheet against the approved decisions, drafts verification requests and the chargeback confirmation reply, and posts approved decisions for the analysts

    Google DriveAttioGmailSlack

Two agents share the fraud room. Nova is the default, so a question about any order's decision goes to it unnamed. Nova reads Stripe through a lasting grant the payments lead approved for this room, and looks up charges by each order's Stripe customer id, never by the order number. Ada owns the worksheet check and the customer contact. When an approved decision needs a customer to verify, Nova mentions Ada with the order and what is missing, and Ada drafts the request.

The review in seven steps

The rule order, the score line and the recording fields are in Google Drive and in the room guidelines. Each step ends with a person.

  • Agent works
  • Person decides
  • Arrives or gets recorded
Scroll sideways to see the whole flow.
StageWhat happensWho actsWho decides
DispositionsEach flagged order is checked against its customer's Stripe charges for address and card results, refunds and the verified flag, and gets a decisionNovaThe fraud review lead approves before Attio is written
Worksheet reviewThe generated worksheet is compared with the approved decisions, and its flag is set only on orders it coversAdaThe fraud review lead confirms the corrections
Verification repliesCustomers' replies are matched to their orders, and those orders are re-derivedNova, then Ada for any follow-upAn analyst confirms each verification
Chargeback cancellationsOrders with a processed chargeback are cancelled, and one reply on the payments thread lists every cancelled orderNova, then Ada for the replyThe payments team confirms, and an analyst sends the reply
Card check correctionOrders whose card security result was corrected are re-derived under the full rule orderNovaThe fraud review lead approves any changed decision
Score line loweredEvery in-scope order is re-derived under the new line, not only those near itNova, checked by AdaThe fraud review lead approves
Close-outTotals by decision are counted from the current Attio recordsNovaThe fraud review lead signs off
Stages of a manual fraud review cycle. Orders, scores and customers in this example are illustrative.

A lower score line means a full re-check

A lower auto-cancel line looks as if it only affects orders just above it. Because the score check sits inside the full rule order, Nova re-derives every order in scope from the top rather than filtering for scores near the line, and lists each decision that changed along with the rule that changed it. The fraud lead approves the set in one pass.

Corrections and replies are handled the same way. A corrected card check on one charge can change the decision on that customer's other flagged orders, so the re-derivation follows the customer, not the message. Every one of these turns is kept in the run history, so when a customer or the payments team asks why an order was cancelled, the answer is a record rather than a recollection.

What the checks catch

  • A Stripe charge matched to an order by order number instead of customer id, which pulls in another customer's evidence
  • A worksheet flag set on an order the worksheet never covered
  • A lowered score line applied only to orders near the line, leaving the rest decided under the old one
  • A verification reply matched to the wrong order when one customer has several flagged
  • Two replies on the chargeback thread, or one that leaves out a cancelled order

What stays with people

  • Approving every release, hold and cancel before Attio is written
  • Releasing or cancelling the order in the store
  • Sending verification requests and thread replies, which Ada prepares as drafts in Gmail
  • Setting the auto-cancel score line

Integrations in this workflow

Kylon is not a fraud screening tool, and it does not replace the one that flags your orders. It sits across the records and payment data the review team already uses, so the coordination between them has one home.

  • Attio tracks each flagged order with its score, decision, reason and worksheet flag
  • Stripe provides each customer's charges with address and card check results, refunds and disputes
  • Google Drive keeps the review policy, the rule order and the generated worksheet
  • Gmail carries verification requests and the chargeback thread, and each message is a draft an analyst sends
  • Slack is where the payments team posts processed chargebacks and analysts flag urgent orders

Where to start

Start with one day's flagged queue. Connect the Attio list of flagged orders and give the room a lasting grant on Stripe, then spell out one rule in the room guidelines: charges are found by customer id, every change to the score line re-derives the whole queue, and the fraud lead approves every decision before it is written.

“A flagged order gets the same full check whether it is first in the queue or fortieth.”

Set it up with your agent

Open a new Room, add your agent and paste this prompt. It connects the tools, builds the App with you and asks for your rules one step at a time, and nothing goes out until a person approves it.

Set-up prompt

Your first company harness. Where humans and agents run your business together.

Get started

More Use Cases

View all

Card Chargebacks: Every Dispute Represented or Accepted on Its Evidence, Not Its Deadline

Each chargeback is represented, partly represented or accepted on what its Box evidence and Outlook refund history show, analysts are assigned by tier, and late evidence re-runs the rules. The disputes lead approves every status before Attio changes.

Retail & e-commerceFinance operations

Crowdfunding Reward Fulfillment: Pledges Placed in Waves That Stay Right as Holds Clear

Backer pledges are walked into fulfillment waves or holds in one Kylon room, with shipping and add-on amounts on each Notion page. Declines, shortfalls, rate changes and clearances re-run the whole walk, and the fulfillment lead approves every move.

Retail & e-commerceSupport & customer success