Vendor Security Assessments: Every Vendor Re-Measured When the Policy Changes
Vendor security packages in Box, tiers and spend in Attio and an age-limit policy in Drive come together in one Kylon room. Agents measure every report against its limit and re-measure all vendors when a limit changes, and the risk lead approves each result.
Security reports age every day, and the limits do not hold still
Each vendor in scope sends a security package: a SOC report, a bridge letter when the report period ended a while ago, a penetration test summary and a completed questionnaire. The packages sit in Box, one folder per vendor. The assessment policy in Google Drive sets how old a report may be for each vendor tier. Attio holds the vendor record with its tier, business owner and annual spend, and spend sets the order reviews happen in.
The first pass is manageable. The trouble starts when something moves. Security shortens the age limit for critical vendors, and someone re-checks only the vendors whose status flips, missing the ones that stay blocked for the same reason but now sit further over the limit. Spend is copied from last year's export instead of Attio, and a large vendor lands in the last batch. A vendor is reclassified, and nobody re-confirms the order of everything already blocked.
Who works in the room
People
Third-party risk lead
Owns the assessment cycle, approves every disposition and signs the closeout records
Security reviewers
Work through their review batch, read new findings and decide whether each one blocks the vendor
Business owners
Hold the vendor relationship and chase the vendor for updated reports
Agents

NovaAssessment coordinator
Reads each vendor's security package in Box, measures report age against the tier limit, proposes a disposition and builds review batches from Attio spend
Box
Attio
Google Drive
RyanNotices and revisions
Audits the notice list against approved dispositions, re-confirms results after every limit or tier change, and drafts vendor notices for a person to send
Nova is the default agent, so a plain question about a vendor's status lands with it, while the notice list and every revision belong to Ryan. Nova reads Box and Attio under a lasting grant from the risk lead, and takes annual spend from the Attio record only, even when an email quotes another figure. After a re-measure, Nova mentions Ryan with the changed vendors and Ryan leads the thread. Ryan's vendor notices are drafted in the risk lead's own Outlook.
From first read to four closeout records
The policy and the age-limit table are linked from the room guidelines, so both agents apply the same version. Every result names the report and the date it was measured from.
- Agent works
- Person decides
- Arrives or gets recorded
flowchart TD
packages([Vendor security packages<br>sit in Box])
measure["<b>Nova</b> measures each newest report<br>against its tier limit"]
ok1["<b>Risk lead</b> approves<br>before Attio is updated"]
batch["<b>Nova</b> groups blocked and conditional<br>vendors by annual spend"]
assign["<b>Risk lead</b> assigns each<br>batch to a reviewer"]
audit["<b>Ryan</b> audits the draft notice<br>list in both directions"]
sec["<b>Security</b> confirms how<br>a new limit reads"]
findings["<b>Nova</b> re-checks vendors<br>with new findings"]
reclass["<b>Ryan</b> re-confirms the blocked<br>list after a tier change"]
remeasure["<b>Nova</b> re-measures every<br>vendor under the new table"]
reviewer["<b>Security reviewer</b><br>decides if it blocks"]
order["<b>Risk lead</b> approves<br>the resulting order"]
close["<b>Nova</b> writes one closeout record<br>per tier from current Attio data"]
sign["<b>Risk lead</b> signs each record"]
packages --> measure --> ok1 --> batch --> assign --> audit
audit --> sec & findings & reclass
sec --> remeasure
findings --> reviewer
reclass --> order
remeasure & reviewer & order --> close --> sign
class measure,batch,audit,findings,reclass,remeasure,close agent
class ok1,assign,sec,reviewer,order,sign person
class packages event
classDef agent fill:#FFFFFF,stroke:#DCD3C8,color:#1B1712
classDef person fill:#EEF0E3,stroke:#6E7447,color:#1B1712
classDef event fill:#F4ECDD,stroke:#F4ECDD,color:#564C42| Stage | What happens | Who acts | Who decides |
|---|---|---|---|
| First disposition | Each vendor's newest report is measured against its tier limit and marked cleared, conditional or blocked, with a reason and the days over the limit | Nova, reading the thirty packages with parallel helpers | The risk lead approves before Attio is updated |
| Review batches | Blocked and conditional vendors are grouped into reviewer batches in order of annual spend from Attio | Nova | The risk lead assigns each batch to a reviewer |
| Notice list audit | The draft list of vendors to notify is checked against the approved dispositions, in both directions | Ryan | The risk lead corrects and approves the list |
| Limit revision | Every vendor is re-measured under the new table, and any change in reason or days over the limit is recorded as a revision | Nova, checked by Ryan | Security confirms how the new limit reads |
| Findings batch | New penetration test findings are attached to their vendors and those dispositions re-checked | Nova | The security reviewer decides whether each finding blocks |
| Reclassification | A tier change on one vendor is applied, then the whole blocked list is re-confirmed in batch order | Ryan | The risk lead approves the resulting order |
| Closeout | Four closeout records are written from current Attio data, one per vendor tier, each with the same fixed fields | Nova | The risk lead signs each record |
A tighter limit, then a reclassified vendor
A tighter age limit changes more vendors than it seems to. A critical vendor that was blocked at 40 days over the old limit is now 130 days over the new one, and its reason has not changed. Nova still records it as revised, because the reviewer's batch and the business owner's notice both carry that number. Ryan then lists every revised vendor with its old and new figures side by side, so the risk lead can approve the changes in one pass.
Reclassification is the quieter change. When a standard vendor starts handling customer data and moves to critical, its own limit tightens and its place among the blocked vendors can shift. Ryan re-confirms every blocked vendor in batch order rather than only the one that moved, and posts the list with each position marked unchanged or moved. Nothing reaches Attio until the risk lead approves it.
What the checks catch
- A vendor that stays blocked for a stale report but whose days over the limit changed under the new table, which still counts as a revision
- Annual spend taken from an old export or an email instead of the Attio record, which puts a vendor in the wrong review batch
- A bridge letter or newer report filed in another vendor's Box folder, so the first read missed it
- A notice list that still names a vendor cleared since its new report arrived, or leaves out one that became blocked
- A reclassified vendor that shifts the order of the blocked list, caught by re-confirming every blocked vendor in sequence
What stays with people
- Approving every disposition before the vendor record in Attio changes
- Deciding whether an open penetration test finding blocks a vendor or becomes a condition
- Sending each vendor notice from Outlook, which Ryan prepares as a draft
- Signing the closeout record for each tier
Integrations in this workflow
Kylon is not a third-party risk platform and does not take the place of one. The vendor book stays in Attio and the evidence stays in Box. The room is where the measuring, checking and approving happen, in order.
Attio
Box
Google Drive
Outlook
Slack
- Attio holds each vendor's record, tier, business owner and annual spend, and receives every approved disposition
- Box holds the security packages: SOC reports, bridge letters, penetration test summaries and questionnaires
- Google Drive keeps the assessment policy, the age-limit table and the draft notice list
- Outlook is where vendors send updated reports, and where notices go out once a person sends the draft
- Slack is where business owners ask when their vendor will clear, and Ryan collects those questions in the assessment thread
Where to start
Pick one assessment cycle. Give the room the Box vendor folders, connect Attio with a grant the risk lead approves, and add one line to the room guidelines: when a limit or a tier changes, every vendor is re-measured, and nothing reaches Attio until the risk lead approves the revised list.
“When the limit changed, every vendor was re-measured, including the ones whose status stayed the same.”
Set it up with your agent
Open a new Room, add your agent and paste this prompt. It connects the tools, builds the App with you and asks for your rules one step at a time, and nothing goes out until a person approves it.
Set up our vendor security assessment desk in this Room. Take it one step at a time and wait for my OK before you move on. 1. Connect Attio, Box, Google Drive, Outlook and Slack. Tell me which ones still need connecting. 2. Ask me who works this desk: the third-party risk lead, the security reviewers who work through each batch, and the business owners who hold the vendor relationships. Help me invite them to this Room. 3. Build a Vendor Assessments App with Vendor, Tier, Report age and Status, one record per vendor. Pull each vendor's tier, business owner and annual spend from Attio, and read the security packages from the Box folders. 4. Measure each vendor's newest report against the tier limit in the Google Drive policy table. Propose a disposition, a reason and the days over the limit for every vendor. Show the ones that land blocked or conditional, grouped into review batches in order of annual spend from Attio only. Flag any report found in the wrong Box folder. 5. Draft vendor notices in the risk lead's Outlook and hold every Attio update and every notice until the risk lead approves. When a limit or tier changes, re-measure every vendor, record any change in reason or days as a revision, and list old and new figures side by side for the risk lead to approve in one pass. 6. Write the rule order and who approves what into this Room's guideline, so every cycle follows it. 7. After one clean cycle, offer to turn the re-measure step into an Automation. Before you start, ask me for our rules one at a time.
Your first company harness. Where humans and agents run your business together.
More Use Cases
View allSpare Parts Reorder Levels: Stocking Rules That Hold When One Part Changes
When one part changes its lead time, criticality or supersession, every part tied to it is checked again. Agents set min and reorder levels from ClickUp work orders and Salesforce quotes in one Kylon room, and the planner approves each level.
Localization Vendor QA: Translation Payments Priced Right and Paid Within Each Run's Cap
Translation jobs are priced from word counts, rate bands, rush uplifts and late penalties, placed in payment runs under a cash cap, and re-priced when rates, holds or disputes change. Agents work ClickUp and Box, and the vendor manager approves every amount.




