Review the evidence architecture
Objectives
A team presents the evidence architecture for one SOC 2 control family ahead of the readiness assessment. The demo works and the diagram is excellent.
Accept the design decisions that will survive an auditor. Reject the ones that only survive a demo.
Verdicts are accept or reject. Every rejection needs one reason code from: mutable-store | period-gap | not-reperformable | no-control-id.
Architecture review packet: decisions under review
J-1 The catalog control id is written into collector output, monitor records and every row of the report. J-2 Collectors hold write and delete permissions on the evidence bucket so bad runs can be re-collected over the top. J-3 Each stored payload carries run metadata: run id, query issued, window covered and records evaluated. J-4 Automation goes live 1 May for a January-December period; no bridge is planned for January to April. J-5 Report figures are produced by a notebook on one engineer's laptop joining four sources with local credentials. J-6 The monitor identifies checks by an internal numeric key; nothing maps it to the catalog.
Checks the server runs (3)
- Every line in the fixture carries a verdict
- Accept and reject land on the right lines
- Each rejection cites a valid reason code
Check names are all you see here: the expectations that decide pass or fail, and the reference solution, stay on the server.
Step-by-step hints
The guided walkthrough, in full. It is free: no XP cost, and it does not touch the paid hint ladder or the reveal gate.
- Step 1
Read the request before the artefact
Judge each decision against one question: given a control id and a date, could someone who has never met this team reach the artefact and re-derive the number?
- Step 2
Judge every line, including the boring ones
Six decisions, six verdicts. The two accepts are the join key and the run metadata; leaving them unremarked invites a refactor that quietly drops them.
Every line in the fixture carries a verdict
- Step 3
Separate what is wrong from what is merely ugly
A store the collector can overwrite cannot support a claim about the past, no matter how good the hashing is around it.
Separate the two coverage failures: one is about a period nothing evidences, the other about a number nobody but its author can produce.
Accept and reject land on the right lines
- Step 4
Say why, in the vocabulary the programme uses
Use the join-key code for the layer that names things its own way, and the reperformance code for the figure trapped in a personal notebook.
Each rejection cites a valid reason code
Rules summary
XP on pass
40 bonus XP the first time every check goes green.
Paid hints
2 available. Each costs 25% of the lab XP (about 10 XP).
Reveal solution
Scores 0 XP and unlocks only after 3 check runs.
Attempt cap
60 check runs per learner. The runner warns you in the last 10.
Drafts
Your editor content is saved in this browser, so a reload will not lose work.
Walkthrough
Always free and never penalised: use it before spending a hint.