Review the control pipelines before the audit window
Objectives
Six controls run in CI. The engineering lead says all six are automated and wants them listed as engineered in the audit narrative.
Automated is not the bar. Accept the pipelines that would still demonstrate the control six months from now; reject the rest and name the stage that fails.
Verdicts are accept or reject. Every rejection needs one reason code from: no-negative-test | undocumented-bypass | advisory-gate | evidence-on-pass-only.
Pipeline summary (per control)
P-1 CC-STORAGE-PUBLIC | tests: 6 positive, 2 negative, fixtures pinned | gate: blocking, fail-closed | evidence: emitted pass and fail with control id, run id, population P-2 CC-MFA-ADMIN | tests: 4 positive, 0 negative | gate: blocking | evidence: emitted both outcomes with control id and run id P-3 CC-ENCRYPT-VOL | tests: 5 positive, 3 negative | gate: blocking, but SKIP_POLICY_CHECKS=true set in the workflow 11 weeks ago, no ticket, no end date P-4 CC-LOG-RETAIN | tests: 4 positive, 2 negative | gate: advisory: prints a warning, never fails the build | evidence: emitted both outcomes P-5 CC-KEY-ROTATE | tests: 5 positive, 2 negative | gate: blocking, fail-closed | evidence: emitted on pass only, failing runs stop at the gate and write nothing P-6 CC-VULN-CRIT | tests: 6 positive, 3 negative, fixtures pinned | gate: blocking, fail-closed | evidence: emitted both outcomes with control id, run id, population
Checks the server runs (3)
- Every line in the fixture carries a verdict
- Accept and reject land on the right lines
- Each rejection cites a valid reason code
Check names are all you see here: the expectations that decide pass or fail, and the reference solution, stay on the server.
Step-by-step hints
The guided walkthrough, in full. It is free: no XP cost, and it does not touch the paid hint ladder or the reveal gate.
- Step 1
Read the request before the artefact
Before judging, fix the question you will ask of every row: if this pipeline ran on the day of the incident, would it have said no, and would there be a record that it did?
- Step 2
Judge every line, including the boring ones
Six pipelines, six verdicts. Two are genuinely engineered; the audit narrative needs to know which so the other four are fixed rather than described.
Every line in the fixture carries a verdict
- Step 3
Separate what is wrong from what is merely ugly
A suite with no negative case proves the evaluator runs, not that it can deny: treat that as a failing pipeline no matter how green it looks.
Then the gate: a warning nobody must act on and a permanent skip flag are the same outcome by different routes. Last, evidence: written on pass only is a record of the good days.
Accept and reject land on the right lines
- Step 4
Say why, in the vocabulary the programme uses
Name the stage that fails, not the pipeline's general maturity: each defect has a different owner and a different fix.
Each rejection cites a valid reason code
Rules summary
XP on pass
40 bonus XP the first time every check goes green.
Paid hints
2 available. Each costs 25% of the lab XP (about 10 XP).
Reveal solution
Scores 0 XP and unlocks only after 3 check runs.
Attempt cap
60 check runs per learner. The runner warns you in the last 10.
Drafts
Your editor content is saved in this browser, so a reload will not lose work.
Walkthrough
Always free and never penalised: use it before spending a hint.