Audit whether critical controls are actually followed

Audit whether critical controls are actually followed

A layered process audit checks execution of important controls through planned observation by defined roles. Choose specific questions tied to process risks, then decide how evidence is recorded and what happens when a control is absent or ineffective. The purpose is to detect and correct weaknesses in routine execution, not to substitute for product inspection or a full management-system audit. Review completion, findings, action effectiveness and recurring patterns as different measures. A high completion percentage can coexist with poor observations, and a low finding count can reflect superficial checks. Use learning to improve both the process and the audit questions without turning the routine into blame.

Follow the method

1. Critical-control questions
2. Roles + cadence
3. Observe evidence
4. Act + verify
5. Review effectiveness

Keep observation, response and effectiveness connected

Fictional case: ten process checks were scheduled across leadership layers at Vale Assembly. Eight were completed and two findings recorded. These values remain unchanged in the core diagram. Supervisor Priya must report the results and follow an absent identity check through containment, action and a later observation.

Follow the method

1. Completion
2. Finding rate
3. Identity finding
4. Effectiveness

Eight checks completed, two findings, no product-quality percentage

Observe a critical control at the work, record objective evidence and verify the response while keeping audit-completion metrics distinct from product quality.

Fictional case: ten process checks were scheduled across leadership layers at Vale Assembly. Eight were completed and two findings recorded. These values remain unchanged in the core diagram. Supervisor Priya must report the results and follow an absent identity check through containment, action and a later observation.

Role: Layered-audit coordinator and process leaders

Normal condition

Questions target specific critical controls, observers inspect actual work/records and findings reach an accountable response with verification.

The gap

The dashboard labels 80% completion as 80% quality and closes findings when a reminder email is sent.

• Layered process checks are not a substitute for product inspection or a certification audit.
• Cadence, questions and roles must fit the process and applicable requirements; this is not a copied CQI-8 form.

1. Choose an observable control question

   Priya replaces “Does the team care about quality?” with a question about whether the current product identity is checked against the setup instruction. The observer must see the work or its required record.

   Why: A specific question can produce objective evidence. An opinion question encourages easy yes answers without testing the control.

   Evidence: The question names the control, evidence and relevant operating moment.

2. Assign layers and response ownership

   Different leadership roles observe the critical control at planned opportunities. Priya identifies who responds to an abnormality and who removes a system obstacle.

   Why: Layers provide different perspectives and authority; repeatedly collecting signatures without an action path does not strengthen the control.

   Evidence: The schedule names observers, opportunity and receiving owner.

3. Record what was actually seen

   One observer records that setup proceeded without the required product-identity check, with time and relevant record reference. Another finding remains a separate evidence item.

   Why: The finding should be reproducible and bounded. “Operator careless” is a causal judgment that the observation alone does not establish.

   Evidence: Two objective findings are retained rather than merged into a general score.

4. Calculate separate process metrics

   Completion is 8/10=80%. Finding rate among completed checks is 2/8=25%. Priya labels both denominators and avoids interpreting either as percentage conforming product.

   Why: The measures concern the audit activity and its observations. They do not estimate product quality or prove that the underlying control is effective.

   Evidence: The dashboard names scheduled-check completion and findings per completed check.

5. Close through evidence of response

   The owner handles immediate exposure, investigates why the identity step was missed and corrects the relevant process. A later observed opportunity checks whether the intended control now works.

   Why: Sending a reminder is an action, not effectiveness evidence. The review must distinguish restoration now from prevention of the recurring gap.

   Evidence: Closure references the later observation and any remaining system issue.

All scheduled checks are signed on one afternoon

The log shows every leader completed the week’s planned observations at the same quiet moment.

Review whether the planned operating opportunities were actually covered and correct the observation plan. Preserve the true timing rather than backdating entries.

A perfect completion count can miss the conditions where a control is most likely to fail. The schedule should support representative observation.

The review records actual opportunities and gaps in coverage.

Run a practice session

Materials

• Schedule and finding cards
• Blank observation record
• Role map

1. Improve the question · 5 minutes

   What could you actually observe?

2. Interpret the two rates · 8 minutes

   Which population is each about?

3. Repair the email closure · 10 minutes

   What evidence would demonstrate the control?

4. Debrief timing · 5 minutes

   Which operating condition might a convenient visit miss?

Debrief

• Ask learners to replace a blame phrase with an observation.
• Do not reward low finding counts without examining observation quality.

Write one audit question with its expected evidence and reaction owner.

Transfer into the work

Owner: Layered-audit coordinator and process owner

Record: Observation schedule, objective findings and effectiveness record

Review: At planned leadership reviews and follow-up observations

Evidence: Relevant coverage and verified control response

Improve questions, access or process conditions when repeated findings or superficial checks persist.