From the Desk of Customer Success: A Flag Is One Piece of a Much Bigger Review

One of the questions I get a lot is what a flag actually means.

And the answer is pretty simple: it means something happened during a session that deserves review.

It does not automatically mean someone cheated. It doesn’t mean the assessment should be invalidated. And it doesn’t mean technology should be making that decision on its own.

A participant might look away from the screen because someone walked into the room. A phone might appear because it was part of an approved process. Notes, calculators, blank paper, or other materials may be completely acceptable depending on how the assessment has been set up.

That’s why the rules behind the assessment matter just as much as the technology supporting it.

Clear rules make for a better assessment experience

A lot of frustration can be avoided before the assessment even begins.

If participants are allowed to use things like paper, a calculator, notes, or another resource, tell them clearly. If something isn’t allowed, make that just as clear.

The important part is making sure the rules you’ve set for the assessment are also the rules the participant understands.

Clear communication doesn’t mean every permitted action will automatically be obvious in the review. Context still matters.

For example, paper and pen may be allowed, but if a participant is looking down for long periods and the reviewer can’t clearly see what they’re looking at, that activity may still be flagged to be safe.

That doesn’t necessarily mean anything went wrong. It means the reviewer is documenting what they observed so the full context is available.

Your rule settings should still match what you’ve communicated to participants, including any allowed resources, but configuration is only one part of the experience. Clear communication matters just as much.

Technology can support the review, but it doesn’t replace it

Automation and AI can be incredibly useful in an assessment integrity program.

They can help identify patterns, surface unusual activity, and add another layer of information to the review process.

But at Integrity Advocate, a human reviews the entirety of every session, whether something has been flagged by AI or not.

That distinction matters.

The final review isn’t based only on what technology notices. It’s based on the full session, the rules that were in place, and the context around what actually happened.

A flag is one piece of information within a much bigger review.

More flags isn’t necessarily better

The goal shouldn’t be to generate as many flags as possible. It should be to provide useful information.

A flag is most valuable when it helps an administrator understand what happened during a session and decide whether anything needs further attention.

That’s why clear rules, thoughtful configuration, and communication with participants all matter. The better those pieces line up, the easier the final review is to interpret.

Good assessment integrity isn’t about letting technology make the call.

It’s about using technology alongside full human review so organizations get a more complete picture of what happened during a session.

Clear rules, clear communication, and context all matter.

And the more participants understand what to expect before they begin, the easier it is for everyone to interpret what happened afterward.

{{post-cta}}