CyMon · Behind the scenes

Behind the scenes

Here you see how people and machines work together to collect, process, assess, record and keep information traceable.

Human–machine interaction with human in the loop

«On this page ▾»

In 30 seconds

In 30 seconds

HUMAN IN THE LOOP Human
MACHINE Machine
HUMAN IN THE LOOP Human in the loop
VASTLEGGING Recording

Op · Af · Bij = the people in the process

HUMAN IN THE LOOP · OP HUMAN IN THE LOOP · AF HUMAN IN THE LOOP · BIJ

The human provides information, context or a decision. The machine supports processing. Where a substance judgement is needed, the human returns in the loop.

See how this works ↓

How does it work?

Human–machine interaction

Overview of who is up. The machine supports; a human takes the substance decision.

  1. HUMAN IN THE LOOP · OP
    Delivery

    The human delivers documents and explanatory context.

  2. MACHINE
    Machine registreert

    Receipt, source and version are recorded. Receipt is not approval.

  3. MACHINE
    Machine ordent en verwerkt

    The machine structures information and flags changes.

  4. MACHINE
    Machine makes a proposal

    Possible relations and uncertainties become visible.

  5. HUMAN IN THE LOOP · OP HUMAN IN THE LOOP · AF
    Human completes and corrects

    Here the proposal waits for human intervention. Op where clarification is needed. Af provides the information, source and context here.

  6. HUMAN IN THE LOOP · BIJ
    Human assesses and returns the analysis

    The human can accept, adjust, reject or ask for further investigation.

  7. MACHINE
    Machine processes the established decision

    Only the human decision is processed; the machine forms no independent judgement.

  8. MACHINE
    Recording

    Source, version, decision and responsible party stay linked.

  9. MACHINE
    Overview en historie

    The machine presents the recorded information. The human follows coherence and progress from Bij.

See the human roles ↓
What does the machine support?
  • Ontvangen en registreren
  • Structureren, vergelijken en ordenen
  • Wijzigingen detecteren
  • Relations voorstellen en informatie voorbereiden
  • Process established information
  • History bijhouden en overzichten genereren

The machine does not take over a human substance decision.

Human in the loop

The human roles are perspectives on the work. One person can fulfil multiple roles; authorities are agreed separately.

Op

HUMAN IN THE LOOP · OP

Delivers information, source material and context.

Examples of human intervention
  • Look up information
  • Upload information
  • Create information

Interaction with Af

  • Clarify
  • Call out uncertainty

Af

HUMAN IN THE LOOP · AF

Provides additional context, signals and looks along.

Examples of human intervention
  • Indicate a starting point
  • Clarify
  • Closing out the handled delivery in the online portal

Interaction with Op

  • Provide context
  • Ask a question

Do: clarify together, write it yourself. (Whisper is allowed)

Don’t: ask for content to be produced.

Bij

HUMAN IN THE LOOP · BIJ

Assesses and establishes substance.

Gives instruction and receives input in the online portal.

Examples of human intervention

Substance review

  • Assess a proposal
  • Reject a proposal
  • Assess the substantiation
  • Decide that further investigation is needed
  • Compare sources
  • Make a human determination

Technology

  • Accept or adjust a relation
  • Follow up on questions
  • Ensure the process stays under control

Coordination

  • Request information
  • Progress volgen
  • Open punten signaleren
  • Actions volgen
  • History bewaken
  • Ask Af to draft policy, processes and work instructions

A recurring interplay

Human provides information or decision Machine supports and processes Machine presents result or proposal Human in the loop Human checks or decides

↺ When a question or new information arises, the interplay starts again.

Deep dive: register, relaties en historie ↓

Deep dive

What happens behind the scenes?

A simplified relation model with the principle of decoupled linking. The connections show coherence and are not a technical execution order.

Delivery Context Document Machineverwerking Voorstel Human in the loop Beoordeling Central register Standards / quality framework Overview en historie

thin line = relation (not order)

The framework is already relevant at the request, the proposal and the assessment. The link to the register means criteria and their source version are recorded with traceability; the framework does not only appear after the assessment.

Information at the source

With the source comes information about context, requirements, assessments, versions and history. The central register links this information to the document.

Document
Central register
  • Context
  • Eis / criterium
  • Beoordeling
  • Versie en historie

The register points to the document and the version used. The document therefore does not need to exist physically multiple times.

Standards / quality framework

The standards / quality framework determines against what information is assessed.

Physical storage of information and substance assessment are separated.

What does the source relate to?
Document Relations Standards / quality framework
What has been human-established?
Humanelijke beoordeling Recording History

A proposed relation shows possible relevance. It does not prove that a requirement is met.

One document, multiple relations

The document remains one source. Meaning, application and relations are recorded separately.

One document
  • Context A
  • Context B
  • Criterium A
  • Criterium B
  • Beoordelingsmoment (Veranderende criteria bij W&R of instituut)

The letters are fictional examples. Multiple relations prevent unnecessary physical duplication. New versions stay separately recognisable.

Different views

The same underlying registration can be viewed from different questions.

Central register

Contextweergave

What belongs to this topic?

Standards / quality framework

Which information is linked to these requirements?

Historyweergave

Which source versions and decisions were fixed at a given moment?

These views use the same registration. They do not form separately maintained truths. Access follows the agreed authorities.

How to deliver

The instruction cards are an explanation for you about starting the conversation. They help you provide extra context.

On CyMon Says you find the five flashcards: what are we asking, relevant requirements, what do we want to know, what can you deliver, and how to deliver.

The explanatory note is ultimately used as source and context information. It is never automatically a substance assessment. “Unknown” or “more information follows” may remain visible.

Do you need to deliver something? Do this in Pakhuis or in the closed area.

To the closed area

From instruction to recording

The instruction cards form the human access point to processing.

Instruction Human delivers Machine registreert Machine verwerkt Human in the loop Vastgelegd resultaat

volle pijl = volgende processtap

The result is only established in substance by the authorised human. The instruction cards therefore stand apart from the technical system visual.

History and traceability

Earlier versions and decisions stay traceable. New information does not silently overwrite what was established earlier.

  1. Ontvangst
  2. Verwerking
  3. Voorstel
  4. Humanelijke beslissing
  5. Recording
  6. Nieuwe informatie of nieuwe versie
  7. Herbeoordeling indien nodig

verticale lijn = historie / tijd

With a new version it becomes visible which relations need attention again. An earlier decision stays linked to the version it related to.

Project progress en inhoudelijke beoordeling

Progress describes the work. An assessment describes what the information substantiates.

Project progress
  • Ontvangen
  • In behandeling
  • Follow-up question
  • Action open
  • Beoordeling nodig
  • Afgerond

“Afgerond” benoemt altijd welke activiteit is afgerond.

Useersstatus ≠ inhoudelijke beoordeling.

Inhoudelijke beoordeling

What does the source substantiate? What limitations are there? What has a human established?

Received or marked complete does not mean the information is sufficient in substance.

User layer and behind-the-scenes layer

The user layer makes the request and feedback understandable. Behind the scenes, sources, relations and decisions are linked.

Useerslaag
  • Onderwerp
  • Instruction
  • Relevante vraag
  • Requested information
  • Delivery
  • Follow-up question
  • Progress
Behind the scenes
  • Registratie en verwerking
  • Documentrelaties
  • Standards / quality framework
  • Voorstellen en menselijke beslismomenten
  • Centrale vastlegging
  • Versiehistorie en herleidbaarheid

Useerslaag → informatie en context → Behind the scenes

Behind the scenes → begrijpelijke vraag en terugkoppeling → Useerslaag

Do you need to deliver something? Do this in Pakhuis or in the closed area.

To the closed area