Documentatie voor AI-systemen

Open-source templates voor modeldocumentatie van AI-systemen. Afgestemd op de eisen uit de AI Verordening en Nederlandse soft law kaders, zoals de Handreiking Algoritmeregister van het Ministerie van Binnenlandse Zaken.

Help mee ontwikkelen, deel feedback middels Github of via info@algorithmaudit.eu.

Overview

Back to overview

Identification AI systems and impactful algorithms

Determine whether your system is an AI system or impactful algorithm by answering a maximum of 8 questions.

* required

Automation of rules devised by humans

Does the system directly automate rules established in legislation, regulations, or other guidelines created by people?

If rules within your application are not explicilty predefined and documented, select here “no”. Software requirements with certain degrees of freedom are not considered to be rules devised by humans.

Yes, legislation or regulation

One-on-one automation of rules established in legislation or regulations

Yes, devised by people

One-on-one automation of human-generated rules (other than laws or regulations)

No

Which law or regulation?
*

Does the system contain a model or decision rules derived from data?

Yes, manually created

Model or algorithm is manually created, but with the help of data analysis to determine, for example, selection of variables, weighting factors or threshold values

Yes, by statistical methods

Model or algorithm is created through optimization, machine learning, simulation or something similar

false

Which of the following categories does the system’s outcome fall into?

An estimated score, ranking or chance

An estimated label or classification

Yes/no, high/low or a division into groups

A recommendation

A decision

Content (written text, video, audio or images)

A graph or dashboard is not considered content

Another kind of output

Provide a description of the output

Which of the following categories does the system’s outcome fall into?

An estimated score, ranking or chance

An estimated label or classification

Yes/no, high/low or a division into groups

A recommendation

A decision

Content (written text, video, audio or images)

A graph or dashboard is not considered content

Another kind of output

Provide a description of the output
*

The following questions relate to the process in which the application is used. For the answers, it does not matter how automated this process is or what role the application has in the process. We will ask about the role of the application afterward.

Role in decision making

Are decisions made for individual citizens in the process? Note: a decision is much broader than a formal resolution.

true

false

Type of decision

What kind of decisions are made in the process? Choose the option that best matches the type of decision.

Decision that has direct financial consequences for citizens

For instances, decisions about benefits, allowances, grants, fines, repayments or the possibility of a payment arrangement

Decision on applications and requests without any direct financial consequences

Decision about formal complaints and objections

Decision about prioritization or routing of applications, requests, complaints, and objections

Decision about inspection, research/investigation or request for additional information by the citizen

Other

Describe the type of decision
*

Type of interaction with citizen

Does the process contribute to how the government categorises or approaches (groups of) residents?

Select “Yes” if you are uncertain, and briefly describe why.

true

false

Effect of the application

What is the effect of the system on the outcome of the process?

Choose the option that best fits.

The outcome of the process is directly determined by the system

For instance, straight through processing. Human supervision can be applied afterwards by viewing or analyzing the results.

The outcome of the process is largely influenced by the system

For instance, because work instructions connect a consequence to a specific output of the system. An employee can make different choices, but in practice the output is a decisive factor for the outcome of the process.

The outcome of the process is influenced to some extent by the output of the system

The output of the application is an important factor for the process outcome, but an employee makes the choice about the outcome itself. This employee has the right information, experience/skills, mandate and available time to make this choice.