Case repository

Year
Type of audit
Type of algorithm
Ethical issue
Harmonized standard
Algorithm owned by

Bias prevented

Disparities have been identified in the control process of a Dutch public sector organisation regarding misuse of college allowances. In the period 2012-2022, students who lived close to their parent(s) were significantly more often selected for a control procedure than others. The algorithm used to support the selection performed as expected. Read more...

AA:2024:01 technical audit rule-based profiling proxy discrimination public organisation

Risk Profiling for Social Welfare Reexamination

The commission judges that algorithmic risk profiling can be used under strict conditions for sampling residents receiving social welfare for re-examination. The aim of re-examination is a leading factor in judging profiling criteria. Read more...

AA:2023:02 normative audit profiling ML high-risk AI proxy discrimination public organisation

BERT-based disinformation classifier

The audit commission believes there is a low risk of (higher-dimensional) proxy discrimination by the BERT-based disinformation classifier and that the particular difference in treatment identified by the quantitative bias scan can be justified, if certain conditions apply. Read more...

AA:2023:01 normative audit bias detection tool ML high-risk AI FP-FN balancing Algorithm Audit disinformation

Type of SIM card as a predictor variable to detect payment fraud

The audit commission advises against using type of SIM card as an input variable in algorithmic models that predict payment defaults and block afterpay services for specific customers. As it is likely that type of SIM card acts as a proxy-variable for sensitive demographic categories, the model would run an intolerable risk of disproportionally excluding vulnerable demographic groups from the payment service. Read more...

AA:2022:01 normative audit profiling proxy discrimination private organisation e-commerce

Newsletter

Stay up to date about our work by signing up for our newsletter

Newsletter

Stay up to date about our work by signing up for our newsletter