Evaluation of generative AI

Content overview

Introduction
Validation framework
Development and usage

👋 Do you want to learn more about Algorithm Audit’s expertise on generative AI? Get in contact.

Introduction

Algorithm Audit has versatile expertise in evaluating generative AI. We have contributed to developing a validation framework for responsible use of large language models (LLMs) for public information provision. Also, we conduct project work for the AI Office of the European Commission to evaluate socio-technical risks of general purpose AI (GPAI) models.

Validation framework

Soon available in English.

Development and usage of validation framework:

The validation framework ‘Responsible use of Large Language Models (LLMs) for public information provision’ has been developed in collaboration with the Dutch judiciary, Technical University Eindhoven (TU/e), T&T Data Consultancy and Deloitte. The validation framework is for a large extent inspired on the LLM-pilot voorrecht-Rechtspraak. The project is supported by the program ‘Responsible AI in de praktijk’ of the SIDN Fund and TopSectorICT.

The Validation framework is published under the CC BY-4.0 license.