Skip down to main content

Trustworthiness Auditing for AI

Trustworthiness Auditing for AI

Overview

All advancements challenge us to reconfigure expectations and integrate them into our lives before we might realise the benefits and opportunities they promise. And yet, artificial intelligence (AI), machine learning, and algorithmic decision-making systems pose distinctive and perhaps unprecedented challenges as we increasingly entrust automated and autonomous systems with lifechanging decisions, recommendations, and physical tasks.

Decisions about our health, employment, parole, and creditworthiness, for example, have their foundation in a physical albeit technological past, but they are now digitally embodied, distributed, and made by systems trained on data about people that reflect historical lessons and prejudices. What sets AI apart is its complexity, subtlety, and unpredictability. When AI systems work, the mechanisms underlying success are often inscrutable or imperceptible, but similarly they often fail in unexpected and confounding ways.

Despite their risks, AI can unlock the potential of people and institutions to work more efficiently and safely, make more accurate decisions, and to improve equity and fairness across all segments of society. To realise these benefits through widespread adoption and avoid ethical, legal, societal, and economic risks, AI systems must be trusted. In turn, the organisations responsible for these systems, and the systems themselves, must be trustworthy and accountable to the communities of practice and people who use and are affected by them.

This project will examine the social and institutional norms, legal mandates, ethical values, and technical constraints guiding the development and governance of trustworthy AI systems. We will develop the necessary evidence base and tools to assess the efficacy of AI accountability toolkits across different systems, domains, and use cases. We will create a meta-toolkit for trustworthy and accountable AI consisting of technical methods, best practice standards, and guidelines designed to encourage sustainable development, usage, and governance of trustworthy and accountable AI systems. And finally, we will promote these goals through related policy and regulatory proposals that set standards for effective and trustworthy usage of accountability tools. Such an integrated, multidisciplinary approach is essential to tackle issues of fairness, bias, and opacity in AI systems from technical, organisational, and regulatory perspectives simultaneously.

Key Information

Funders:
  • Wellcome Trust
  • Sloan Foundation
  • NHSx
  • Project dates:
    September 2021 - December 2024

    All Publications

    Journal Articles

    Conference Papers

    Working Papers

    Participants

    Related Topics:

    Privacy Overview
    Oxford Internet Institute

    This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

    Strictly Necessary Cookies
    • moove_gdrp_popup -  a cookie that saves your preferences for cookie settings. Without this cookie, the screen offering you cookie options will appear on every page you visit.

    This cookie remains on your computer for 365 days, but you can adjust your preferences at any time by clicking on the "Cookie settings" link in the website footer.

    Please note that if you visit the Oxford University website, any cookies you accept there will appear on our site here too, this being a subdomain. To control them, you must change your cookie preferences on the main University website.

    Google Analytics

    This website uses Google Tags and Google Analytics to collect anonymised information such as the number of visitors to the site, and the most popular pages. Keeping these cookies enabled helps the OII improve our website.

    Enabling this option will allow cookies from:

    • Google Analytics - tracking visits to the ox.ac.uk and oii.ox.ac.uk domains

    These cookies will remain on your website for 365 days, but you can edit your cookie preferences at any time via the "Cookie Settings" button in the website footer.