AI risk assessment

Artificial Intelligence (AI) Strategy

Vidhi Chugh

AI strategist and ethicist

Ethical guardrails

 

  • UNESCO
    • Need guardrails
    • Prevent risks such as bias and discrimination
    • Fundamental human rights

 

Guardrails

1 https://www.unesco.org/en/artificial-intelligence/recommendation-ethics
Artificial Intelligence (AI) Strategy

AI risks

 

  • National Institute of Standards and Technology (NIST)

    Probability

 

  • Probability of occurrence
  • Degree of the consequences

Impact

1 https://www.nist.gov/artificial-intelligence
Artificial Intelligence (AI) Strategy

Data risks

  • Data privacy
    • Sensitive information

Sensitive information

  • Data bias
    • Perpetuate societal biases  

Societal biases

Artificial Intelligence (AI) Strategy

AI gone wrong

 

  • Gender bias

Recruitment

 

  • Racial discrimination

Mortgage

Artificial Intelligence (AI) Strategy

Data privacy breach

  • Heavy fine for non-compliance with the GDPR
  • Unlawful processing of data
  • Scraped images for facial recognition

 

Privacy penalty

Artificial Intelligence (AI) Strategy

Business implications

Legal

Legal harms

Artificial Intelligence (AI) Strategy

Business implications

Legal, reputational

Reputational harms

Artificial Intelligence (AI) Strategy

Business implications

Legal, reputational and financial harms.

Financial harms

Artificial Intelligence (AI) Strategy

Ethical frameworks

Framework for ethical AI

Artificial Intelligence (AI) Strategy

Ethical frameworks

UNESCO ethics charter

Artificial Intelligence (AI) Strategy

Ethical frameworks

Microsoft elements of responsible AI

Artificial Intelligence (AI) Strategy

Key pillars of risk assessment

Privacy

                Privacy

Fairness

                Fairness

Transparency

             Transparency

Accountability

             Accountability
Artificial Intelligence (AI) Strategy

Regulations and compliance

  • AI project lifecycle

AI project lifecycle

  • Regulations and compliance
    • Accountability requires governance
    • Define roles and responsibilities
    • Compliance with data privacy regulations
    • Seek user consent and anonymize data
Artificial Intelligence (AI) Strategy

Data collection and preparation

Assess

  • Internally available or procure externally?
  • Sensitive information such as Personal Identifiable Information (PII)?
  • Well-represented population?

Well-represented population

Mitigate

  • Processes for data integrity
  • Identifier encryption, synthetic data generation
  • Create balanced data

Create balanced data

Artificial Intelligence (AI) Strategy

Model development and evaluation

  • Explain model outcomes
    • Explanation and bias identification
    • Fair treatment across categories

Explanation and bias identification

Artificial Intelligence (AI) Strategy

Model deployment and monitoring

 

  • Degree of impact

  • Establish mitigation strategies

 

High cost

 

  • Cost is high in healthcare and finance

  • Realign model behavior

 

Healthcare

Artificial Intelligence (AI) Strategy

Let's practice!

Artificial Intelligence (AI) Strategy

Preparing Video For Download...