# Funding Call for Online Learning Courses in Responsible AI - Sandpit

> The Alan Turing Institute is pleased to announce a new funding call aimed at the development and delivery of online learning courses on the broad topic of Responsible AI. This work is part of our commitment to offering immersive learning opportunities in data science and AI with a focus on the ethical and responsible approaches in designing, building and deploying AI for social good.

> This work builds on the ‘Pedagogic innovation in (non-)cognate Data/AI Education through industry-academic co-creation’, which was supported by Towards Turing 2.0 under the EPSRC Grant EP/W037211/1 and The Alan Turing Institute. In addition, Accenture as a Turing strategic partner has provided significant resources towards this funding call.

###### tags: `Sandpit`, `Online Learning Course`, `Responsible AI`

- Link to Funding Call: [Funding Call for Online Learning Courses in Responsible AI](https://www.turing.ac.uk/funding-call-online-learning-courses-responsible-ai)
- Direct link to Call document: [Call Document](https://www.turing.ac.uk/sites/default/files/2022-05/funding_call_document_-_final.pdf)
- Date and time: [Monday 16th May 2022, 14:30 - 16:00 UTC](https://arewemeetingyet.com/London/2022-05-12/10:30/Turing-Funding-Call-Online-Learning-Courses), Duration: 90 minutes

## Introduction

This sandpit will bring you together with academics and industry practitioners from a variety of disciplines. In this session we will:
- introduce principles of effective instructional design,
- provide you with networking opportunities to stimulate collaboration and identify new opportunities for joint bids to the Funding Call for Online Learning Courses in Responsible AI.

# Agenda

:::info
1. Welcome and Introduction to the Call `10 mins`
> [name=Mishka and Sarah]
2. Principles of the sandpit and effective instructional design `10 mins`
> [name=Matt]
3. Breakouts `3x 15 mins`
> [name=All]
3. Session Close and Next Steps `10 min`
> [name=All]
:::

# Introductions
- **Name(s):** David Stern [e-mail]
- **Role and Organisation:** IDEMS International
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- **General Responsible AI topics**
- **1-2 sentence outline of your project idea:** How learning to lie with data is essential to prevent sexist and racist AI.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A Professional audience awareness (Our team is coming from a mostly acdemic background)
- B
- C
- **Name(s):** Aaron Lee
- **Role and Organisation:** QMUL
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Transparency (intermediate and expert level)
- **1-2 sentence outline of your project idea:**
- Pragmatic guidance on developing transparent AI
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- Resources (time)
- **Name(s):** Ferrante Neri
- **Role and Organisation:** Professor of Machine Learning and AI, University of Surrey
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- **1-2 sentence outline of your project idea:** Explaining fairness in Machine Learning to a general user still keeping the mathematical rigour. Providing some real worl examples.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A Understanding from users of AI mechanisms
- B Transparent use of AI from policy makers
- C
- **Name(s):** Var Shankar ([e-mail]), Aurelie Jacquet
- **Role and Organisation:** Responsible AI Institute
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Transparency (intermediate and expert level)
- Responsible AI - Fairness (intermediate and expert level)
- General Responsible AI topics
- We are looking to develop a course for practitioners of AI in financial services, with an emphasis on transparency, at the intermediate or expert level.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- Course development experience
- Experience at a financial institution, for example in risk modeling

- **Name(s):** Jeremy Crampton
- **Role and Organisation:** Prof, Newcastle University
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- 1-2 sentence: I am already responsible for delivering the RRI to our Geospatial CDT at Newcastle/Notts, and have taken some RRI training via EU Embassy of Good Science. It would be good to develop this more specifically eg on digital twins, ethics of location info.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A Need someone current on GeoAI with interests in ethical AI (or ML preferred)
- B Maybe someone with expertise on autonomous systems
- C
- **Name(s):** Aniko Ekart
- **Role and Organisation:** Reader, Computer Science, Aston University
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- General Responsible AI topics
- **1-2 sentence outline of your project idea:** *Trustworthy AI*
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A social science/business perspective
- B industry partners to help set the expectations
- C
- **Name(s):** Annabelle Painter
- **Role and Organisation:** Clinical fellow, AI & Workforce- HEE & NHS AI lab
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- General Responsible AI topics
- **1-2 sentence outline of your project idea:** At HEE/NHS AI lab we are exploring confidence in AI amongst the healthcare workforce and the associated education and training needs.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A
- B
- C
- **Name(s):** Mike Nix
- **Role and Organisation:** Clinical Fellow - NHS AI Lab / Health Education England
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- General Responsible AI topics
- **1-2 sentence outline of your project idea:** We are working on investigating factors that drive confidence in clinical use of AI, particularly appropriate confidence, which acknoweldges the human-AI interaction and the role of cognitive bias. How to educate the workforce to make good AI-assisted/augmented clinical decisions.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- Profession experts - for translation of high level remit to specific educational domains
- Experts in human-AI interaction
- Experts in transparency/explainability

- **Name(s):** Jin Xing
- **Role and Organisation:** School of Engineering, Newcastle University
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- Explainable AI
- **1-2 sentence outline of your project idea:** I plan to investigate new methods to make the blackbox behaviour of AI transparent.
- **What are your percevied gaps for your project?*(Knowledge, expertise, resources, etc)*
- A I want to investigate the user requirement and need of explainable AI.
- B Expertise in human-machine interaction

- **Name(s):** Marianna Ganapini & Ryan Carrier
- **Role and Organisation:** ForHumanity
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- General Responsible AI topics
- **1-2 sentence outline of your project idea:** the foundations of Ethical Choice underpin so much of responsible AI, but they are poorly understood. Our work in this group is to attempt to clarify and develop understanding of the way we identify and make ethical choices. The better everyone involved can identify where ethical choice exists, be better we will, collectively, develop our abilities to build responsible AI. We aim at developing a curriculum/ course on the underpinning of ethical choices in organizations.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A understanding of resources and knowledge on this topic
- B
- C
- **Name(s):** Philip Inglesant [e-mail]
- **Role and Organisation:** ORBIT-RRI
- **Which track(s) are you considering?** (Delete as appropriate)
- General Responsible AI topics
- **1-2 sentence outline of your project idea:** To complete.
Design methods for ethical and responsible AI. We already have a short course based on an Ethics by Design methodology, and we also have self-paced courses on our own LMS for other topics. Would be interested in expanding our EbD course with application-specific examples and to address Transparency in particular
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A - Expertise- ORBIT-RRI is a spin-off from EPSRC project in responsible innovation, so substantial experience in RI
- B - Good experience in ethical AI but could strengthen expertise in Fairness and Transparency

Project idea: adapt existing EbD model to address specific issues and put into ATI Moodle
- **Name(s):** Benita Mathew
- **Role and Organisation:** Lecturer in AI and Fintech
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- General Responsible AI topics
- **1-2 sentence outline of your project idea:** To complete.
- We would like to take a problem-solving/case study based approach to tackle three to four pressing issues in the context of responsible AI coupled with the technical guidance/options to implement change or respond to these issues.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A Collaboration with industry partners to infer pressing issues to suggest a solution that is workable in practice
- B
- C
- **Name(s):** Ogerta Elezaj
- **Role and Organisation:** Lecturer of Computer Science
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness
- **1-2 sentence outline of your project idea:** Respnsible AI in Social Media,
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A Industry Collaboration
- B
- C
- **Name(s):** Nadia Papamichail
- **Role and Organisation:** Senior Lecturer and Manchester Turing Fellow, The University of Manchester/Turing https://www.linkedin.com/in/nadia-papamichail-8339b62/
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Fairness (intermediate and expert level)
- Responsible AI - Transparency (intermediate and expert level)
- Explainable AI; Explanatory tools
- **1-2 sentence outline of your project idea:** Project in the area of decision behaviour/decision analysis. Develop AI Ethics course with case studies with ethical dilemnas for AI developers or decision makers.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- A Resources
- B Applications for case studies (e.g. medical AI)
- C
- **Name(s):** Haiping Lu
- **Role and Organisation:** Senior Lecturer in Machine Learning at The University of Sheffield
- **Which track(s) are you considering?** (Delete as appropriate)
- Responsible AI - Transparency (intermediate and expert level)
- **1-2 sentence outline of your project idea:** We will introduce transparent/interpretable machine learning to audience from multiple disciplines with diverse background. We aim to cover the essentials necessary to go from little/zero knowledge about machine learning to being equipped with the essentials to understand and use classic, fundamental machine learning tools that are transparent.
- **What are your percevied gaps for your project?** *(Knowledge, expertise, resources, etc)*
- We have 5+ years of machine learning teaching experience and about 20 years of machine learning research experience. Our perceieved gap is the resources available for us to develop high-quality materials that will suit audience from a broad spectrum.

# Principles of effective instructional design

- What does *quality* look like in online training?
-
-
-
- What challenges might we encounter in developing online training?
- Ensuring that the training is well understood, since learners are not there present with the trainers
-
-
-
- How can we evaluate the success of online learning development?
-
-
-
-

# Breakout One

:::info
Use the sections below for any note-taking within your groups.
:::

## Group A
-
-
-
-
-

## Group B
-
-
-
-

## Group C
-
-
-
-
-

## Group D
-
-
-
-
-

# Breakout Two

:::info
Use the sections below for any note-taking within your groups.
:::

## Group A
-
-
-
-
-

## Group B
-
-
-
-

## Group C
-
-
-
-
-

## Group D
- participants: Annabelle, Ferrante, Philip, Ogerta,Aniko
- good balance of expertise and interests in this group
- challenges of evaluating success: difficult to capture engagement of participants, whether they encounter any issues (in self-study)
-

# Breakout Three

:::info
Use the sections below for any note-taking within your groups.
:::

## Group A
-
-
-
-
-

## Group B
-
-
-
-

## Group C
-
-
-
-
-

# General Q&A
:::info
Please post any general questions about the Call here and we will address these during the session. For further enquiries, please feel welcome to contact [e-mail].
:::

- Could we work with another institution eg Ada Lovelace Inst?
- Yes as long as it's based in the UK and it has a research focus
- Could we also work with a non-UK organization (along with a UK one)? (So, I am UK-based and would be the applciant and would like to work with both UK-based and non-UK based if possible)
- No unfortunately, the call is open to UK-based applicants only (ie that is, those who are directly affliated with a UK-based institution / public body / business / university etc ). However, the co-applicants / collaborators of the lead applicants can be based outside the UK / affiliated with a non-UK institution.
- What are the timelines for delivering the project?
- The deadline is 26th May. Reviews through June. Work completed between July and December '22. Depending on the scope of the proposal, timescales for delivery may vary.
- From the total budget it looks like ATI is looking to fund around 9-10 projects - is that correct?
- We anticipate funding in the region of ten projects through this call.

# Next Steps

- Deadline for submitting the proposals is 26 May 2022 (11:59 am BST)
- For detailed information about the funding call, please visit [our website](https://www.turing.ac.uk/funding-call-online-learning-courses-responsible-ai).
- Please [read the Call Document](https://www.turing.ac.uk/sites/default/files/2022-05/funding_call_document_-_final.pdf) before starting your application.
- For any questions unanswered there, please email the team at [e-mail].
- Would you like a 1:1 to discuss your project idea? Please feel welcome to contact [e-mail] to find a 15 minute slot.

# :writing_hand: Leave your feedback
What worked?

-
-
-
-
-

What didn’t work?

- Random allocation didn't work well - lots of group repetition
-
-
-
-

What would you change?

- Send out attendee list in advance and request specific people to meet
- Themed breakout rooms for areas of shared interest e.g. finance, health etc
-
-
-

What surprised you?

-
-
-
-
-