# Tutorial Proposal
PyData NYC 2024

_Alexandre Andorra and Christopher Fonnesbeck_

## Title

Mastering Gaussian Processes with PyMC

Tutorial (90 min)

## Abstract

Gaussian processes (GPs) are a powerful Bayesian approach for quantifying uncertainty and making probabilistic inferences, especially when dealing with **complex, non-linear relationships** in regression and classification.
This tutorial will introduce you to the flexibility of GPs in handling diverse data problems, including the [new Hilbert space Gaussian process](https://www.pymc.io/projects/examples/en/latest/gaussian_processes/HSGP-Basic.html) (HSGP) approximation, which scales GPs to large datasets.
By the end, you will be equipped to **specify, fit, and validate GP models** using PyMC, with a special focus on a real-world sports analytics case study.

## Description

Gaussian processes (GPs) are a versatile and powerful tool in the Bayesian modeling toolkit, allowing users to model complex systems without needing to specify exact functional forms. This tutorial is designed for data scientists and statisticians who are new to GPs or want to deepen their understanding.

We'll begin with an overview of probabilistic modeling before outlining the key properties of GPs, notably their flexibility in **capturing non-linear relationships** and their ability to **incorporate prior knowledge**. We will then focus on the practical aspects of building and fitting GP models in PyMC, highlighting the importance of selecting the right covariance function and demonstrating how to [apply the HSGP approximation](https://www.pymc.io/projects/examples/en/latest/gaussian_processes/HSGP-Advanced.html) for scaling to larger datasets.

To reinforce these concepts, we will demonstrate a **Gaussian process modeling workflow using a sports analytics example**. Here we will demonstrate how to use GPs to model the data and generate predictions, showcasing the practical application of these concepts in real-world scenarios.

### Target Audience
This tutorial is aimed at data scientists, statisticians, and researchers with a basic understanding of statistics and Python, who are interested in learning how to apply Gaussian Processes to their work. Prior experience with PyMC is not required but will be beneficial.

### Takeaway
Participants will leave with a **solid understanding of Gaussian Processes and the skills needed to apply these models using PyMC**, including handling large datasets with HSGP. They will also gain insight into practical applications through a detailed sports analytics case study.

### Background Knowledge Required
Basic understanding of probability and statistics, and familiarity with Python.

### Materials Distribution
All tutorial materials, including notebooks and datasets, will be made available via a GitHub repository.

## Outline

1. **Introduction to Probabilistic Modeling** (10 min)
- Overview of modeling complex systems using Gaussian distributions.

2. **What is a Gaussian Process?** (15 min)
- Explanation of Gaussian Processes, their features, and properties.
- Discussion of the flexibility of GPs in capturing non-linear relationships.

3. **Building a Gaussian Process Model in PyMC** (10 min)
- How to choose and customize covariance functions to suit different problems.

4. **Fitting and Evaluating your GP Model** (5 min)
- Methods for fitting GPs and validating their output.

5. **Fast Gaussian Processes: HSGP Approximation** (10 min)
- Introduction to the HSGP approximation and how it scales GPs to large datasets.

6. **Sports Analytics Case Study** (40 min)
- Application of GPs to a real-world sports analytics problem.
- Step-by-step walkthrough of modeling and prediction using GPs in PyMC.