## December 16, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | Apple | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Alex Bozarth | IBM | @ajbozarth |
| Jay Koehler |Red Hat | @jkoehler-redhat

* **Release status**:
* Latest official release [3.4.0rc0]
* [3.4.0rc0 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-4-0rc0-12-15-2021)
* Try it out!
* `pip install --upgrade "elyra[all]==3.4.0rc0" --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.5.0 (Targeting mid to late Jan)
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.5.0) (subject to change)

### Agenda + Minutes

- Happy Holidays!
- Meetings on 23rd and 30th have been cancelled

- Alan
- Working on the pipeline spec package in conda

- Karla
- Working on script editor integration with lab debugger

## December 9, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Alex Bozarth | IBM | @ajbozarth |
| David C Martin | Age@Home | @dcmartin |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Kevin Bates | IBM | @kevin-bates|
| Martha Cryan | IBM | @marthacryan |
| Patrick Titzler | IBM | @ptitzler|
| Theodore Aptekarev | No org 🤷‍♂️ | @piiq |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Luciano Resende | Apple | @lresende |

* **Release status**:
* Latest official release [3.3.0]
* [3.3.0 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-3-0-12-03-2021)
* Try it out!
* `pip install --upgrade "elyra[all]==3.3.0" --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.4.0 (target mid December)(optimistic =) )
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.4.0) (subject to change)

### Agenda + Minutes

- General Discussion
- Milestone / Sprint Planning / Medium to Long range goals
- global pipeline properties / env etc.
- TODO: schedule meeting to discuss requirements (week of 12/14)
- related issues:
- https://github.com/elyra-ai/elyra/issues/1129
- https://github.com/elyra-ai/elyra/issues/1130
- https://github.com/elyra-ai/elyra/issues/1843
- https://github.com/elyra-ai/elyra/issues/2185
- content manager / cos / object storage / k8s volumes
- bring you own runtime/validation - byor /
- TODO: follow-up with Thi
- git extension improvements
- data/sql
- https://github.com/pbugnion/jupyterlab-sql
- Upcoming JupyterLab release schedule updates
- JupyterLab 4.0 most likely coming late Q1 rather than the expected Janurary. More information should be coming after upcoming dev meetings

- Alan
- [KFP Inputvalue behavior](https://github.com/elyra-ai/elyra/pull/2350) - Changes kfp inputvalue behaviors to accept outputpaths
- Updating Elyra packaging (entrypoints) and working with kfp upstream on conda

- Alex
- Working on moving our builds from source to pre-built extensions

- Kiersten
- Opened [#2349](https://github.com/elyra-ai/elyra/pull/2349) to enable async reloads of the component cache

- ptitzler
- [Elyra related publications are now linked to from the documentation](https://elyra.readthedocs.io/en/latest/getting_started/published-resources.html)
- published blog post that focuses on custom components and catalogs

- Theodore
- General 👋🖖🚀🙏 to the community and a question about Elyra in the VS Code ecosystem

## December 2, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler | IBM | @ptitzler|
| Alan Chin | IBM | @akchinSTC |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Alex Bozarth | IBM | @ajbozarth |
| Martha Cryan | IBM | @marthacryan |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Kevin Bates | IBM | @kevin-bates|
| Luciano Resende | Apple | @lresende |
| David C Martin | Age@Home | @dcmartin |

* **Release status**:
* Latest official release [3.3.0RC2]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2219)
* [3.3.0 RC2 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-3-0rc2-12-01-2021)
* Try it out!
* `pip install --upgrade "elyra[all]==3.3.0rc2" --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.4.0 (target mid December)(optimistic =) )
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.4.0) (subject to change)

### Agenda + Minutes

- Bug in release script causing older releases to use newest npm packages. New releases of 3.0.x, 3.1.x and 3.2.x branches were cut yesterday to address this. Docker image builds are in progress.

- Alan
- Troubleshooting docker CI fails on master
- Reviewing the new examples tutorial for airflow

- Alex
- Migration code has been merged and released in rc2, making it the first feature complete rc

- Luciano
- Release experience
- Runtime specific components
- Migration
- Data passing

- Karla
- [#2320](https://github.com/elyra-ai/elyra/pull/2320) - export dialog title
- [#2327](https://github.com/elyra-ai/elyra/pull/2327) - export file type options for kfp pipelines
- [#2330](https://github.com/elyra-ai/elyra/pull/2330) - fix sorting list of component catalogs

- Kiersten
- [#2336](https://github.com/elyra-ai/elyra/pull/2336) - simple one-line change to fix issue #2323

- ptitzler
- 3.3 blog post
- one of ...

- Luciano
- build status
- next features

## November 25, 2021 Weekly Meeting

No community meeting. Happy Thanksgiving!

## November 18th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Kevin Bates | IBM | @kevin-bates|
| Karla Spuldaro | IBM | @karlaspuldaro |
| David C Martin | Age@Home | @dcmartin |
| Kiersten Stokes | IBM | @kiersten-stokes
| Martha Cryan | IBM | @marthacryan |

* **Release status**:
* Latest official release [3.3.0RC0]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [3.3.0 RC0 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-3-0rc0-11-17-2021)
* Try it out!
* `pip install --upgrade elyra[all] --pre --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.4.0 (target mid December)
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.4.0) (subject to change)

### Agenda + Minutes

REMINDER : There will be no weekly dev meeting next week ( Nov 25 ) Gobble Gobble!

- Alan
- Starting work on [KFP InputValue](https://github.com/elyra-ai/elyra/issues/2197) changes to match up with existing behavior when constructing kfp pipelines
- Fixing the dev docker builds

- Karla
- [#2281](https://github.com/elyra-ai/elyra/issues/2281) - provide guidance on how to add to the component palette: final review

- Kevin
- [Alternate Contents Managers](https://github.com/elyra-ai/elyra/issues/1759)
- Currently assume local filesystem
- Will look into [s3contents](https://github.com/danielfrg/s3contents) to reproduce issue
- This may lead to a general solution for [#1131](https://github.com/elyra-ai/elyra/issues/1131)
- Runtime types
- inching closer to full BYO runtime

- Alex
- Working on wrapping up the migration work for 3.3 [PR](https://github.com/elyra-ai/pipeline-editor/pull/172)
-

- Kiersten
- [examples #80](https://github.com/elyra-ai/examples/pull/80) ready for review

## November 11th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| David C Martin | Age@Home | @dcmartin |
| Kevin Bates | IBM | @kevin-bates |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Luciano Resende | Apple | @lresende |
| Patrick Titzler | IBM | @ptitzler|
| Alex Bozarth | IBM | @ajbozarth |

* **Release status**:
* Latest official release [3.2.2]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-2-1-10-18-2021)
* Try it out!
* `pip install --upgrade elyra[all] --use-deprecated legacy-resolver`
* Get a cup of coffee while you wait =)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.3.0 (target mid November)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.3.0)

### Agenda + Minutes

- Alan
- Airflow Data Exchange - working on some sample test resources, waiting for migration work to complete prior to merge
- https://github.com/elyra-ai/elyra/pull/2267 - schema display name
https://github.com/elyra-ai/elyra/pull/2282 - catalogs schemaspace
https://github.com/elyra-ai/examples/pull/79 - example catalogs mlx connector
https://github.com/elyra-ai/elyra/pull/2286 - component examples made optional
https://github.com/elyra-ai/pipeline-editor/pull/170 - oneofcontrol feature
https://github.com/elyra-ai/elyra/pull/2244 - airflow datax
https://github.com/elyra-ai/pipeline-editor/pull/172 - pipeline migration

- Karla
- Working on [#2281](https://github.com/elyra-ai/elyra/issues/2281) - provide guidance on how to add to the component palette

- Martha
- [#2288](https://github.com/elyra-ai/elyra/pull/2288) Hidden fields in metadata editor

## November 4th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Patrick Titzler | IBM | @ptitzler|
| Luciano Resende | Apple | @lresende |
| Kiersten Stokes | IBM | @kierstenstokes |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kevin Bates | IBM | @kevin-bates |
| Alex Bozarth | IBM | @ajbozarth |
| David C Martin | Age@Home | @dcmartin |

* **Release status**:
* Latest official release [3.2.2]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-2-1-10-18-2021)
* Try it out!
* `pip install --upgrade elyra[all] --use-deprecated legacy-resolver`
* Get a cup of coffee while you wait =)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.3.0 (target early November)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.3.0)

### Agenda + Minutes

- Alan
- [Airflow Datax](https://github.com/elyra-ai/elyra/pull/2244)
- Finishing up validation checks and comments
- How to handle missing value in payload - alex
- small demo?
-

- ptitzer
- wrapping up Kubeflow authentication enhancements
- protyping new pipeline component examples delivery mechanism
- uses BYO component catalog connector infrastructure (eliminates custom server code)
- requires no internet connectivity
- requires no Elyra rebuild (for customization)
- double opt-out
- (1) pip install [implicit|pypi|source]
- (2) enable examples in VPE
- improves up-and-running experience

- Luciano
- [2272](https://github.com/elyra-ai/elyra/pull/2272) - Use local copies of preconfigured runtime components
- [2273](https://github.com/elyra-ai/elyra/pull/2273) - Update to JupyterHub Single User image version 1.1.0
- [2274](https://github.com/elyra-ai/elyra/pull/2274) - Enable building Elyra docker image from current source code

- kevin
- [Runtime types](https://github.com/elyra-ai/elyra/pull/2263)
- Wrapping up test updates
- Could use some help with [`generateSingleFilePipeline`](https://github.com/elyra-ai/elyra/blob/5eceb1753e45801bfc356a91582d045cb551daf1/packages/pipeline-editor/src/utils.ts#L33) for the submit notebook/script
- What help you need... this is sort of creating a piepline file to submit and fiiling the gaps
- Just need to convey runtime_type into the method. Just haven't taken the time to look deep when someone (with knowledge of the env) could probably do it in a couple of minutes
- Hmm, actually won't the runtime_type always be 'generic' in these cases?

- Karla
- [PR #2267](https://github.com/elyra-ai/elyra/pull/2267) - Remove references to schema display_name property from schema and frontend logic : ready for review

- Alex
- Working on pipeline v5 -> v6 migration code for 3.3 release

- David
- Saw FEAST (Feature Store) at LFAI-TAC meeting; very cool; feast.dev

## October 28, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler | IBM | @ptitzler|
| Alan Chin | IBM | @akchinSTC |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Kevin Bates |IBM | @kevin-bates|
| Karla Spuldaro | IBM | @karlaspuldaro |
| David C Martin | Age@Home | @dcmartin |
| Luciano Resende | Apple | @lresende |

* **Release status**:
* Latest official release [3.2.2]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-2-1-10-18-2021)
* Try it out!
* `pip install --upgrade elyra[all] --use-deprecated legacy-resolver`
* Get a cup of coffee while you wait =)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.3.0 (target early November)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.3.0)

### Agenda + Minutes

- discuss [Introduce the notion of Runtime Processor Type](https://github.com/elyra-ai/elyra/issues/2258) proposal

- Alan
- Validation checks - https://github.com/elyra-ai/elyra/pull/2251
- most part working as intended, need submission with runtime config, users need to use --runtime-config flag to reference runtime `name` which doesnt seem right, should just be the type
- Testing migration of packaging to setup.cfg to support runtime sub package installation

- ptitzler
- last call for [survey questions](https://github.com/elyra-ai/elyra/discussions/2239)
- Need to set up component catalog connector marketplace
- Customers will (hopefully) create custom component catalog connectors, which are not included in Elyra, hence BYO
- BYO connectors are provided as is and not endorsed (or maintained) by the community
- dedicated section in https://github.com/elyra-ai/examples?
- customers can open PR to add their connector
- would increase repository traffic and awareness
- show & tell: Improved Kubeflow authentication handling

- Kiersten
- Add some performance improvements for the component cache: [PR#2253](https://github.com/elyra-ai/elyra/pull/2253)
- Only refreshes components in the modified catalog
- Add support for BYO catalog types: [PR#2241](https://github.com/elyra-ai/elyra/pull/2241)
- **demo**
- [More instructions to come]

- Karla
- [Issue #2255](https://github.com/elyra-ai/elyra/issues/2255) - Remove display_name property references from schema and frontend logic
- New contributor's merged PR: [#2252](https://github.com/elyra-ai/elyra/pull/2252)

- Luciano
- [Issue 2258 - Introduce the notion of Runtime Processor Type](https://github.com/elyra-ai/elyra/issues/2258)

## October 21st, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Patrick Titzler | IBM | @ptitzler|
| Kiersten Stokes | IBM | @kiersten-stokes |
| Luciano Resende | Apple | @lresende |
| Alex Bozarth | IBM | @ajbozarth |
| Kevin Bates|IBM | @kevin-bates|
| David C Martin | Age@Home | @dcmartin |

* **Release status**:
* Latest official release [3.2.1]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-2-1-10-18-2021)
* Try it out!
* `pip install --upgrade elyra[all] --use-deprecated legacy-resolver`
* Get a cup of coffee while you wait =)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.3.0 (target late October)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.3.0)

### Agenda + Minutes

- Alan
- [Airflow DataX](https://github.com/elyra-ai/elyra/pull/2244) - First set of changes are in the canvas properties template for the new structure.

- Alex
- Starting work on UI for Airflow DataX
- Quick discussion around https://github.com/elyra-ai/canvas/issues/811

- Luciano
- Github ACL

- ptitzler
- [Introduction to] component catalogs
- Joined project (Kiersten, Kevin, and I)
- Potentially big community opportunity
- Contribute catalog support or bring your own

## October 14th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Patrick Titzler | IBM | @ptitzler|
| David C Martin | Age@Home | @dcmartin |
| Alex Bozarth | IBM | @ajbozarth |
| Luciano Resende | Apple | @lresende |
| Kevin Bates | IBM | @kevin-bates |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Adriano Arantes | Hitachi | @asarantes |tf_node_elyratf_node_elyra

* **Release status**:
* Latest official release [3.2.0]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-2-0-10-12-2021)
* Try it out!
* `pip install elyra`
* `sudo apt update -qq -y`
* `sudo apt install -qq -y jupyter`
* `jupyter lab build` [_dcmartin_: didn't work]
* Get a cup of coffee while you wait =)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec in progress)
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.3.0 (target late October)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.3.0)

### Agenda + Minutes

- ptitzler
- Show and Tell: Use [Machine Learning Exchange](https://github.com/machine-learning-exchange) as component catalog
- This is a proof of concept
- Custom component catalog connector was created based on [these instructions](https://github.com/elyra-ai/elyra/discussions/2224)
- Starting to collect questions for survey

- Alan
- airflow data exchange in progress
- Elyra website status - [link](https://github.com/elyra-ai/elyra-ai-site)
- go / no go?

## October 7th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Martha Cryan | IBM | @marthacryan |
| Alex Bozarth | IBM | @ajbozarth |
| Kevin Bates | IBM | @kevin-bates |
| Karla Spuldaro | IBM | @karlaspuldaro |

* **Release status**:
* Latest official release [3.2.0rc0]
* [What's new summary](https://github.com/elyra-ai/elyra/discussions/2191)
* [changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-2-0rc0-10-06-2021)
* Try it out!
* `pip install elyra[all] --pre && jupyter lab build`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP and Tekton Packages
* Next planned release: 3.3.0 (target late October)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.3)

### Agenda + Minutes

- Alan
- [Kubeflow components update example](https://github.com/elyra-ai/examples/pull/71) - Ok to merge, needs approval
- [Add truncate-file KFP example custom component](https://github.com/elyra-ai/examples/pull/75) - Review in progress
-

## September 30, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler | IBM | @ptitzler|
| David C Martin | Age@Home | @dcmartin |
| Luciano Resende | IBM | @lresende |
| Alex Bozarth | IBM | @ajbozarth |
| Martha Cryan | IBM | @marthacryan |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kevin Bates | IBM | @kevin-bates |

* **Release status**:
* Latest official release [3.1.1](https://elyra.readthedocs.io/en/stable/getting_started/changelog.html#release-3-0-1-08-18-2021) (no changes since last week)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP and Tekton Packages
* Next planned release: 3.2.0 (target early October)
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.2)

### Agenda + Minutes

- Share what you did or ask questions!

- ptitzler
- Ready for initial review: [Custom components for Kubeflow Pipelines tutorial](https://github.com/elyra-ai/examples/pull/70)
- Completion blocked by https://github.com/elyra-ai/elyra/pull/2094

- Alex
- I've finishing (pending further review) my [UI work](https://github.com/elyra-ai/pipeline-editor/pull/161) on adding support for [data exchange between kfp components](https://github.com/elyra-ai/elyra/pull/2094)

- Luciano
- Refactor to make new runtimes more isolated
- Next, work on refactoring the install [2136](https://github.com/elyra-ai/elyra/issues/2136)

- David
- Potential partner to integrate sources of location data; https://kuwala.io/
- Community ideas -> create components to load data from kuwala or even dax?

## September 23rd, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Romeo Kienzler | IBM | @romeokienzler |
| Alan Chin | IBM | @akchinSTC |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Patrick Titzler | IBM | @ptitzler|
| Luciano Resende | IBM | @lresende |
| Thi Nguyen | Startup | @duongnt |
| Kevin Bates | IBM | @kevin-bates|
| Alex Bozarth | IBM | @ajbozarth |
| David C Martin | Age@Home | @dcmartin |
| Kiersten Stokes | IBM | @kiersten-stokes |

Please see our current release status:
* **Release status**:
* [3.1.1](https://elyra.readthedocs.io/en/stable/getting_started/changelog.html#release-3-0-1-08-18-2021) (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v3.1.1?urlpath=lab/tree/binder-demo)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP and Tekton Packages
* **Open Data Hub** [In-Progress](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* 3.2.0 - Next Release
* [Link to Milestone and Issues](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.2.0)
* Support data exchange between KFP components (input and output paths)
* Improved CLI option descriptions
* Elyra python module structure updated
* Component registry caching behavior improved
* Various documentation updates

* Public (and daily) scrum meetings (except Thursdays)
* We will be opening our daily scrum meetings to the community for development discussions at this webex and everyday at 8:30 am (PDT) with the exception of Thursdays (which will continue to be our community meeting at 9 am (PDT))

### Agenda + Minutes

- romeo
- Feature Request: Automatically specify all outputs per notebook in the pipeline editor. [2161](https://github.com/elyra-ai/elyra/issues/2161)

- Related issues (lresende):
- Content service - [957](https://github.com/elyra-ai/elyra/issues/957)
- Parsing apis - [1599](https://github.com/elyra-ai/elyra/issues/1599)

- Alan
- [Data exchange PR](https://hackmd.io/SgvSqrWWR2248mCw2BZ5gg?both) - out of WIP, ready for review
- [dev docker images](https://github.com/elyra-ai/elyra/pull/2166) - addressing reviews

- Kiersten
- Working on a few performance improvements re: the component registry
- [PR #2157](https://github.com/elyra-ai/elyra/issues/2162) improves caching to update on modification of a registry
- [PR #2169](https://github.com/elyra-ai/elyra/pull/2169) adds support for component definition read parallelization
- [Issue #2162](https://github.com/elyra-ai/elyra/issues/2162) will add a watchdog for the registry cache to speed up all operations that touch the registries

- Alex
- Working on UI for [Data exchange between KFP components](https://github.com/elyra-ai/elyra/pull/2094), it's ready for review, but I still need to write/update tests

- ptitzler
- [WIP: Custom component tutorial for Kubeflow Pipelines](https://github.com/elyra-ai/examples/pull/70)
- Blog post: what's new in 3.1/3.2
- considering to start informal micro blogging covering things we work on
- Suggestion (lresende): Use [Jupyter Forum] (https://discourse.jupyter.org/categories) either on the [JupyterLab category](https://discourse.jupyter.org/c/jupyterlab/17) or lobby to create our own Elyra category.

- Karla
- Still working on BYO schemas PR [#2109](https://github.com/elyra-ai/elyra/pull/2109)
- Also WIP debugger integration with script editor [#2087](https://github.com/elyra-ai/elyra/pull/2087)

- Kevin
- Making good progress with Karla on BYO schemas
- Will be reworking the docs to cover the complete metadata service, schemaspaces, schemas providers, metadata class instances, etc.
- Added `post_save()` and `post_delete()` hooks to `Metadata` instance classes. Thrown exceptions will roll back "transaction".

- Thi
- Issues with pipeline validation (pipeline version mismatched)
- Issues with deploying a fork of elyra
- Changes in some UI packages (e.g. `@elyra/ui-components`) not reflected.

## September 16th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | IBM | @lresende |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Luciano Resende | IBM | @lresende |
| Alex Bozarth | IBM | @ajbozarth |
| Patrick Titzler | IBM | @ptitzler|
| David C Martin | Age@Home | @dcmartin |
| Dusan Boskovic | IBM | @dusanboskovic |
| Kevin Bates | IBM | @kevin-bates |
| Romeo Kienzler | IBM | @romeokienzler |

Please see our current release status:
* **Release status**:
* [3.1.1](https://elyra.readthedocs.io/en/stable/getting_started/changelog.html#release-3-0-1-08-18-2021) (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v3.1.1?urlpath=lab/tree/binder-demo)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP and Tekton Packages
* **Open Data Hub** [In-Progress](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* 3.1.1 (Release is out as of 9/15)
* Migration of component registry to metadata service
* Support for private image registries for KFP
* Install - kfp-tekton is now an optional component (https://github.com/elyra-ai/elyra/pull/2043)
* 3.2.0
* [Milestone](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.2.0)
* Support data exchange between custom components and custom components to generic components

### Agenda + Minutes

- Alex
- Working on frontend for Alan's [data exchange PR](https://github.com/elyra-ai/elyra/pull/2094), currently have a [draft PR](https://github.com/elyra-ai/pipeline-editor/pull/161) open with inital work (all class and var names to be changed)
- Working with IBM jumpstart program to introduce open source to devs, so far I have 3 mentees
- I've returned to my work with Martha on donating the metadata editor to core, we're currently focusing on donating the formeditor portion of the code for now.

- Luciano
- Master branch is back to fully functional on Windows
- Have been doing CLI updates
- Goal: Automate CI to clone and run all pipelines scenarios
- Refactoring
- Pipeline runtimes into its own modules [2125](https://github.com/elyra-ai/elyra/pull/2125)
- Next: Tests
- After that: Deployment [2136](https://github.com/elyra-ai/elyra/issues/2136)
- Design Discussions
- UI Morphing based on installed runtime capabilities [2135](https://github.com/elyra-ai/elyra/issues/2135)

- ptitzler
- doc updates for pipeline component management (UI/CLI)
- what's new blog post (likely 3.1/3.2 combined)
- updated [existing medium blog posts](https://medium.com/ibm-data-ai/search?q=elyra)

- Alan
- [Data exchange](https://github.com/elyra-ai/elyra/pull/2094)
- KFP component to component is working
- Airflow controller is in progress
- Moving generic operations in kfp into component form testing

#### Additional Discussion

- (Optional) short introduction for new attendees (Alex)
- ~~Some design discussion around data exchange UI for Airflow, generics, and BYO. (Alex)~~ (Tabled for later when Nick and Luciano are able to join)
- Checkout github.com/motion-ai for @dcmartin project using Jupyter and moving toward Elyra

## September 9th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | IBM | @lresende |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Luciano Resende | IBM | @lresende |
| Kevin Bates | IBM | @kevin-bates |
| Alex Bozarth | IBM | @ajbozarth |
| Thi Nguyen | Startup | @duongnt |
| David C Martin | Age@Home | @dcmartin |

Please see our current release status:
* **Release status**:
* [3.0.1](https://elyra.readthedocs.io/en/stable/getting_started/changelog.html#release-3-0-1-08-18-2021) (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v3.0.0?urlpath=lab/tree/binder-demo)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP and Tekton Packages
* **Open Data Hub** [In-Progress](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* 3.1.0 (Release planned for later today)
* https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.1.0
* Migration of component registry to metadata service
* Support for private image registries for KFP (airflow is stretch)
* Install - kfp-tekton is now an optional component (https://github.com/elyra-ai/elyra/pull/2043)
* 3.2.0
* [Milestone](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.2.0)
* Support data exchange between custom components and custom components to generic components

### Agenda + Minutes

- Alan
- [Data exchange in Airflow](https://github.com/elyra-ai/elyra/pull/2094)
- Currently working on the Apache airflow implementation - some interesting typing issues

- Alex
- Working on UI for Alan's data exchange PR

- Kiersten
- [PR #2083](https://github.com/elyra-ai/elyra/pull/2083) - Registry migration to metadata service
- We've decided to support a GUI in this PR as well
- Expected to be merged today

- Karla
- Elyra pitch to RCOS students
- [#2087](https://github.com/elyra-ai/elyra/pull/2087) - Debugger integration
- [#2109](https://github.com/elyra-ai/elyra/pull/2109) - Bring your own schemas

- Kevin
- BYO Schemas
- Schemaspaces and SchemaProviders have been implemented and switched
- Old namespace REST API still in place, but we should switch to returning schemaspaces (JSON that contains corresponding schemas - should discuss prior)
- SchemaFilters go away with SchemasProvider entrypoint
- schemaspace.display_name added for UI or whatever
- Should be ready for 3.2.0

- Luciano
- Updates for CLI
- Adding CI to Pipeline scenarios
- Refactoring for bring your own runtimes
- KFP changes for V2

- David
- Marquez: https://marquezproject.github.io/marquez/
- Lineage with OpenLineage and Egeria
- LINUX Foundation incubation project (700+ GH stars)

## September 2nd, 2021 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Martha Cryan | IBM | @marthacryan |
| Luciano Resende | IBM | @lresende |
| Alex Bozarth | IBM | @ajbozarth |
| Patrick Titzler | IBM | @ptitzler|
| Kiersten Stokes | IBM | @kiersten-stokes |
| David C Martin | Age@Home | @dcmartin |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kevin Bates | IBM | @kevin-bates |
| Thi Nguyen | Stealth Startup | @duongnt |

Please see our current release status:
* **Release status**:
* [3.0.1](https://elyra.readthedocs.io/en/stable/getting_started/changelog.html#release-3-0-1-08-18-2021) (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v3.0.0?urlpath=lab/tree/binder-demo)
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP and Tekton Packages
* **Open Data Hub** [In-Progress](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* 3.1.0 (in progress - eta next week)
* https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.1.0
* Support data exchange between KFP custom components
* Migration of component registry to metadata service
* Support for private image registries for KFP (airflow is stretch)
* Install - kfp-tekton is now an optional component (https://github.com/elyra-ai/elyra/pull/2043)

### Agenda + Minutes

- Devin
- Website updates
- https://quarryboy.github.io/elyra-ai-site/

- Alan
- [Data exchange](https://github.com/elyra-ai/elyra/pull/2094) between kfp component updates

- Kiersten
- Opened [PR #2083](https://github.com/elyra-ai/elyra/pull/2083) for registry migration
- Some discussion still to come on registry schema and necessary frontend support
- Tests and documentation updates to follow

- Martha
- [#156](https://github.com/elyra-ai/pipeline-editor/pull/156) Bug fix for node label
- Still working on setting editor

- Luciano
- Wrapping up pipeline definition abstraction
- Enabling individual runtime installation (kfp/airflow/both)

- Thi
- Bring your own runtime?
- https://github.com/elyra-ai/elyra/issues/2100

- Karla
- Still working on debugger integration with script editor
- Started work on introducing schemaspaces