# Elyra Weekly Dev Meeting

:::info

**When:** Thursdays at 9:00AM Pacific (your [timezone](https://arewemeetingyet.com/Los%20Angeles/2019-10-24/09:00/w/Elyra%20Dev%20Meeting))
**Where:** [Webex](https://ibm.webex.com/meet/akchin)

**New**: [Daily (ex Thursday) dev meetings](https://elyra.readthedocs.io/en/latest/getting_started/getting-help.html#join-the-daily-development-meetings) for things that cannot wait
:::

## January 20th, 2022 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler| IBM | @ptitzler |
| Alan Chin | IBM | @akchinSTC |
| Alex Bozarth | IBM | @ajbozarth |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Luciano Resende | Apple | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| David C Martin | Age@Home | @dcmartin |
| Kevin Bates | IBM | @kevin-bates|

* **Release status**:
* Latest official release [3.4.1]
* [3.4.1 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-4-1-01-07-2022)
* Try it out!
* `pip install --upgrade "elyra[all]==3.4.1" --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.5.0
* 3.5.0 (Targeting Jan 21 but subject to change )
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.5.0)

### Agenda + Minutes

- ptitzler
- Show and tell: support for Airflow 2.x provider packages as catalog types
- [Prototype](https://github.com/elyra-ai/examples/pull/87)
- [Provider list](https://airflow.apache.org/docs/apache-airflow-providers/)

- [Potential enhancement request for Sandhya Nayak](https://github.com/elyra-ai/elyra/issues/2404)

- Alan
- Pushing for merge of the kfp-pipeline-spec package changes, conda-forge PR teed up. [KFP #7165](https://github.com/kubeflow/pipelines/pull/7165)

- Kiersten
- [#2399](https://github.com/elyra-ai/elyra/pull/2399) Fix Airflow component parser naming bug

- Karla
- Presenting Elyra at IBM Jumpstart OS next week

- Kevin
- Should we remove the deprecated `component-registries` schemaspace for 3.5? Was originally deprecated in 3.3 where users can use `elyra-metadata migrate component-registries` to transition them to the new schemaspace: `component-catalogs`
- Yes, but removals come in major releases, right? So this would be for Elyra 4.0 ([kb] - ok, that answers that.)

## January 13th, 2022 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler| IBM | @ptitzler |
| Alan Chin | IBM | @akchinSTC |
| David C Martin | Age@Home | @dcmartin |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Martha Cryan | IBM | @marthacryan |
| Sandhya Nayak | IBM | @sandhya-nayak |
| Kevin Bates | IBM | @kevin-bates |
| Romeo Kienzler | IBM | @romeokienzler |
| Luciano Resende | Apple | @lresende|
| Alex Bozarth | IBM | @ajbozarth |
* **Release status**:
* Latest official release [3.4.1]
* [3.4.1 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-4-1-01-07-2022)
* Try it out!
* `pip install --upgrade "elyra[all]==3.4.1" --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.5.0
* 3.5.0 (Targeting late Jan)
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.5.0) (subject to change)
- 3.6.0 (STC - Subject To Change, Q1 2022)
- JupyterLab 3.3
- 4.0 (STC, ~ Q2 2022)
- JupyterLab 4.0

### Agenda + Minutes

- [Apache Airflow 1.10 reached EOL in June 2021 and only limited support is now provided.](https://github.com/elyra-ai/elyra/issues/2392)
- need to add support for Airflow 2.0
- will drive BYO runtime work

- ptitzler
- Airflow Pipelines: [Add support for GitLab as DAG repository](https://github.com/elyra-ai/elyra/issues/1524)
- Next: [Investigate support for provider packages as catalog types](https://github.com/elyra-ai/elyra/issues/2393)

- alan
- Chugging along with figuring out the kfp builds and our conda forge pkgs
- Moving validation to base processor class for BYO validation

- Karla
- [PR #2383](https://github.com/elyra-ai/elyra/pull/2383) - Validate numeric fields in submit file dialog
- [PR #2388](https://github.com/elyra-ai/elyra/pull/2388) - Add Script Editor language-specific subclasses
- [PR #2390](https://github.com/elyra-ai/elyra/pull/2390) - Update Copyright headers
- Debugger integration planned for 4.0

- Kiersten
- [#2382](https://github.com/elyra-ai/elyra/pull/2382) - Removed support for exporting to KFP DSL

- Kevin
- [#2378](https://github.com/elyra-ai/elyra/pull/2378) Add support for CLI metadata and OVPs using JSON or file contents
- Should be ready for review by end of day
- [#2387](https://github.com/elyra-ai/elyra/issues/2387) Duration time showed wrongly for Python notebook after execution in pipeline
- Opened [issue](https://github.com/deshaw/jupyterlab-execute-time/issues/60) with extension

## January 6th, 2022 Weekly Meeting
### Attendees
Add your name to the table below:

| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | Apple | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Martha Cryan | IBM | @marthacryan |
| Kevin Bates | IBM | @kevin-bates |
| Sandhya Nayak | IBM | @sandhya-nayak |
| David C Martin | Age@Home | @dcmartin |

* **Release status**:
* Latest official release [3.4.0]
* [3.4.0 changelog](https://elyra.readthedocs.io/en/latest/getting_started/changelog.html#release-3-4-0-12-17-2021)
* Try it out!
* `pip install --upgrade "elyra[all]==3.4.0" --use-deprecated legacy-resolver`
* **conda-forge**: [In-Progress](https://anaconda.org/conda-forge/elyra)
* Waiting on KFP dependency (kfp-pipeline-spec, in progress) **blocked**
* https://github.com/conda-forge/staged-recipes/pull/16307
* Next planned release: 3.4.1 (Security Fixes)(Targeting later this week)
* 3.5.0 (Targeting late Jan)
* Sprint planning in progress
* [Deliverables](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A3.5.0) (subject to change)

### Agenda + Minutes

Happy New Year and welcome back!

- Team is currently planning and prioritizing issues and milestones for 2022. If there is something you would like to see please feel free to add it to the agenda.

- Alan
- KFP pipeline spec package work
- Validation service refactoring

- Luciano
- Planning to update Elyra video, in case any one want to help :)

- Kevin
- Metadata CLI support for `OneOf`, `AnyOf`, `AllOf`
* Should be able to implement minimal support
- Will add `--file` and `--json` options to bypass schema-to-options processing for files and strings (respectively)

- (lresende) We have a pr to rewrite metadata cli to be using the same framework from pipeline cli, which would remove a lot of plumbing code. Any plans to continue that?
- Community feedback on direction: https://github.com/elyra-ai/elyra/issues/2376

## Archives of Previous Meetings

### September 2021 - December 2021
https://hackmd.io/@pKZ_L5u4RfOGumfwK4WI7A/rJCL09V2F

### June 2021 - Aug 2021
https://hackmd.io/IOgpuDnCTkW9P-UJNHtGXw?view

### March 2021 - May 2021
https://hackmd.io/Lw1A-PdRS2WbTFXRkVpfxw?view

### Nov 2020 - Feb 2021
https://hackmd.io/k5p_LCI_TYenIsWkeIpz2g?view

### May 2020 - Oct 2020
https://hackmd.io/VMs51wxCRjqTXHhCFCazoQ?view