owned this note
owned this note
Published
Linked with GitHub
# Elyra Weekly Dev Meeting Archive: March - May 2021
:::info
**When:** Thursdays at 9:00AM Pacific (your [timezone](https://arewemeetingyet.com/Los%20Angeles/2019-10-24/09:00/w/Elyra%20Dev%20Meeting))
**Where:** [Webex](https://ibm.webex.com/meet/akchin)
:::
## Latest Meeting Minutes
https://hackmd.io/SgvSqrWWR2248mCw2BZ5gg
## May 27th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| David C Martin | Age@Home | @dcmartin |
| Martha Cryan | IBM | @marthacryan |
| Luciano Resende | IBM | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Allison Ishida | IBM | @allisonishida|
| Patrick Titzler| IBM| @ptitzler |
| Kevin Bates | IBM | @kevin-bates |
* **Release status**:
* 2.2.4 (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo)
* **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra)
* **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* **2.3-beta2 release status**
* [2.3-beta2](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0.beta2) - is out and available on pypi - pip install elyra --pre
* **2.3.0 release status**
* [2.3.0](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0) - Milestone in progress
* Support for pipeline specific components
* Pipeline speciifc validation service
### Agenda + Minutes
- Martha
- [#122](https://github.com/elyra-ai/pipeline-editor/pull/122) Adding pipeline properties editor (demo)
- [#1688](https://github.com/elyra-ai/elyra/pull/1688), [#1681](https://github.com/elyra-ai/elyra/pull/1681) Small bug fixes
- [#1683](https://github.com/elyra-ai/elyra/pull/1683) Add indicator for pipeline runtime to pipeline editor toolbar
- Alan
- [#1664](https://github.com/elyra-ai/elyra/pull/1664) - Validation service
- adding batch of test and test resources
- update tests with change? in schema for `runtime`
- Karla
- [#1682](https://github.com/elyra-ai/elyra/pull/1682) - Update clean script to include R support
- Elyra pitch to RCOS students
- Kiersten
- [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Work continues to support runtime-specific components
- Currently working on component execution with a focus on KFP
- Airflow operator execution details will require further discussion
## May 20th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Alex Bozarth | IBM | @ajbozarth |
| Kevin Bates | IBM | @kevin-bates |
| David C Martin | Age@Home | @dcmartin |
| Luciano Resende | IBM | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Patrick Titzler| IBM| @ptitzler |
| Alona Varshal | IBM | @mudspringhiker |
* **Release status**:
* 2.2.4 (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo)
* **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra)
* **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* **2.3-beta2 release status**
* Milestone In Progress : [2.3-beta2](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0.beta2)
### Agenda + Minutes
- Alex
- [#1654](https://github.com/elyra-ai/elyra/pull/1654) will be merged today, add back and expanding support for detection of enviromental variabes used in pipeline nodes
- **Demo**
- Kevin
- [Add indication of runtime into operation's environment](https://github.com/elyra-ai/elyra/pull/1668)
- Enables an executing node to determine the runtime in which it's executing via env var:`ELYRA_RUNTIME_ENV`
- Alan
- [#1664 - Pipeline validation](https://github.com/elyra-ai/elyra/pull/1664)
- supernode(my bad) support
- error message type documentation
- tests and associated resources
- Luciano
- Pipeline Editor 0.3.0 released
- Includes latest Elyra Canvas updates
- Elyra 2.3.0 second beta should be out shortly
-
- Kiersten
- [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Work continues to support runtime-specific components
- Frontend is integrated
- Next steps -- supporting execution, fine-tuning property details
- **Demo**
- Karla
- [#1657](https://github.com/elyra-ai/elyra/pull/1657) - Refactor ui-components, following UI best practices documentation started in [#1594](https://github.com/elyra-ai/elyra/issues/1594)
- [#1678](https://github.com/elyra-ai/elyra/pull/1678) - Fix small bug in script editor output prompt (merged)
## May 13th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Martha Cryan | IBM | @marthacryan |
| Luciano Resende | IBM | @lresende |
| Alona Varshal | IBM | @mudspringhiker |
| Layne Sadler | AIQC | @aiqc |
| Alex Bozarth | IBM | @ajbozarth |
* **Release status**:
* 2.2.4 (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo)
* **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra)
* **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* **2.3-beta2 release status**
* Milestone In Progress : [2.3-beta2](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0.beta2)
* Update docs regarding --upgrade and new version of JL -alpha
### Agenda + Minutes
- Alan
- Very short validation service demo [PR-1664](https://github.com/elyra-ai/elyra/pull/1664)
- Kiersten
- [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Work continues to support runtime-specific components
- End-to-end pass working for KFP and Airflow component parsing
- Martha helping with frontend integration
- Next steps -- supporting execution
- Luciano
- Helping with integration of [#1620] into the Elyra pipeline editor
- Multiple discussions around end-to-end design/integration points
- Martha
- Adding frontend support for [#1620](https://github.com/elyra-ai/elyra/pull/1620)
- [#1631](https://github.com/elyra-ai/elyra/pull/1631) Small update to pipeline editor enum UI
- [#1660](https://github.com/elyra-ai/elyra/pull/1660) Small fix for test failures
- Alex
- Working on (re)adding support for env var detection in pipeline nodes. WIP PRs open: [elyra#1654](https://github.com/elyra-ai/elyra/pull/1654) and [pipeline-editor#116](https://github.com/elyra-ai/pipeline-editor/pull/116)
## May 6th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alex Bozarth | IBM | @ajbozarth |
| Alan Chin | IBM | @akchinSTC |
| David C Martin | Age@Home | @dcmartin |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Kevin Bates | IBM | @kevin-bates |
| Luciano Resende | IBM | @lresende|
| Patrick Titzler| IBM| @ptitzler |
| Lucas LaLima | IBM | @LucasLaLima |
| Layne Sadler | AIQC | @aiqc |
| Romeo Kienzler | IBM | @romeokienzler |
* **Release status**:
* 2.2.4 (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo)
* **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra)
* **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11)
* **2.3-beta release status**
* Published last week, available via pypi
* pip install elyra --pre
* [2.3 beta changelog](https://github.com/elyra-ai/elyra/blob/master/docs/source/getting_started/changelog.md)
### Agenda + Minutes
- Alex
- Working on [710](https://github.com/elyra-ai/elyra/issues/710) to re-add support for automatic detection of env vars for nodes in a pipeline. This was previously partially implemented prior to the new pipeline editor
- Alan
- Pipeline Validation Service - Have draft to iterate off by EOD
- Updating documentation for Kubeflow installation - Kfctl deprecation in favor of kustomize
- Sync up with other kf devs, best practices needed
- Karla
- [#1633](https://github.com/elyra-ai/elyra/pull/1633) - Update command label when creating new Python/R files from the JupyterLab's file menu
- [#1639](https://github.com/elyra-ai/elyra/pull/1639) - Delete unused file in pipeline editor extension
- [#1643](https://github.com/elyra-ai/elyra/pull/1643) - (back to) checking language of code snippets drag and drop into script editors
- New jumpstarter contribution: [#1644](https://github.com/elyra-ai/elyra/pull/1644) - fix broken link
- Kiersten
- [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Working on adding support for additional pipeline components
- Current work:
- Read locally-configured components (in progress; KFP complete pending requested changes; Airflow to come ASAP)
- Filter new component details and properties into the UI (immediate next step)
- Execute pipeline with new components
- Next steps: ability to add custom components
- Luciano
- Helping with design discussions around supporting runtime components on pipeline editor
- Mostly off to Scala land investigating Toree kernel issues
- Issues are turning out to be Scala REPL problems
- https://github.com/scala/bug/issues/12390 :+1:
- Question for @Patrick:
- https://github.com/elyra-ai/elyra/issues/1606
- Suggestion for runtime components:
- Editor for yaml (Patrick)
- Editor for generic Elyra component (Romeo)
- ptitzler
- Fixed Dex authentication issue
- Working on ODH/Elyra documentation
## April 29, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Martha Cryan | IBM | @marthacryan |
| David C Martin | Age@Home | @dcmartin |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Luciano Resende | IBM | @lresende |
| Patrick Titzler| IBM| @ptitzler |
| Karla Spuldaro | IBM | @karlaspuldaro |
|Layne Sadler|AIQC|@aiqc|
| Kevin Bates | IBM | @kevin-bates |
| Bruno Lima | IBM | @limazix |
| Romeo Kienzler | IBM | @romeokienzler |
* **Release status**:
* 2.2.4 (latest stable release)
* **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/)
* **PyPI**: [OK](https://pypi.org/project/elyra/)
* **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated)
* **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo)
* **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra)
* **2.3-beta release status**
* Targetting to be out today
### Agenda + Minutes
- Martha
- [#1591](https://github.com/elyra-ai/elyra/pull/1591) Enabling creating pipelines specific to runtime - almost ready to merge
- [#1626](https://github.com/elyra-ai/elyra/pull/1626) Bug fix for enum in pipeline properties editor storing the display name rather than the value
- No PR yet but working on some UI updates to the new pipeline editor (colors, wording, etc.)
- Romeo (is getting a heart attack)
- [#1614]( https://github.com/elyra-ai/elyra/issues/1614#issuecomment-828647730)
- Karla
- [#1603](https://github.com/elyra-ai/elyra/pull/1603) Display message when no code snippet or tag is defined
- [#1618](https://github.com/elyra-ai/elyra/pull/1618) Fix custom notebook/script code fonts with ligatures
- Layne intro.
- [Jupyter 2021 survey trends](https://layne-bucket.s3.amazonaws.com/all_responses.html). [github/aiqc](https://github.com/aiqc/aiqc).
- Recent Elyra Talks:
- https://www.youtube.com/playlist?list=PLtI2X85XvmrW6lxEeg7V7lUkPOQ1bgumm
## April 22, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | IBM | @lresende |
| Martha Cryan | IBM | @marthacryan |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Lucas LaLima | IBM | @LucasLaLima |
| Patrick Titzler| IBM| @ptitzler |
| Kevin Bates | IBM | @kevin-bates |
| Alex Bozarth | IBM | @ajbozarth |
| David C Martin | [Age@Home](http://age-at-home.com) | @dcmartin |
| Romeo Kienzler | IBM | @romeokienzler |
| Ivan Nesic | University Hospital Basel | |
* **Release status**:
* **2.2.2 release status**
* [Release summary](https://github.com/elyra-ai/elyra/discussions/1260)
* **PyPI**: OK
* **Docker**: OK
* **Binder**: OK
* **conda-forge**: OK
* All packages for 2.2.2 have been published, save r-editor
* **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**:
* Current Elyra version: 2.2.1
* Available in ODH-manifest v1.0.9
* Known issues:
* Update to 2.2.3 in planned
* Do
* Development on kf 1.2.0 was stopped due to istio issues and so focus will shift to kf 1.3.0.
* ** 2.2.3 in progress
* https://github.com/elyra-ai/elyra/pull/1598
* ** 2.3.0-beta release and new features**
* [Closed PRs](https://github.com/elyra-ai/elyra/pulls?q=is%3Apr+milestone%3A2.3.0-beta+is%3Aclosed)
* Prevent exposure of COS credentials (pipelines/KFP/AA)
* Improved build & more predictable results
* Broader automated test coverage
### Agenda + Minutes
- Ivan: GPU setup questions
- https://github.com/elyra-ai/kfp-notebook/issues
- Used container image has Python 3.5 installed/in path, which causes https://github.com/elyra-ai/kfp-notebook/blob/master/etc/docker-scripts/bootstrapper.py#L287 to fail
- 3.5 is not officially supported anymore due to EOL
- Martha
- [#1221](https://github.com/elyra-ai/elyra/pull/1221) pipeline editor PR merged
- Working on [#1591](https://github.com/elyra-ai/elyra/pull/1591) - adding ability to create pipelines specific to runtimes from launcher
- Luciano
- Talking at PyData Montreal today at 3 PM(PST)/6 PM (EST)
- https://www.meetup.com/PyData-MTL/events/277244278/
- We got accepted for SciPy 2021 on July
- Updating release scripts to support:
- Generation of changelog for a given release
- Supporting beta releases
- build/publish docker
- documentation
- Release 2.2.3 and 2.3.0-beta
- Karla
- [#1598](https://github.com/elyra-ai/elyra/pull/1598) new label for the submit notebook/script button + restore resources input alignment on dialog
- Mentoring Elyra at the second round of IBM jumpstart open source program 2021
- Review the jumpstart label in Elyra issues
- Alan
- SciPy Poster Acceptance
- Can submit a binder link, check out Alex's personal branch
- Kubeflow 1.3.0 Testing
- Patrick
- accepted tutorial session at Data and AI conference
## April 15, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler| IBM| @ptitzler |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | IBM | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Martha Cryan | IBM | @marthacryan |
| David C Martin | Age@Home | @dcmartin |
| Bruno Lima | IBM | @limazix |
| Alex Bozarth | IBM | @ajbozarth |
| Lucas Lalima | IBM | @LucasLaLima|
| Kevin Bates | IBM | @kevin-bates |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Romeo Kienzler | IBM | @romeokienzler |
* **Release status**:
* **2.2.1 release status**
* [Release summary](https://github.com/elyra-ai/elyra/discussions/1260)
* **PyPI**: OK
* [elyra-...-extension issue](https://github.com/elyra-ai/elyra/issues/1564)
* **Docker**: OK
* **Binder**: OK
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* NBDime 3.0.0 has been cut and released, git extension release coming soon then we will be unblocked
* **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**:
* Current Elyra version: 2.0.1
* Available in ODH-manifest v1.0.5
* Known issues: https://github.com/elyra-ai/elyra/issues/1473 (fixed in 0.0.7)
* Update to 2.2.1 in progress
* Container image ready (v0.0.7)
* Manifest update done but not yet released
* Development on kf 1.2.0 was stopped due to istio issues and so focus will shift to kf 1.3.0.
* ** 2.2.2 release patch**
* https://github.com/elyra-ai/elyra/pull/1567
* ** 2.3.0-beta release and new features**
* [Closed PRs](https://github.com/elyra-ai/elyra/pulls?q=is%3Apr+milestone%3A2.3.0-beta+is%3Aclosed)
* Prevent exposure of COS credentials (pipelines/KFP/AA)
* Improved build & more predictable results
* Broader automated test coverage
### Agenda + Minutes
- Follow up from last week
- Pipeline Editor accessibility ([raised by Bruno](https://github.com/elyra-ai/elyra/issues/1571))
- Based on the discussion, about editing the pipeline manually, please see: https://github.com/elyra-ai/elyra/issues/1560
- ptitzler
- doc question: https://github.com/elyra-ai/elyra/issues/1566 (updated the issue with TODO items, as discussed)
- Alan
- [1563](https://github.com/elyra-ai/elyra/pull/1563)- update kfp export yaml with cos directory
- Martha
- Pipeline editor demo
- Luciano
- Elyra? Work? Need to remember those after vacation...
- Release 2.2.2 with patches coming by end-of-week
- Will try to get Git released with nbdime 3.0
- this will unblock conda package release
- PyData meetup presentation next week
- Karla
- Introducing Elyra to Florida International University students
- Kevin
- Reviewing PRs
- CI issue status/ideas? Frontend tests are intermittently hanging (seen in py 3.7 and 3.8 so far).
### Demos
- Martha - New pipeline editor
- Bruno - Accessibility
## April 8, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler| IBM| @ptitzler |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Alan Chin | IBM | @akchinSTC |
| Kiersten Stokes | IBM | @kiersten-stokes |
| David C Martin | Age@Home | @dcmartin |
| Martha Cryan | IBM | @marthacryan |
| Kevin Bates | IBM | @kevin-bates |
| Alex Bozarth | IBM | @ajbozarth |
| Bruno Lima | IBM | @limazix |
| Romeo Kienzler | IBM | @romeokienzler |
### Agenda + Minutes
* **Release status**:
* **2.2.1 release status**
* [Release summary](https://github.com/elyra-ai/elyra/discussions/1260)
* **PyPI**: OK
* **Docker**: OK
* **Binder**: OK
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* Blocked by Jupyter releases that have not been updated in conda yet
* should be unblocked 2nd week of April.
* **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**:
* Current Elyra version: 2.0.1
* Available in ODH-manifest v1.0.5
* Known issues: https://github.com/elyra-ai/elyra/issues/1473
* Update to 2.2.1 in progress
* Container image ready (v0.0.7)
* Manifest update in progress
* Development on kf 1.2.0 was stopped due to istio issues and so focus will shift to kf 1.3.0.
* **2.3.0-beta release and new features**
*
- Alan
- [1479](https://github.com/elyra-ai/elyra/issues/1479) - Short cos_secret demo
- david booz @ dabooz-email
- consider HashiCorp's [`Vault`](https://github.com/hashicorp/vault) for general secrets management
- Karla
- [1527](https://github.com/elyra-ai/elyra/pull/1527) - Handle language check on code snippet insert + drag&drop into Script Editors
- Kiersten
- [1460](https://github.com/elyra-ai/elyra/pull/1460) - Refactor env var discovery to backend
- @gabriella on R env var usage and best practice to cover cases
- Alex
- [710](https://github.com/elyra-ai/elyra/issues/710) - Updating env vars after initial pipeline node addition
- Also reviewing 1221, 1527, and 1460
-
- Martha
- [#1221](https://github.com/elyra-ai/elyra/pull/1221) Pipeline editor integration
- Bruno
- accessibility issues with the pipeline editor; will open an issue highlighting major inhibitors
- reach out to Martha for 1-on-1 feedback
## April 1st, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Luciano Resende | IBM | @lresende |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Martha Cryan | IBM | @marthacryan |
| Lucas LaLima | IBM | @LucasLaLima|
| Kevin Bates | IBM | @kevin-bates|
| David C Martin | Age@Home | @dcmartin |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Bruno Lima | IBM | @limazix |
| Alex Bozarth | IBM | @ajbozarth |
| Patrick Titzler| IBM| @ptitzler |
| Akshay Agarwal | IBM| @akshay.agarwal1 |
| Romeo Kienzler | IBM | @romeokienzler |
### Agenda + Minutes
* **Release status**:
* **2.2.1 release status**
* [Release summary](https://github.com/elyra-ai/elyra/discussions/1260)
* **PyPI**: OK
* **Docker**: OK
* **Binder**: OK
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* Blocked by Jupyter releases that have not been updated in conda yet
* should be unblocked 2nd week of April.
* **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**:
* Update to 2.0.1 - is Complete (Alan)
* Available in ODH-manifests v1.0.5
* Known issues: https://github.com/elyra-ai/elyra/issues/1473
* Update to 2.2.x planned (Alan) - in progress
- Luciano
- Release 2.2.1 available as of last night, announcements coming shortly.
- Karla
- R Editor demo
- Fix placeholder dependency file extension in submit notebook dialog [PR #1510](https://github.com/elyra-ai/elyra/pull/1510)
- Martha
- [#1483](https://github.com/elyra-ai/elyra/pull/1483) Added inputs for resource usage (cpu, gpu, ram) to the file submission dialog
- [#1492](https://github.com/elyra-ai/elyra/pull/1492) Bug fix in properties editor
- Pipeline editor
- Kevin
- Will be exploring moving HTTPKernelManager/Client to [juptyer_server](https://github.com/jupyter-server/jupyter_server/issues/455) so other server extensions can better integrate with EG. (Currently, access to EG is only available via REST and not kernel manager instances.)
- Akshay
- Discussion around [#1037](https://github.com/elyra-ai/elyra/issues/1037) - KFP pipelines - Improve usability of exported Python DSL
- David
- FWIW I created a new overview video for the Motion-AI open-source platform https://youtu.be/-nONurw8_Ak (github.com/motion-ai); almost ready for Elyra integration.
## March 25th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| Martha Cryan | IBM | @marthacryan |
| Luciano Resende | IBM | @lresende |
| David C Martin | Age@Home | @dcmartin |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Lucas LaLima | IBM | @LucasLaLima |
| Alex Bozarth | IBM | @ajbozarth |
| Patrick Titzler| IBM| @ptitzler |
| Romeo Kienzler | IBM | @romeokienzler |
* **Release status**:
* **2.1.x release status**
* **PyPI**: OK
* **Docker**: OK
* **Binder**: Fix - in progress
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* Blocked by Jupyter releases that have not been updated in conda yet
* **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**:
* Update to 2.0.1 - is Complete (Alan)
* Available in ODH-manifests v1.0.5
* Known issues: https://github.com/elyra-ai/elyra/issues/1473
* Update to 2.1.x planned (Alan) - in progress
- Romeo
- Where shall pipeline examples which are using the CLAIMED Elyra Component Library go?
- https://github.com/elyra-ai/examples
- https://github.com/elyra-ai/component-library/pipelines
- somewhere else
- Paper on Elyra and the component-library accepted at [First SWForum.eu Workshop on Trustworthy Software and Open Source](https://swforum.eu/news-events/events/first-swforum-workshop-trustworthy-software-and-open-source)
- Elyra and the component-library now part of IBM Call4Code '21
- DEMO of the component library
- Martha
- [#1465](https://github.com/elyra-ai/elyra/pull/1465) Small UI change - adds a button to the pipeline editor toolbar to toggle properties editor open/closed
- [#1459](https://github.com/elyra-ai/elyra/pull/1459) Bug fix in pipeline editor
- [#1221](https://github.com/elyra-ai/elyra/pull/1221) New pipeline editor package - there is a checklist of bugs / features that still need to be added, but it could be tested / reviewed to look for any other issues
- Luciano
- [#1426](https://github.com/elyra-ai/elyra/pull/1246) - Pipeline CLI on final review rounds
- [#1379](https://github.com/elyra-ai/elyra/pull/1379) Wrapping up the metadata cli for this coming release
- [#1456](https://github.com/elyra-ai/elyra/pull/1456) / [#1476](https://github.com/elyra-ai/elyra/pull/1476) - Binder/JupyterHub functionality restored after their regression on registering jupyter server extensions
- Reviews, reviews, reviews
- Karla
- Finishing up R Editor [#1435](https://github.com/elyra-ai/elyra/pull/1435)
- Alan
- [#1468](https://github.com/elyra-ai/elyra/pull/1468) - node labels - ready for merge
- [#1466](https://github.com/elyra-ai/elyra/pull/1466) - kf notebook image - add doc then ready
## March 18th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Romeo Kienzler | IBM | @romeokienzler |
| Patrick Titzler| IBM| @ptitzler |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Martha Cryan | IBM | @marthacryan |
| Lucas LaLima | IBM | @lucasdlalima|
| Kiersten Stokes | IBM | @kiersten-stokes |
| Alan Chin | IBM | @akchinSTC |
| Luciano Resende | IBM | @lresende |
| Kevin Bates | IBM | @kevin-bates |
| David C Martin | age-at-home.com | @dcmartin |
* **Release status**:
* **2.1.x release status**
* **PyPI**: OK
* **Docker**: OK
* **Binder**: FAIL
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* Blocked by Jupyter releases that have not been updated in conda yet
* **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**:
* Elyra is backlevel (1.3.3)
* https://github.com/opendatahub-io/opendatahub.io/pull/6 - is Merged
* Update to 2.0.1 - is Complete (Alan)
* Should be available in ODH v1.0.5
* https://github.com/opendatahub-io/odh-manifests/pull/297
* Update to 2.1.x planned (Alan)
* **Recent publications (blogs, articles, etc)**
* [Elyra pipelines and Apache Airflow](https://dev.to/ibmdeveloper/automate-your-machine-learning-workflow-tasks-using-elyra-and-apache-airflow-1kpa)
* [CLAIMED, a visual and scalable component library for Trusted AI](https://arxiv.org/abs/2103.03281) (pre-print), submitted to scipy2021
### Agenda + Minutes
- vNext feature updates (master branch)
* R script support
* Run R script in pipeline
- Karla
- Working on R Editor feature with Luciano and Lucas [PR #1435](https://github.com/elyra-ai/elyra/pull/1435)
- Demo of R Editor work progress
- R Editor (coming as https://github.com/elyra-ai/elyra/pull/1435)
- Martha
- [#1451](https://github.com/elyra-ai/elyra/pull/1451) Small pipeline properties css bug
- [#1443](https://github.com/elyra-ai/elyra/pull/1443) Updating behavior of dropdowns in metadata editor to allow for default values
- [#9938](https://github.com/jupyterlab/jupyterlab/pull/9938) Bug in ToC for markdown headers
- [#1425](https://github.com/elyra-ai/elyra/pull/1425) Small css fix
- Alan
- [#385](https://github.com/elyra-ai/elyra/issues/385) Parsing Envs from notebooks/ files
- Luciano
- Release 2.1 is out
- Working on R script support
- Working on wrapping up CLIs
- ptitzler
- Elyra/ODH
## March 11th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Patrick Titzler| IBM| @ptitzler |
| Alex Bozarth | IBM | @ajbozarth |
| Karla Spuldaro | IBM | @karlaspuldaro |
| Alan Chin | IBM | @akchinSTC |
| David C Martin | age-at-home.com | @dcmartin |
| Martha Cryan | IBM | @marthacryan |
| Kiersten Stokes | IBM | @kiersten-stokes |
| Luciano Resende | IBM | @lresende |
| Bruno Lima | IBM | @limazix |
| Lucas LaLima | IBM | @lucasdlalima|
| Akshay Agarwal | IBM | @a-ag |
| Kevin Bates | IBM | @kevin-bates |
| Romeo Kienzler | IBM | @romeokienzler |
### Agenda + Minutes
* **Release status**:
* **2.0.x release status** (skip - no changes)
* **PyPI**: OK
* **Docker**: OK
* **Binder**: OK
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* Blocked by Jupyter releases that have not been updated in conda yet
* Open Data Hub: 2.0.1
* **2.1.x release status (master branch)**
* **PyPI**: 2.1.0rc3
* pip install --upgrade elyra==2.1.0rc3 && jupyter lab build
* **Docker**: not available
* **Binder**: not tested
* **conda-forge**: not available/ blocked by third party dependency(Alan)
* Pending issues for GA:
* https://github.com/elyra-ai/elyra/milestone/21
* Pending PRs for GA:
* https://github.com/elyra-ai/elyra/pulls?q=is%3Aopen+is%3Apr+milestone%3A2.1.0
* [Apache Airflow tutorial now available](https://elyra.readthedocs.io/en/latest/getting_started/tutorials.html#running-notebook-pipelines-on-apache-airflow)
Agenda:
Happy 1st Birthday Elyra! 🎉
- Alan
- [#89-90](https://github.com/elyra-ai/kfp-notebook/pull/89) - blocked in testing in openshift
- [#1317](https://github.com/elyra-ai/elyra/pull/1317) - Test changes coming today, should be for 2.1.0
- Martha
- [#1385](https://github.com/elyra-ai/elyra/pull/1385) Add warning before submitting notebook with unsaved changes
- [#1402](https://github.com/elyra-ai/elyra/pull/1402) Remove error label when user fixes invalid field
- Karla
- [PR #1404](https://github.com/elyra-ai/elyra/pull/1404) - Fixes various issues on pipeline dialogs related to missing runtime configurations:
- [#1339](https://github.com/elyra-ai/elyra/issues/1339)
- [#1340](https://github.com/elyra-ai/elyra/issues/1340)
- [#1391](https://github.com/elyra-ai/elyra/issues/1391)
- Tested rc2 and opened new non-blocking issues:
- https://github.com/elyra-ai/elyra/issues/1395 (Code snippets)
- https://github.com/elyra-ai/elyra/issues/1396 (Code snippets)
- https://github.com/elyra-ai/elyra/issues/1397 (Code snippets)
- https://github.com/elyra-ai/elyra/issues/1399 (Python editor)
- https://github.com/elyra-ai/elyra/issues/1400 (LSP)
- David
- demo http://github.com/dcmartin/motion-ai
- Akshay
- [#1037](https://github.com/elyra-ai/elyra/issues/1037) Blocked due to kfp breaking - metacontroller 0
- Luciano
- We are release candidate 3
- Tentative schedule for 2.1.0 by Monday
- Demo - R script Support for Pipeline Editor
## March 4th, 2021 Weekly Meeting
### Attendees
Add your name to the table below:
| Name | Affiliation | Git User-id |
| ----------- | ---------------- | ----------- |
| Alan Chin | IBM | @akchinSTC |
| David C Martin | motion-ai.com | @dcmartin |
| Luciano Resende | IBM | @lresende |
| Martha Cryan | IBM | @marthacryan |
| Alex Bozarth | IBM | @ajbozarth |
| Bruno Lima | IBM | @limazix |
| Patrick Titzler| IBM| @ptitzler |
| Kevin Bates | IBM | @kevin-bates |
| Francesco Murdaca | Red Hat | @pacospace |
| Lucas LaLima | IBM | @lucasdlalima |
| Romeo Kienzler | IBM | @romeokienzler |
### Agenda + Minutes
* **Release status**:
* **2.0.x release status** (skip - no changes)
* PyPI: OK
* Docker: OK
* Binder: OK
* conda-forge: pending (Alan)
* Blocked by Jupyter releases that have not been updated in conda yet
* **2.1.x release status (master branch)**
* Only available in master branch
* Release Candidate 2.1.0rc1 has been published
* pip install --upgrade elyra==2.1.0rc1 && jupyter lab build
* Pending issues for GA:
* https://github.com/elyra-ai/elyra/milestone/21
* Pending PRs for GA:
* https://github.com/elyra-ai/airflow-notebook/pulls
* https://github.com/elyra-ai/kfp-notebook/pulls
* https://github.com/elyra-ai/examples/pulls
Agenda:
- 2.1 feature demos
- Airflow Demo with Elyra 2.1.0 (Alan)
- Pipeline script
- Submit Scripts
- anything else?
- Alan
- [#1362](https://github.com/elyra-ai/elyra/pull/1364/files) - Some small updates based on reviews
- TFD - Hyperparameters [#646](https://github.com/elyra-ai/elyra/issues/646)
- Martha
- Material UI PR merged! [#1293](https://github.com/elyra-ai/elyra/pull/1293)
- Pipeline editor ready to be published after one more PR
- Alex
- [#1327](https://github.com/elyra-ai/elyra/pull/1327) has been merged, addressing the runtimes UI issues blocking the 2.1 release
- [#1369](https://github.com/elyra-ai/elyra/pull/1369) has been opened to add dark mode support missing in #1327
- I'll be starting on [#838](https://github.com/elyra-ai/elyra/issues/838) next
- I've archived the last 4 months of meeting notes, the link can be found below
- Luciano
- CLIs
- Release candidate and release script updates to support RCs
- Reviews, Merges, repeat