# Elyra Weekly Dev Meeting Archive: March - May 2021 :::info **When:** Thursdays at 9:00AM Pacific (your [timezone](https://arewemeetingyet.com/Los%20Angeles/2019-10-24/09:00/w/Elyra%20Dev%20Meeting)) **Where:** [Webex](https://ibm.webex.com/meet/akchin) ::: ## Latest Meeting Minutes https://hackmd.io/SgvSqrWWR2248mCw2BZ5gg ## May 27th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alan Chin | IBM | @akchinSTC | | David C Martin | Age@Home | @dcmartin | | Martha Cryan | IBM | @marthacryan | | Luciano Resende | IBM | @lresende | | Karla Spuldaro | IBM | @karlaspuldaro | | Kiersten Stokes | IBM | @kiersten-stokes | | Allison Ishida | IBM | @allisonishida| | Patrick Titzler| IBM| @ptitzler | | Kevin Bates | IBM | @kevin-bates | * **Release status**: * 2.2.4 (latest stable release) * **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/) * **PyPI**: [OK](https://pypi.org/project/elyra/) * **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated) * **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo) * **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra) * **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11) * **2.3-beta2 release status** * [2.3-beta2](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0.beta2) - is out and available on pypi - pip install elyra --pre * **2.3.0 release status** * [2.3.0](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0) - Milestone in progress * Support for pipeline specific components * Pipeline speciifc validation service ### Agenda + Minutes - Martha - [#122](https://github.com/elyra-ai/pipeline-editor/pull/122) Adding pipeline properties editor (demo) - [#1688](https://github.com/elyra-ai/elyra/pull/1688), [#1681](https://github.com/elyra-ai/elyra/pull/1681) Small bug fixes - [#1683](https://github.com/elyra-ai/elyra/pull/1683) Add indicator for pipeline runtime to pipeline editor toolbar - Alan - [#1664](https://github.com/elyra-ai/elyra/pull/1664) - Validation service - adding batch of test and test resources - update tests with change? in schema for `runtime` - Karla - [#1682](https://github.com/elyra-ai/elyra/pull/1682) - Update clean script to include R support - Elyra pitch to RCOS students - Kiersten - [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Work continues to support runtime-specific components - Currently working on component execution with a focus on KFP - Airflow operator execution details will require further discussion ## May 20th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alan Chin | IBM | @akchinSTC | | Alex Bozarth | IBM | @ajbozarth | | Kevin Bates | IBM | @kevin-bates | | David C Martin | Age@Home | @dcmartin | | Luciano Resende | IBM | @lresende | | Karla Spuldaro | IBM | @karlaspuldaro | | Patrick Titzler| IBM| @ptitzler | | Alona Varshal | IBM | @mudspringhiker | * **Release status**: * 2.2.4 (latest stable release) * **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/) * **PyPI**: [OK](https://pypi.org/project/elyra/) * **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated) * **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo) * **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra) * **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11) * **2.3-beta2 release status** * Milestone In Progress : [2.3-beta2](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0.beta2) ### Agenda + Minutes - Alex - [#1654](https://github.com/elyra-ai/elyra/pull/1654) will be merged today, add back and expanding support for detection of enviromental variabes used in pipeline nodes - **Demo** - Kevin - [Add indication of runtime into operation's environment](https://github.com/elyra-ai/elyra/pull/1668) - Enables an executing node to determine the runtime in which it's executing via env var:`ELYRA_RUNTIME_ENV` - Alan - [#1664 - Pipeline validation](https://github.com/elyra-ai/elyra/pull/1664) - supernode(my bad) support - error message type documentation - tests and associated resources - Luciano - Pipeline Editor 0.3.0 released - Includes latest Elyra Canvas updates - Elyra 2.3.0 second beta should be out shortly - - Kiersten - [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Work continues to support runtime-specific components - Frontend is integrated - Next steps -- supporting execution, fine-tuning property details - **Demo** - Karla - [#1657](https://github.com/elyra-ai/elyra/pull/1657) - Refactor ui-components, following UI best practices documentation started in [#1594](https://github.com/elyra-ai/elyra/issues/1594) - [#1678](https://github.com/elyra-ai/elyra/pull/1678) - Fix small bug in script editor output prompt (merged) ## May 13th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alan Chin | IBM | @akchinSTC | | Kiersten Stokes | IBM | @kiersten-stokes | | Martha Cryan | IBM | @marthacryan | | Luciano Resende | IBM | @lresende | | Alona Varshal | IBM | @mudspringhiker | | Layne Sadler | AIQC | @aiqc | | Alex Bozarth | IBM | @ajbozarth | * **Release status**: * 2.2.4 (latest stable release) * **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/) * **PyPI**: [OK](https://pypi.org/project/elyra/) * **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated) * **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo) * **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra) * **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11) * **2.3-beta2 release status** * Milestone In Progress : [2.3-beta2](https://github.com/elyra-ai/elyra/issues?q=is%3Aopen+is%3Aissue+milestone%3A2.3.0.beta2) * Update docs regarding --upgrade and new version of JL -alpha ### Agenda + Minutes - Alan - Very short validation service demo [PR-1664](https://github.com/elyra-ai/elyra/pull/1664) - Kiersten - [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Work continues to support runtime-specific components - End-to-end pass working for KFP and Airflow component parsing - Martha helping with frontend integration - Next steps -- supporting execution - Luciano - Helping with integration of [#1620] into the Elyra pipeline editor - Multiple discussions around end-to-end design/integration points - Martha - Adding frontend support for [#1620](https://github.com/elyra-ai/elyra/pull/1620) - [#1631](https://github.com/elyra-ai/elyra/pull/1631) Small update to pipeline editor enum UI - [#1660](https://github.com/elyra-ai/elyra/pull/1660) Small fix for test failures - Alex - Working on (re)adding support for env var detection in pipeline nodes. WIP PRs open: [elyra#1654](https://github.com/elyra-ai/elyra/pull/1654) and [pipeline-editor#116](https://github.com/elyra-ai/pipeline-editor/pull/116) ## May 6th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alex Bozarth | IBM | @ajbozarth | | Alan Chin | IBM | @akchinSTC | | David C Martin | Age@Home | @dcmartin | | Karla Spuldaro | IBM | @karlaspuldaro | | Kiersten Stokes | IBM | @kiersten-stokes | | Kevin Bates | IBM | @kevin-bates | | Luciano Resende | IBM | @lresende| | Patrick Titzler| IBM| @ptitzler | | Lucas LaLima | IBM | @LucasLaLima | | Layne Sadler | AIQC | @aiqc | | Romeo Kienzler | IBM | @romeokienzler | * **Release status**: * 2.2.4 (latest stable release) * **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/) * **PyPI**: [OK](https://pypi.org/project/elyra/) * **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated) * **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo) * **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra) * **Open Data Hub** [OK](https://github.com/opendatahub-io/odh-manifests/tree/v1.0.11) * **2.3-beta release status** * Published last week, available via pypi * pip install elyra --pre * [2.3 beta changelog](https://github.com/elyra-ai/elyra/blob/master/docs/source/getting_started/changelog.md) ### Agenda + Minutes - Alex - Working on [710](https://github.com/elyra-ai/elyra/issues/710) to re-add support for automatic detection of env vars for nodes in a pipeline. This was previously partially implemented prior to the new pipeline editor - Alan - Pipeline Validation Service - Have draft to iterate off by EOD - Updating documentation for Kubeflow installation - Kfctl deprecation in favor of kustomize - Sync up with other kf devs, best practices needed - Karla - [#1633](https://github.com/elyra-ai/elyra/pull/1633) - Update command label when creating new Python/R files from the JupyterLab's file menu - [#1639](https://github.com/elyra-ai/elyra/pull/1639) - Delete unused file in pipeline editor extension - [#1643](https://github.com/elyra-ai/elyra/pull/1643) - (back to) checking language of code snippets drag and drop into script editors - New jumpstarter contribution: [#1644](https://github.com/elyra-ai/elyra/pull/1644) - fix broken link - Kiersten - [#1620](https://github.com/elyra-ai/elyra/pull/1620) - Working on adding support for additional pipeline components - Current work: - Read locally-configured components (in progress; KFP complete pending requested changes; Airflow to come ASAP) - Filter new component details and properties into the UI (immediate next step) - Execute pipeline with new components - Next steps: ability to add custom components - Luciano - Helping with design discussions around supporting runtime components on pipeline editor - Mostly off to Scala land investigating Toree kernel issues - Issues are turning out to be Scala REPL problems - https://github.com/scala/bug/issues/12390 :+1: - Question for @Patrick: - https://github.com/elyra-ai/elyra/issues/1606 - Suggestion for runtime components: - Editor for yaml (Patrick) - Editor for generic Elyra component (Romeo) - ptitzler - Fixed Dex authentication issue - Working on ODH/Elyra documentation ## April 29, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Martha Cryan | IBM | @marthacryan | | David C Martin | Age@Home | @dcmartin | | Kiersten Stokes | IBM | @kiersten-stokes | | Luciano Resende | IBM | @lresende | | Patrick Titzler| IBM| @ptitzler | | Karla Spuldaro | IBM | @karlaspuldaro | |Layne Sadler|AIQC|@aiqc| | Kevin Bates | IBM | @kevin-bates | | Bruno Lima | IBM | @limazix | | Romeo Kienzler | IBM | @romeokienzler | * **Release status**: * 2.2.4 (latest stable release) * **Documentation**: [OK](https://elyra.readthedocs.io/en/stable/) * **PyPI**: [OK](https://pypi.org/project/elyra/) * **Docker**: [elyra (OK)](https://hub.docker.com/r/elyra/elyra/tags?page=1&ordering=last_updated) [kf-notebook (OK)](https://hub.docker.com/r/elyra/kf-notebook/tags?page=1&ordering=last_updated) * **Binder**: [OK](https://mybinder.org/v2/gh/elyra-ai/elyra/v2.2.4?urlpath=lab/tree/binder-demo) * **conda-forge**: [OK](https://anaconda.org/conda-forge/elyra) * **2.3-beta release status** * Targetting to be out today ### Agenda + Minutes - Martha - [#1591](https://github.com/elyra-ai/elyra/pull/1591) Enabling creating pipelines specific to runtime - almost ready to merge - [#1626](https://github.com/elyra-ai/elyra/pull/1626) Bug fix for enum in pipeline properties editor storing the display name rather than the value - No PR yet but working on some UI updates to the new pipeline editor (colors, wording, etc.) - Romeo (is getting a heart attack) - [#1614]( https://github.com/elyra-ai/elyra/issues/1614#issuecomment-828647730) - Karla - [#1603](https://github.com/elyra-ai/elyra/pull/1603) Display message when no code snippet or tag is defined - [#1618](https://github.com/elyra-ai/elyra/pull/1618) Fix custom notebook/script code fonts with ligatures - Layne intro. - [Jupyter 2021 survey trends](https://layne-bucket.s3.amazonaws.com/all_responses.html). [github/aiqc](https://github.com/aiqc/aiqc). - Recent Elyra Talks: - https://www.youtube.com/playlist?list=PLtI2X85XvmrW6lxEeg7V7lUkPOQ1bgumm ## April 22, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alan Chin | IBM | @akchinSTC | | Luciano Resende | IBM | @lresende | | Martha Cryan | IBM | @marthacryan | | Karla Spuldaro | IBM | @karlaspuldaro | | Kiersten Stokes | IBM | @kiersten-stokes | | Lucas LaLima | IBM | @LucasLaLima | | Patrick Titzler| IBM| @ptitzler | | Kevin Bates | IBM | @kevin-bates | | Alex Bozarth | IBM | @ajbozarth | | David C Martin | [Age@Home](http://age-at-home.com) | @dcmartin | | Romeo Kienzler | IBM | @romeokienzler | | Ivan Nesic | University Hospital Basel | | * **Release status**: * **2.2.2 release status** * [Release summary](https://github.com/elyra-ai/elyra/discussions/1260) * **PyPI**: OK * **Docker**: OK * **Binder**: OK * **conda-forge**: OK * All packages for 2.2.2 have been published, save r-editor * **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**: * Current Elyra version: 2.2.1 * Available in ODH-manifest v1.0.9 * Known issues: * Update to 2.2.3 in planned * Do * Development on kf 1.2.0 was stopped due to istio issues and so focus will shift to kf 1.3.0. * ** 2.2.3 in progress * https://github.com/elyra-ai/elyra/pull/1598 * ** 2.3.0-beta release and new features** * [Closed PRs](https://github.com/elyra-ai/elyra/pulls?q=is%3Apr+milestone%3A2.3.0-beta+is%3Aclosed) * Prevent exposure of COS credentials (pipelines/KFP/AA) * Improved build & more predictable results * Broader automated test coverage ### Agenda + Minutes - Ivan: GPU setup questions - https://github.com/elyra-ai/kfp-notebook/issues - Used container image has Python 3.5 installed/in path, which causes https://github.com/elyra-ai/kfp-notebook/blob/master/etc/docker-scripts/bootstrapper.py#L287 to fail - 3.5 is not officially supported anymore due to EOL - Martha - [#1221](https://github.com/elyra-ai/elyra/pull/1221) pipeline editor PR merged - Working on [#1591](https://github.com/elyra-ai/elyra/pull/1591) - adding ability to create pipelines specific to runtimes from launcher - Luciano - Talking at PyData Montreal today at 3 PM(PST)/6 PM (EST) - https://www.meetup.com/PyData-MTL/events/277244278/ - We got accepted for SciPy 2021 on July - Updating release scripts to support: - Generation of changelog for a given release - Supporting beta releases - build/publish docker - documentation - Release 2.2.3 and 2.3.0-beta - Karla - [#1598](https://github.com/elyra-ai/elyra/pull/1598) new label for the submit notebook/script button + restore resources input alignment on dialog - Mentoring Elyra at the second round of IBM jumpstart open source program 2021 - Review the jumpstart label in Elyra issues - Alan - SciPy Poster Acceptance - Can submit a binder link, check out Alex's personal branch - Kubeflow 1.3.0 Testing - Patrick - accepted tutorial session at Data and AI conference ## April 15, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Patrick Titzler| IBM| @ptitzler | | Alan Chin | IBM | @akchinSTC | | Luciano Resende | IBM | @lresende | | Karla Spuldaro | IBM | @karlaspuldaro | | Martha Cryan | IBM | @marthacryan | | David C Martin | Age@Home | @dcmartin | | Bruno Lima | IBM | @limazix | | Alex Bozarth | IBM | @ajbozarth | | Lucas Lalima | IBM | @LucasLaLima| | Kevin Bates | IBM | @kevin-bates | | Kiersten Stokes | IBM | @kiersten-stokes | | Romeo Kienzler | IBM | @romeokienzler | * **Release status**: * **2.2.1 release status** * [Release summary](https://github.com/elyra-ai/elyra/discussions/1260) * **PyPI**: OK * [elyra-...-extension issue](https://github.com/elyra-ai/elyra/issues/1564) * **Docker**: OK * **Binder**: OK * **conda-forge**: not available/ blocked by third party dependency(Alan) * NBDime 3.0.0 has been cut and released, git extension release coming soon then we will be unblocked * **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**: * Current Elyra version: 2.0.1 * Available in ODH-manifest v1.0.5 * Known issues: https://github.com/elyra-ai/elyra/issues/1473 (fixed in 0.0.7) * Update to 2.2.1 in progress * Container image ready (v0.0.7) * Manifest update done but not yet released * Development on kf 1.2.0 was stopped due to istio issues and so focus will shift to kf 1.3.0. * ** 2.2.2 release patch** * https://github.com/elyra-ai/elyra/pull/1567 * ** 2.3.0-beta release and new features** * [Closed PRs](https://github.com/elyra-ai/elyra/pulls?q=is%3Apr+milestone%3A2.3.0-beta+is%3Aclosed) * Prevent exposure of COS credentials (pipelines/KFP/AA) * Improved build & more predictable results * Broader automated test coverage ### Agenda + Minutes - Follow up from last week - Pipeline Editor accessibility ([raised by Bruno](https://github.com/elyra-ai/elyra/issues/1571)) - Based on the discussion, about editing the pipeline manually, please see: https://github.com/elyra-ai/elyra/issues/1560 - ptitzler - doc question: https://github.com/elyra-ai/elyra/issues/1566 (updated the issue with TODO items, as discussed) - Alan - [1563](https://github.com/elyra-ai/elyra/pull/1563)- update kfp export yaml with cos directory - Martha - Pipeline editor demo - Luciano - Elyra? Work? Need to remember those after vacation... - Release 2.2.2 with patches coming by end-of-week - Will try to get Git released with nbdime 3.0 - this will unblock conda package release - PyData meetup presentation next week - Karla - Introducing Elyra to Florida International University students - Kevin - Reviewing PRs - CI issue status/ideas? Frontend tests are intermittently hanging (seen in py 3.7 and 3.8 so far). ### Demos - Martha - New pipeline editor - Bruno - Accessibility ## April 8, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Patrick Titzler| IBM| @ptitzler | | Karla Spuldaro | IBM | @karlaspuldaro | | Alan Chin | IBM | @akchinSTC | | Kiersten Stokes | IBM | @kiersten-stokes | | David C Martin | Age@Home | @dcmartin | | Martha Cryan | IBM | @marthacryan | | Kevin Bates | IBM | @kevin-bates | | Alex Bozarth | IBM | @ajbozarth | | Bruno Lima | IBM | @limazix | | Romeo Kienzler | IBM | @romeokienzler | ### Agenda + Minutes * **Release status**: * **2.2.1 release status** * [Release summary](https://github.com/elyra-ai/elyra/discussions/1260) * **PyPI**: OK * **Docker**: OK * **Binder**: OK * **conda-forge**: not available/ blocked by third party dependency(Alan) * Blocked by Jupyter releases that have not been updated in conda yet * should be unblocked 2nd week of April. * **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**: * Current Elyra version: 2.0.1 * Available in ODH-manifest v1.0.5 * Known issues: https://github.com/elyra-ai/elyra/issues/1473 * Update to 2.2.1 in progress * Container image ready (v0.0.7) * Manifest update in progress * Development on kf 1.2.0 was stopped due to istio issues and so focus will shift to kf 1.3.0. * **2.3.0-beta release and new features** * - Alan - [1479](https://github.com/elyra-ai/elyra/issues/1479) - Short cos_secret demo - david booz @ dabooz-email - consider HashiCorp's [`Vault`](https://github.com/hashicorp/vault) for general secrets management - Karla - [1527](https://github.com/elyra-ai/elyra/pull/1527) - Handle language check on code snippet insert + drag&drop into Script Editors - Kiersten - [1460](https://github.com/elyra-ai/elyra/pull/1460) - Refactor env var discovery to backend - @gabriella on R env var usage and best practice to cover cases - Alex - [710](https://github.com/elyra-ai/elyra/issues/710) - Updating env vars after initial pipeline node addition - Also reviewing 1221, 1527, and 1460 - - Martha - [#1221](https://github.com/elyra-ai/elyra/pull/1221) Pipeline editor integration - Bruno - accessibility issues with the pipeline editor; will open an issue highlighting major inhibitors - reach out to Martha for 1-on-1 feedback ## April 1st, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Luciano Resende | IBM | @lresende | | Karla Spuldaro | IBM | @karlaspuldaro | | Martha Cryan | IBM | @marthacryan | | Lucas LaLima | IBM | @LucasLaLima| | Kevin Bates | IBM | @kevin-bates| | David C Martin | Age@Home | @dcmartin | | Kiersten Stokes | IBM | @kiersten-stokes | | Bruno Lima | IBM | @limazix | | Alex Bozarth | IBM | @ajbozarth | | Patrick Titzler| IBM| @ptitzler | | Akshay Agarwal | IBM| @akshay.agarwal1 | | Romeo Kienzler | IBM | @romeokienzler | ### Agenda + Minutes * **Release status**: * **2.2.1 release status** * [Release summary](https://github.com/elyra-ai/elyra/discussions/1260) * **PyPI**: OK * **Docker**: OK * **Binder**: OK * **conda-forge**: not available/ blocked by third party dependency(Alan) * Blocked by Jupyter releases that have not been updated in conda yet * should be unblocked 2nd week of April. * **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**: * Update to 2.0.1 - is Complete (Alan) * Available in ODH-manifests v1.0.5 * Known issues: https://github.com/elyra-ai/elyra/issues/1473 * Update to 2.2.x planned (Alan) - in progress - Luciano - Release 2.2.1 available as of last night, announcements coming shortly. - Karla - R Editor demo - Fix placeholder dependency file extension in submit notebook dialog [PR #1510](https://github.com/elyra-ai/elyra/pull/1510) - Martha - [#1483](https://github.com/elyra-ai/elyra/pull/1483) Added inputs for resource usage (cpu, gpu, ram) to the file submission dialog - [#1492](https://github.com/elyra-ai/elyra/pull/1492) Bug fix in properties editor - Pipeline editor - Kevin - Will be exploring moving HTTPKernelManager/Client to [juptyer_server](https://github.com/jupyter-server/jupyter_server/issues/455) so other server extensions can better integrate with EG. (Currently, access to EG is only available via REST and not kernel manager instances.) - Akshay - Discussion around [#1037](https://github.com/elyra-ai/elyra/issues/1037) - KFP pipelines - Improve usability of exported Python DSL - David - FWIW I created a new overview video for the Motion-AI open-source platform https://youtu.be/-nONurw8_Ak (github.com/motion-ai); almost ready for Elyra integration. ## March 25th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alan Chin | IBM | @akchinSTC | | Martha Cryan | IBM | @marthacryan | | Luciano Resende | IBM | @lresende | | David C Martin | Age@Home | @dcmartin | | Kiersten Stokes | IBM | @kiersten-stokes | | Karla Spuldaro | IBM | @karlaspuldaro | | Lucas LaLima | IBM | @LucasLaLima | | Alex Bozarth | IBM | @ajbozarth | | Patrick Titzler| IBM| @ptitzler | | Romeo Kienzler | IBM | @romeokienzler | * **Release status**: * **2.1.x release status** * **PyPI**: OK * **Docker**: OK * **Binder**: Fix - in progress * **conda-forge**: not available/ blocked by third party dependency(Alan) * Blocked by Jupyter releases that have not been updated in conda yet * **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**: * Update to 2.0.1 - is Complete (Alan) * Available in ODH-manifests v1.0.5 * Known issues: https://github.com/elyra-ai/elyra/issues/1473 * Update to 2.1.x planned (Alan) - in progress - Romeo - Where shall pipeline examples which are using the CLAIMED Elyra Component Library go? - https://github.com/elyra-ai/examples - https://github.com/elyra-ai/component-library/pipelines - somewhere else - Paper on Elyra and the component-library accepted at [First SWForum.eu Workshop on Trustworthy Software and Open Source](https://swforum.eu/news-events/events/first-swforum-workshop-trustworthy-software-and-open-source) - Elyra and the component-library now part of IBM Call4Code '21 - DEMO of the component library - Martha - [#1465](https://github.com/elyra-ai/elyra/pull/1465) Small UI change - adds a button to the pipeline editor toolbar to toggle properties editor open/closed - [#1459](https://github.com/elyra-ai/elyra/pull/1459) Bug fix in pipeline editor - [#1221](https://github.com/elyra-ai/elyra/pull/1221) New pipeline editor package - there is a checklist of bugs / features that still need to be added, but it could be tested / reviewed to look for any other issues - Luciano - [#1426](https://github.com/elyra-ai/elyra/pull/1246) - Pipeline CLI on final review rounds - [#1379](https://github.com/elyra-ai/elyra/pull/1379) Wrapping up the metadata cli for this coming release - [#1456](https://github.com/elyra-ai/elyra/pull/1456) / [#1476](https://github.com/elyra-ai/elyra/pull/1476) - Binder/JupyterHub functionality restored after their regression on registering jupyter server extensions - Reviews, reviews, reviews - Karla - Finishing up R Editor [#1435](https://github.com/elyra-ai/elyra/pull/1435) - Alan - [#1468](https://github.com/elyra-ai/elyra/pull/1468) - node labels - ready for merge - [#1466](https://github.com/elyra-ai/elyra/pull/1466) - kf notebook image - add doc then ready ## March 18th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Romeo Kienzler | IBM | @romeokienzler | | Patrick Titzler| IBM| @ptitzler | | Karla Spuldaro | IBM | @karlaspuldaro | | Martha Cryan | IBM | @marthacryan | | Lucas LaLima | IBM | @lucasdlalima| | Kiersten Stokes | IBM | @kiersten-stokes | | Alan Chin | IBM | @akchinSTC | | Luciano Resende | IBM | @lresende | | Kevin Bates | IBM | @kevin-bates | | David C Martin | age-at-home.com | @dcmartin | * **Release status**: * **2.1.x release status** * **PyPI**: OK * **Docker**: OK * **Binder**: FAIL * **conda-forge**: not available/ blocked by third party dependency(Alan) * Blocked by Jupyter releases that have not been updated in conda yet * **Integration with [Open Data Hub (ODH)](https://opendatahub.io/)**: * Elyra is backlevel (1.3.3) * https://github.com/opendatahub-io/opendatahub.io/pull/6 - is Merged * Update to 2.0.1 - is Complete (Alan) * Should be available in ODH v1.0.5 * https://github.com/opendatahub-io/odh-manifests/pull/297 * Update to 2.1.x planned (Alan) * **Recent publications (blogs, articles, etc)** * [Elyra pipelines and Apache Airflow](https://dev.to/ibmdeveloper/automate-your-machine-learning-workflow-tasks-using-elyra-and-apache-airflow-1kpa) * [CLAIMED, a visual and scalable component library for Trusted AI](https://arxiv.org/abs/2103.03281) (pre-print), submitted to scipy2021 ### Agenda + Minutes - vNext feature updates (master branch) * R script support * Run R script in pipeline - Karla - Working on R Editor feature with Luciano and Lucas [PR #1435](https://github.com/elyra-ai/elyra/pull/1435) - Demo of R Editor work progress - R Editor (coming as https://github.com/elyra-ai/elyra/pull/1435) - Martha - [#1451](https://github.com/elyra-ai/elyra/pull/1451) Small pipeline properties css bug - [#1443](https://github.com/elyra-ai/elyra/pull/1443) Updating behavior of dropdowns in metadata editor to allow for default values - [#9938](https://github.com/jupyterlab/jupyterlab/pull/9938) Bug in ToC for markdown headers - [#1425](https://github.com/elyra-ai/elyra/pull/1425) Small css fix - Alan - [#385](https://github.com/elyra-ai/elyra/issues/385) Parsing Envs from notebooks/ files - Luciano - Release 2.1 is out - Working on R script support - Working on wrapping up CLIs - ptitzler - Elyra/ODH ## March 11th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Patrick Titzler| IBM| @ptitzler | | Alex Bozarth | IBM | @ajbozarth | | Karla Spuldaro | IBM | @karlaspuldaro | | Alan Chin | IBM | @akchinSTC | | David C Martin | age-at-home.com | @dcmartin | | Martha Cryan | IBM | @marthacryan | | Kiersten Stokes | IBM | @kiersten-stokes | | Luciano Resende | IBM | @lresende | | Bruno Lima | IBM | @limazix | | Lucas LaLima | IBM | @lucasdlalima| | Akshay Agarwal | IBM | @a-ag | | Kevin Bates | IBM | @kevin-bates | | Romeo Kienzler | IBM | @romeokienzler | ### Agenda + Minutes * **Release status**: * **2.0.x release status** (skip - no changes) * **PyPI**: OK * **Docker**: OK * **Binder**: OK * **conda-forge**: not available/ blocked by third party dependency(Alan) * Blocked by Jupyter releases that have not been updated in conda yet * Open Data Hub: 2.0.1 * **2.1.x release status (master branch)** * **PyPI**: 2.1.0rc3 * pip install --upgrade elyra==2.1.0rc3 && jupyter lab build * **Docker**: not available * **Binder**: not tested * **conda-forge**: not available/ blocked by third party dependency(Alan) * Pending issues for GA: * https://github.com/elyra-ai/elyra/milestone/21 * Pending PRs for GA: * https://github.com/elyra-ai/elyra/pulls?q=is%3Aopen+is%3Apr+milestone%3A2.1.0 * [Apache Airflow tutorial now available](https://elyra.readthedocs.io/en/latest/getting_started/tutorials.html#running-notebook-pipelines-on-apache-airflow) Agenda: Happy 1st Birthday Elyra! 🎉 - Alan - [#89-90](https://github.com/elyra-ai/kfp-notebook/pull/89) - blocked in testing in openshift - [#1317](https://github.com/elyra-ai/elyra/pull/1317) - Test changes coming today, should be for 2.1.0 - Martha - [#1385](https://github.com/elyra-ai/elyra/pull/1385) Add warning before submitting notebook with unsaved changes - [#1402](https://github.com/elyra-ai/elyra/pull/1402) Remove error label when user fixes invalid field - Karla - [PR #1404](https://github.com/elyra-ai/elyra/pull/1404) - Fixes various issues on pipeline dialogs related to missing runtime configurations: - [#1339](https://github.com/elyra-ai/elyra/issues/1339) - [#1340](https://github.com/elyra-ai/elyra/issues/1340) - [#1391](https://github.com/elyra-ai/elyra/issues/1391) - Tested rc2 and opened new non-blocking issues: - https://github.com/elyra-ai/elyra/issues/1395 (Code snippets) - https://github.com/elyra-ai/elyra/issues/1396 (Code snippets) - https://github.com/elyra-ai/elyra/issues/1397 (Code snippets) - https://github.com/elyra-ai/elyra/issues/1399 (Python editor) - https://github.com/elyra-ai/elyra/issues/1400 (LSP) - David - demo http://github.com/dcmartin/motion-ai - Akshay - [#1037](https://github.com/elyra-ai/elyra/issues/1037) Blocked due to kfp breaking - metacontroller 0 - Luciano - We are release candidate 3 - Tentative schedule for 2.1.0 by Monday - Demo - R script Support for Pipeline Editor ## March 4th, 2021 Weekly Meeting ### Attendees Add your name to the table below: | Name | Affiliation | Git User-id | | ----------- | ---------------- | ----------- | | Alan Chin | IBM | @akchinSTC | | David C Martin | motion-ai.com | @dcmartin | | Luciano Resende | IBM | @lresende | | Martha Cryan | IBM | @marthacryan | | Alex Bozarth | IBM | @ajbozarth | | Bruno Lima | IBM | @limazix | | Patrick Titzler| IBM| @ptitzler | | Kevin Bates | IBM | @kevin-bates | | Francesco Murdaca | Red Hat | @pacospace | | Lucas LaLima | IBM | @lucasdlalima | | Romeo Kienzler | IBM | @romeokienzler | ### Agenda + Minutes * **Release status**: * **2.0.x release status** (skip - no changes) * PyPI: OK * Docker: OK * Binder: OK * conda-forge: pending (Alan) * Blocked by Jupyter releases that have not been updated in conda yet * **2.1.x release status (master branch)** * Only available in master branch * Release Candidate 2.1.0rc1 has been published * pip install --upgrade elyra==2.1.0rc1 && jupyter lab build * Pending issues for GA: * https://github.com/elyra-ai/elyra/milestone/21 * Pending PRs for GA: * https://github.com/elyra-ai/airflow-notebook/pulls * https://github.com/elyra-ai/kfp-notebook/pulls * https://github.com/elyra-ai/examples/pulls Agenda: - 2.1 feature demos - Airflow Demo with Elyra 2.1.0 (Alan) - Pipeline script - Submit Scripts - anything else? - Alan - [#1362](https://github.com/elyra-ai/elyra/pull/1364/files) - Some small updates based on reviews - TFD - Hyperparameters [#646](https://github.com/elyra-ai/elyra/issues/646) - Martha - Material UI PR merged! [#1293](https://github.com/elyra-ai/elyra/pull/1293) - Pipeline editor ready to be published after one more PR - Alex - [#1327](https://github.com/elyra-ai/elyra/pull/1327) has been merged, addressing the runtimes UI issues blocking the 2.1 release - [#1369](https://github.com/elyra-ai/elyra/pull/1369) has been opened to add dark mode support missing in #1327 - I'll be starting on [#838](https://github.com/elyra-ai/elyra/issues/838) next - I've archived the last 4 months of meeting notes, the link can be found below - Luciano - CLIs - Release candidate and release script updates to support RCs - Reviews, Merges, repeat