# Pulpcore/katello/pulp_deb integration meeting
See also: https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## Overview
* Purpose: Facilitate release-planning between Pulp3, Katello, and pulp_deb releases
* Attendees: pulpcore, katello, pulp_deb reps; others as needed
## Template
```
## YYYY-MM-DD 1000-1030 GMT-5
### Attendees:
### Regrets:
### Agenda:
* Previous AIs:
### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
```
# 2023
## 2023-09-05 1000-1030 GMT-5
### Attendees:
### Regrets:
### Agenda:
* Previous AIs:
* RE structured-deb-content
* AI: [quba42] get forklift-env set up w/ POC uip and running
* AI: [quba42/iballou] work together to get a meeting together w/ Appropriate Knowledgeable Folk to go over the POC
* AI: [iballou] nag more folk to review the structured-content-doc
*
### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-08-01 1000-1030 GMT-5
### Attendees: ggainey, quba42, hstct, iballou, sjha
### Regrets:
### Agenda:
* Previous AIs:
* DONE AI: [ggainey] nag iballou RE [katello RFE](https://community.theforeman.org/t/auto-select-errata-which-is-solved-by-installing-another-erratum/31615), pulp_deb/3.0 migration issue
* DONE AI: [quba42] ask ewoud about theforeman-reviewers for PR
* DONE AI: [quba42] to finally write that RFC on "structured APT"
* https://community.theforeman.org/t/rfc-transitioning-katello-to-structured-apt-deb-content/34262
* My apologies for the amount of text.
* We had a strange edge case where a Pulp publication failed because of full disk. (The Pulp sync was successfull) This means the repo was synced and all the packages showed up in Katello, but the content wasn't actually being served in the CV. Re-syncing did nothing, because the Pulp re-sync reported no new packages, so Katello did not bother to re-publish. Ultimately we solved it by doing a "republish repository metadata" using hammer.
* Are there plans for "republish repository metadata" to come back to the UI, or will it remain hammer only?
* The above showed that if sync succeeds, but publish fails, regular Katello usage will never repair this situation, can this be improved?
* there are lots of ways metadata might get corrupted
* katello is restoring "republish" to the UI for non-mirror-complete repositories
* there is a push to make it globally available in spite of ways that might Go Worng - discussion in progress
* review of structured-apt writeup
* will be in pulp_deb 3.0
* 2 katello PRs, 1 subscription-manager PR
* how to make forklist use unreleased versions of "things"?
* iballou: usually just do a pip-install of source
* orcharino test-setup - see quba42 for details
* still [edge-cases](https://community.theforeman.org/t/rfc-transitioning-katello-to-structured-apt-deb-content/34262#remaining-challenges-and-limitations-5) that need to be solved
* prob need to get together w/ someone on candlepin to iron out some details
* who should quba42 work with/demo to, to work thru the pulp_deb/katello/candlepin pieces?
* paji/jlentz/croberts?
* AI: [quba42] get forklift-env set up w/ POC uip and running
* AI: [quba42/iballou] work together to get a meeting together w/ Appropriate Knowledgeable Folk to go over the POC
* AI: [iballou] nag more folk to review the structured-content-doc
* is this something katello/4.10 has-to have?
* is there a pulp_deb compatible with core/3.28?
* yes - 2.22 (we think)
* is that the right version for katello/4.10? If not, tell iballou "now"
* there exists a long data-migration to get to pulp_deb/3
* notes from chat
* Samir Jha
1. This deb release will be compatible with pulpcore >= 3.25 ?
2. Is there any migration involved of existing deb repositories?
3. We can move those settings to installer and possibly options there like we do for --enable-deb?
* hstct responds
1. right now it is compatible with it.
2. yes there is I believe it this one here: https://github.com/pulp/pulp_deb/blob/main/pulp_deb/app/migrations/0025_merge_colliding_structure_content.py
### Action Items:
* RE structured-deb-content
* AI: [quba42] get forklift-env set up w/ POC uip and running
* AI: [quba42/iballou] work together to get a meeting together w/ Appropriate Knowledgeable Folk to go over the POC
* AI: [iballou] nag more folk to review the structured-content-doc
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-07-11 1000-1030 GMT-5
### Attendees: quba42, hstct, bernhards, ggainey, mbucher
### Regrets: all of katello
### Agenda:
* Previous AIs:
* RFC: https://projects.theforeman.org/issues/35778
* AI: [ggainey] poke iballou to respond to this thread!
* "sometimes" the requested behavior works
* applying N+1 can make N unapplicable?
* get that fact into the thread!
* AI: [ggainey] add thoughts to discourse thread [DONE]
* More of a Foreman deployment (rather than a Katello topic), but whom to ask (?) about review for: https://github.com/theforeman/foreman/pull/9318
* ggainey does not know - maybe ask Ewoud in Matrix?
* Transitioning Katello to “structured APT”:
* Tracker: https://projects.theforeman.org/issues/35959
* Draft PR: https://github.com/Katello/katello/pull/10420
* We have encountered a challenge: cp2_content always seems to be updated simultaneously across all LCENVs, as soon as the corresponding katello_root_repository is updated. Would it be possible to have different cp2_content associated with different LCENV based on the katello_repository in use for that LCENV?
* add this to the "upcoming" RFC
* Structured upload PR: https://github.com/Katello/katello/pull/10639
* community RFC: quba42 has not yet written this.
* Will include instructions how to test.
* next pulp_deb release will be called 3.0
* big db-migration incoming
* may take A Long Time to run the migration - needs to be in the CHANGELOG
* prob need a blog-post...somewhere?
* maybe start with ATIX blog
* can this be included in katello/4.10 timeframe?
* AI: [ggainey] bring to iballou's attention
### Action Items:
* AI: [ggainey] nag iballou RE [katello RFE](https://community.theforeman.org/t/auto-select-errata-which-is-solved-by-installing-another-erratum/31615), pulp_deb/3.0 migration issue [DONE]
* AI: [quba42] ask ewoud about theforeman-reviewers for PR
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-06-06 1000-1030 GMT-5
### Attendees: hstct, sjha, quba42, iballou
### Regrets: ggainey
### Agenda:
* iballou to host due to ggainey out for an appt
* Thanks Ian!
* Previous AIs:
* AI: [ggainey] is there a list of core-releases we backport stuff to?
* eg, "what releases does katello depend on"
* https://docs.pulpproject.org/pulpcore/release_process.html#active-branches-as-of-2023-05-16
* docs get out of date - CI testing is canonical
* https://github.com/pulp/pulpcore/blob/main/template_config.yml#L21
* Transitioning Katello to "structured APT"
* Existing PR: https://github.com/Katello/katello/pull/10420
* Can only really be merged once the whole feature is ready...
* Needs to be introduced step by step using settings
* Need to go into some background...
* Our internal test branch uses the following in `/etc/foreman/plugins/katello.yml`:
```
:deb:
:use_structured_content_for_clients: true
:publish_simple_content: false
```
* AI: quba42 to open a Foreman tracker and write a community RFC
### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-05-02 1000-1030 GMT-5
### Attendees: hstct, sjha, quba42, ggainey, iballou
### Regrets:
### Agenda:
* Previous AIs:
* core/3.24 releasing TODAY
* core/3.25 #soon - mid/end of May?
* https://github.com/pulp/pulpcore/milestone/8
* django-4.2
* psycopg3
* any deprecation warnings? fix em now!
* next breaking-release: core/3.40
* see https://hackmd.io/XfI9DxymSAu6UJnblh7prQ#March-7-2023 for discussion
* discussion
* packaging?
* where do plugins look to find dperecation-warnings?
* quba42 to ask in OpenFloor
* AI: [ggainey] is there a list of core-releases we backport stuff to?
* write this down somewhere
* eg, "what releases does katello depend on"
* pulp_deb release: https://discourse.pulpproject.org/t/pulp-deb-2-20-2-has-been-released/833
* bindings change implied?
* makes katello-packaging harder
* serializer-change - almost certainly yes
* can this be ready for katello/4.9 release?
* should be possible
* quba42 to investigate/do/poke katello if more info needed
* SLES advisory export/import problem
* https://github.com/pulp/pulp_rpm/issues/3127
* https://github.com/pulp/pulp_rpm/pull/3128
* Need to talk to pulp_rpm about this, did not have time to address it here.
* Working with the Katello upload implementation:
* https://github.com/Katello/katello/blob/master/app/lib/actions/pulp3/orchestration/repository/upload_content.rb
* Katello is open to using the `repository` parameter on content endpoints instead of separately calling the `modify` API after creating the content.
* If the upload workflow needs to change for plugins that implement "create or retireve" logic on the Pulp side, there are two options:
* A flag in the existing workflow (if the two workflows are not very different)
* A separate workflow that is called for some plugins
* The goal should be to ultimately move all plugins to the new workflow and move "create or retrieve" logic from Katello to Pulp.
### Action Items:
* AI: [ggainey] is there a list of core-releases we backport stuff to?
* write this down somewhere
* eg, "what releases does katello depend on"
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-04-04 1000-1030 GMT-5
### Attendees: quba42, hstct, sjha, ggainey
### Regrets:
### Agenda:
* Previous AIs:
* Possibility of releasing pulp_deb orphan cleanup fix for released versions of Katello?
* See: https://community.theforeman.org/t/katello-4-8-0-rc1-feedback/33039/4
* fix includes a migration
* it's the only "new" migration since release
* should be "safe" in all respects (idempotent, no other possibly-skipped migrations "in the way")
* which version backporting to?
* pulp_deb/2.20.1, for katello/4.7 users
* Any plans to drop Puppet 6 support? If so, with what Foreman/Katello version?
* See also: https://docs.theforeman.org/3.6/Release_Notes/index-katello.html#_puppet_6_is_eol
* Foreman won't "drop" Puppet/6 support "yet"
* further plans - talk to TheForeman gang
* Adding a mix of synced and uploaded content in a single repository
* ATIX opinion:
* It is a best practice to use separate repos for the two use cases. (Especially in the case of deb/APT content)
* Katello should be opinionated about enforcing best practice here.
* Pulp probably does not need to be as opinionated about this as Katello should be.
* Pulp opinion: Pulp **should not/cannot** be opinionated in this area
* See also: https://discourse.pulpproject.org/t/rfc-separating-sync-and-upload-workflows-in-pulp-deb-and-others/787/9
* can we get a discussion opened on theforeman discourse to gather user-feedback?
* At a minimum, can we get the katello UI to give some guidance to keep users from *accidentally* shoot themselves in the foot
### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-03-07 1000-1030 GMT-5
### Attendees: ggainey, iballou, sjha, quba42, hstct
### Regrets:
### Agenda:
* Previous AIs:
* AI: [ggainey] schedule 6 months starting first tues in March
* AI: [ggainey] clean up mtg-doc
* https://hackmd.io/@pulp/pulp-deb-katello-integration_2022
* https://hackmd.io/@pulp/pulp-deb-katello-integration_2021
* pulp_rpm to get rid of dependency solving?! (https://discourse.pulpproject.org/t/katello-pulp3-integration-meeting/37/73)
* "fun" discussion ensues
* no, pulp_rpm isn't dropping depsolve any time soon
* How important a feature is ACS for pulp_deb?
* My gut feeling is that people can live without this feature, and other priorities should take precedence. However, I am wondering if there are potential pitfalls in pulp_deb does not implementing this?
* ACS will allow smart-proxies to sync directly from upstream-deb-repos
* not 'necessary' to implement, totally optional
* some RH users are excited about it, but we don't have any metrics on actual uptake
* S3-storage for pulp-artifacts in katello/foreman-proxy-content? *Out-of-scope*, *on the roadmap*, or *waiting for someone to implement it*?
* https://github.com/pulp/pulpcore/issues/3358
* Pulp implements this
* needs installer-support to turn on the right cfg-options
* katello has related issue
* "switching to S3 broke things" - to be reviewed/fixed
* Notes from Pulp Gang at CfgMgtCamp:
* several community members were asking for RBAC in pulp_deb (Magnus and Alexander?)
* ttereshc will ping Magnus to open an issue so y'all can talk directly
* https://github.com/pulp/pulp_deb/issues/392
* ATIX met w/ ddavis' team
* may invite their team to this mtg?
* not as interested in pulp_deb/katello integration
* What version of katello is ATIX using?
* 4.1 katello, branch using 4.3
* sync up katello/foreman versions? - not currently
* fun with LEAPP is happening at ATIX
* be aware of the postgres-reindex-issue!
* https://bugzilla.redhat.com/show_bug.cgi?id=2161929
* https://community.theforeman.org/t/possible-to-use-leapp-for-oracle-7-oracle-8-migration/32273/34
* Q: is ATIX working on new-host-details page?
* prob become important post-EL7-to-EL8 upgrade/katello-4.3
* Discussion around pulpcore-version-release-process upcoming changes
* will be discussed in/on/discourse/matrix
### Action Items:
* AI: ggainey to look at "can one decide to move content to a diff backend storage"
* not yet - https://github.com/pulp/pulpcore/issues/3358
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
## 2023-01-10 1000-1030 GMT-5
### Attendees: ggainey, iballou, sjha, quba42, hstct
### Regrets:
### Agenda:
* Previous AIs:
* AI: [iballou] to look at SCA-thread, add debugging commentary if/as useful
* Resulted in https://projects.theforeman.org/issues/35713
* AI: [ATIX] to start a thread on import/export with "katello" tag, maybe ping iballou/sjha/paji in #foreman-dev
* https://community.theforeman.org/t/support-importing-content-views-with-deb-content-with-hammer-content-import/31178
* AI: [ATIX] someone at ATIX will poke at issue [#35362](https://projects.theforeman.org/issues/35362)
* We believe it is fixed with [these pulp_deb bugfix releases](https://discourse.pulpproject.org/t/pulp-deb-2-20-1-2-19-3-2-18-3-have-been-released/716)
* Requires this packaging PR: https://github.com/theforeman/pulpcore-packaging/pull/603
* New Items
* What is the deprecation timeline for the old host details page (what Foreman version switches by default, what version drops the old one completely?)
* Thinking about https://projects.theforeman.org/issues/35713
* discussion has happened, we think we know the answer
* When will "legacy" page get totally removed?
* not before katello/4.8, most likely katello/4.9
* katello/4.5 allows choosing which you want
* katello/4.7 makes new-page The Default
* katello will add a "debian" tag to the content-page (see #35713 above)
* Does somebody remember https://github.com/pulp/pulpcore/issues/2250 ?
* Following links eventually led me to https://access.redhat.com/solutions/6977656, but I am still unsure about the full scope/background of the problem.
* Is there a pulpcore version, that completely solves this issue, or is it a case of "performance has improved over time to the point where it is no longer a critical issue"?
* we think we're happy w/ the kbase described above
* lots of performance/memory fixes going into pulpcore - stay up to date(er)?
* What else is needed to make [this](https://github.com/pulp/pulpcore/pull/3038) work for Katello 4.3.1/pulpcore 3.16.12?
* may actually be working for ATIX - needs new-year-neurons to look at it
* How should this meeting proceed in 2023?
* nag paji as needed
* 1st Tues works
* Feb is to be skipped - cfgmgt camp and lots of year-startup happening
* AI: [ggainey] schedule 6 months starting first tues in March
* Proposal: Archive 2021/2022 minutes into a separate doc
* no major objection
* AI: [ggainey] clean up mtg-doc
### Action Items:
* AI: [ggainey] schedule 6 months starting first tues in March
* AI: [ggainey] clean up mtg-doc
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
# 2022
* Archived: https://hackmd.io/@pulp/pulp-deb-katello-integration_2022
# 2021
* Archived : https://hackmd.io/@pulp/pulp-deb-katello-integration_2021
###### tags: `Minutes`