# Pulpcore/katello/pulp_deb integration meeting, 2022 archive

## 2022-12-13 1000-1030 GMT-5
### Attendees: ggainey, sjha
### Regrets:
### Agenda:

* meeting called
* will schedule first 2023 meeting for 10-JAN!
* meeting value/format to be evaluated at this mtg

### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-11-02 0900-0930 GMT-5
### Attendees: ggainey, iballou, quba42, mbucher, sjha, hstct
### Regrets:
### Agenda:
* Previous AIs
* pulp_deb 2.20.0 and various bugfix releases have been released since the last meeting.
* gobbled up already by build-team
* pulp_deb optimize sync for Katello: https://github.com/Katello/katello/pull/10258
* will work w/ core/3.21 and katello/4.7
* sjha added to katello board, someone will pick it up
* Community users are reporting possible issues with APT content and Simple content access: https://community.theforeman.org/t/debian-11-host-warning-no-installed-packages-and-or-enabled-repositories-have-been-reported-by-subscription-manager/31014/2
* EDIT: Apparently ATIX has run some basic SCA with Debian content tests which were successfull, so the above may be unrelated to SCA.
* thoughts from katello: can we stick a log-stmt in katello code at profile-import level to see if we're even getting to katello?
* should be a profile-cache on client for sub-mgr that can be looked at as well
* in rails-console: load up host-context, look at bound_repositories?
* AI: [iballou] look at thread, add debugging commentary if/as useful
* Could not connect with Partha Aji regarding import/export deb content with Katello via email/irc. Any other person that can be contacted regarding the same?
* https://github.com/Katello/katello/blob/master/app/models/katello/repository.rb#L34
* https://github.com/pulp/pulp_deb/pull/454
* can we get a discussion started on theforeman discourse?
* AI: [ATIX] to start a thread on above with "katello" tag, maybe ping iballou/sjha/paji in #foreman-dev
* https://projects.theforeman.org/issues/35362
* on katello's board
* may be same issue on pulp_deb tracker?
* AI: [ATIX] someone at ATIX will poke around
* ATIX General Outlook
* mostly "downstream on el8" right now
* would like to reduce the gap between downstream and upstream-katello
* getting reset to katello-dev-env is painful when you're not doing it all the time
* sjha: stable-katello-boxes should help
* node-js-versions can be a problem - update to node14 if so
### Action Items:
* AI: [iballou] to look at SCA-thread, add debugging commentary if/as useful
* AI: [ATIX] to start a thread on import/export with "katello" tag, maybe ping iballou/sjha/paji in #foreman-dev
* AI: [ATIX] someone at ATIX will poke at issue #35362
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-10-04 1000-1030 GMT-5
### Attendees: sjha, iballou, ggainey
### Regrets:
### Agenda:
* No agenda items, meeting called at 10:05! :)
* Previous AIs
* Result from last time: https://github.com/theforeman/puppet-pulpcore/pull/263

### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-09-06 1000-1030 GMT-5
### Attendees: msinghal, quba42, iballou, sjha, ggainey, hstct, mbucher
### Regrets:
### Agenda:
* Previous AIs
* RE pulp_deb and urlencoding content-URLS - quba42 to release pulp_deb w/ the fix
* How does Katello install Pulp? I believe the pulp_installer is just for pip based installs. Could I just install the RPMs and start the services? Is a from RPM Pulp installation (without installing all of Katello) somehow supported? Is it documented somewhere?
* look into https://github.com/theforeman/puppet-pulpcore
* pulp_deb optimize sync will depend on pulpcore >= 3.21.0. Given the latest pulpcore-packaging is 3.18, when can we reasonably expect this to become available for Katello?
* Draft Katello PR: https://github.com/Katello/katello/pull/10258
* katello/4.7 to use core/3.21
* core/3.21 coming "this week"
* hence: katello-artifacts should be available in 3-4 weeks
* HTTPS proxy (again), will this be a "downstream only fix" (for older python versions): https://discourse.pulpproject.org/t/pulpcore-3-21-release-schedule/573/4?u=quba42
* in a word - "yes" :)
* I would like to set `FORCE_IGNORE_MISSING_PACKAGE_INDICES = True` in `/etc/pulp/settings.py` for Katello installations. I imagine this would be some foreman-installer change, but how can I find the right place?
* https://github.com/theforeman/puppet-pulpcore
* https://github.com/theforeman/puppet-pulpcore/blob/master/templates/settings.py.erb
* Import/Export feature doesn't work in Katello but works fine with pulp_deb.
* work directly w/ Partha Aji ([e-mail], partha in matrix in #pulp-dev)
* "regenerate repository metadata" was removed from UI (for all content types) because of problems with pulp_rpm "complete mirror" mode? https://community.theforeman.org/t/katello-4-3-cannot-republish-repository-metadata-or-view-packages-of-a-repository/27045/4?u=quba42
* pulp_deb would like to see it made available for deb-repos
* "Why does RPM 'Win'?"
* Partially a one-off emergency fix
* katello would like to have it back as well
* what katello PR removed this?
* [katello link](https://github.com/Katello/katello/commit/79e606ac3ffcb416c3c03baeca12e083e24bbe84#diff-61d56e6a99080fb276547067d3f4f0fb0f74be652157984f5914a7fb16ae1104)
* great discussion around what "republish" means for other content types
* maybe remove UI IFF "complete mirroring" in use
* Forklift issues.
* what's up w/ katello-devel?
* centos7/8-katello-stable/unstable aren't working (for a variety of reasons)
* see foreman-dev matrix
* hstct: anually reinstall webpack?
* sjha: "bundle exec rails webpack:compile in foreman dir.."
* sjha: immediately upgrade nodejs to 12 on dev-box
* sjha: delete package-lock/node files in foreman/katello and reinstall?
* iballou: stable boxes should "just work"?

### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-08 ~~02~~ -09 1000-1030 GMT-5 (rescheduled due to conflict)
### Attendees: quba42, sjha, iballou, hstct, ggainey
### Regrets:
### Agenda:
* Katello smart-proxy sync and SLES:
* https://projects.theforeman.org/issues/35332
* https://github.com/pulp/pulp_rpm/issues/2691
* quba42 to experiment w/ the committed Pulp fixes, work w/ dalley if there are questions
* The [Katello-Satellite integration meeting](https://discourse.pulpproject.org/t/katello-pulp3-integration-meeting/37/56) appears to have discussed a "satellite backport strategy" in a non-public [Google document](https://docs.google.com/document/d/1bgJq_zL2Bc896SHUD1QxRMHJsm1EVZif4avQj8Q4P6Q/edit). While I am sure this is non-public for sound reasons, I would be interested in anything you feel you can divulge (from this backport strategy), since we are obviously facing the same issue with orcharhino (and have done some experimenting of our own for example with backporting migrations).
* [AI] iballou to make the public parts, public, in a Discourse thread
* pulp_rpm SLES issue fixed in pulp_rpm, [but not packaged for Katello](https://community.theforeman.org/t/content-view-not-synced-to-all-proxies/29593/8?u=quba42) How to request a RPM z-version bump?
* I believe this has since been packaged
* "what gets backported and when does it get packaged" is part of the "backport" discussion, above
* packaging requests can be made on Foreman Dev-discussion Discourse
* Revisit HTTPS proxy discussion under "Previous AIs"
* pulpcore issue https://github.com/pulp/pulpcore/issues/3036
* see discussion in core PR https://github.com/pulp/pulpcore/pull/3038
* see discussion in the original BZ https://bugzilla.redhat.com/show_bug.cgi?id=1993917
* ggainey made as much of it public as we're allowed to
* please contribute to discussion in that PR
* [AI] ggainey to look for any other discussion around this and include here
* https://projects.theforeman.org/issues/35148
* url-encoding bites us Again
* [AI] quba42 - pulp_deb needs releases w/ the fix
* pulp-plugin-branch release into a katello-version can be Exciting
* once pypi release exists, see prev discussion RE packagin team
* client bindings can make things even More Fun (but not in this case)
* Previous AIs
* quba42 to double check about pulp_2to3_migration plugin removal
* It looks like `foreman-maintain content remove-pulp2` removes the RPM package and also cleans up the DB removing every trace of the plugin (even on pulpcore 3.14 before plugin removal was a pulpcore feature).
* quba42 to talk to sjha RE upload-issue
* It looks like these issues are nearing a fix:
* https://github.com/Katello/katello/pull/10190
* https://github.com/Katello/katello/pull/10164 Thanks @ sjha!
* Should this be backported to Katello 4.5? https://community.theforeman.org/t/new-user-seeking-update-advice-with-foreman-debian/29011/7
* iballou to consider requesting from pulp a "can I upload this content to this repo with this name?" standardized API
* https://github.com/pulp/pulpcore/issues/2911
* Is there an update on what Katello version will regain HTTPS proxy support?
* The [satellite bugreport](https://bugzilla.redhat.com/show_bug.cgi?id=1993917) says "Target Milestone: 6.12.0"
* Bottom of [this post](https://discourse.pulpproject.org/t/katello-pulp3-integration-meeting/37/56) looks related as well.
* Releasing katello-host-tools - https://github.com/Katello/katello-host-tools/pull/132
* paji has a question outstanding preventing merge
* Katello community demo: https://community.theforeman.org/t/foreman-community-demo-114/29198
* would be cool to have ATIX demo pulp_deb CV filtering
* [AI] quba42 to talk to msinghal about presenting

### Action Items:
* RE backport/release discussion - iballou to make the public parts, public, in Discourse thread
* RE HTTPS Proxy work - ggainey to look for any other discussion around this and include here [DONE]
* RE pulp_deb and urlencoding content-URLS - quba42 to release pulp_deb w/ the fix
* RE pulp_deb CV filtering - quba42 to talk to msinghal about presenting at katello-community-demo
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-~~07-05~~ 06-28 1000-1030 GMT-4 (rescheduled due to conflict)
### Attendees: ggainey, iballou, quba42, hstct, msinghal
### Regrets:
### Agenda:
* Is there some Katello version that does/will uninstall the 2to3 migration plugin (OR-3254)?
* 2to3 EOLs DEC-2022 (currently)
* downstream does this?
* [ggainey] to report on earliest pulpocore rel;eaase that allows plugin removal
* [core/3.18](https://docs.pulpproject.org/pulpcore/changes.html#id37)
* [iballou] https://github.com/theforeman/foreman_maintain/blob/16ad4954605928da2cd3e15b1c21513cfb224121/definitions/procedures/pulp/remove.rb#L58
* How will "simple content access" impact everything that isn't RHEL?
* enabling SCA causes problems for not-RHEL attached to katello-4.x
* poss due to older katello (<=4.1)
* non-rhel still uses the subscription-machinery (just "unlimited")
* quba42 to talk to Jeremy Lenz ([e-mail], #foreman-dev) for subscription access questions
* ATIX to test internally w/ newer katello than 3.18
* can we leverage the getRepositoryTypes() action to determine if deb is enabled on a box?
* katello tracks all enabled repo-types
* katello tracks "is pulp plugin installed"
* may (or may not) be what getRepositoryTypes() JS references
* it "should" (we think?) be supported
* iballou to check w/ sjha, (someone) will get back msinghal
* Debian package upload update
* GUI issue: https://projects.theforeman.org/issues/35060 (OR-3243)
* Broken when the artifact/content unit already exists
* katello has a content-existence check
* relative-path?
* pulp_deb has a different handling for rel-path
* pulp_deb doesn't let user specify rel-path
* katello checks for filename-provided (which is not pulp_deb-rule-following)
* pulp_deb/katello need to come to an agreement on how to handle
* we def need some tests built into katello to test the upload-API for multiple plugin-types
* prob worth adding to katello-nightly would be great
* having heuristics in multiple codebases for answering the same question makes ggainey Sad
* Debian optimized sync in active development
* hstct working on this
* building on pulp_rpm experience
* katello will want to take advantage once it's available in pulp_deb
* look for skip-metadata-check in Dynflow tasks
* https://github.com/Katello/katello/blob/master/app/controllers/katello/api/v2/repositories_controller.rb#L294
* https://github.com/Katello/katello/blob/b056c7960fe99f709cb225c68cd1a321ec105840/app/lib/actions/katello/repository/sync.rb#L26
* https://github.com/Katello/katello/blob/b056c7960fe99f709cb225c68cd1a321ec105840/app/lib/actions/katello/repository/sync.rb#L37
* Previous AIs
* **DONE** [quba42] AI to pass along "paji would like some manual test steps to see the PR fixing the problem"
* **DONE** [paji] AI to go directly to PR author
### Action Items:
* quba42 to talk to sjha RE upload-issue
* iballou to consider requesting from pulp a "can I upload this content to this repo with this name?" standardized API
* https://github.com/pulp/pulpcore/issues/2911
* ggainey to monitor meeting-length - maybe we want/need to expand to an hour?
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-06-06 1000-1030 GMT-4
### Attendees: ggainey, quba42, mbucher, hstct, iballou, sjha, paji
### Regrets:
### Agenda:
* welcome to Tobias (hstct) from ATIX
* orcharhino 6.0 is out https://orcharhino.com/orcharhino-6-0-0/
* Uses Katello 4.1 with pulpcore 3.14
* Reporting issues back to the community? (We have talked about this before)
* Yes please.
* discussion about when/whether to backport will be ongoing.
* How will the breaking pulpcore 3.20 work?
* release aimed for 14-JUN
* Outlook: Improving pulp_deb sync performance
* What has your experience been: Is performance a pure Pulp topic, or is it as much to do with how Katello uses Pulp?
* almost all in the plugin itself
* Tobias is rewriting tests to use pytest
* ggainey cheers wildly
* talk to dkliban/bmbouters
* debian pkg-upload broken in katello master
* ATIX nag incoming
* one fix made, more probs discovered
* katello removed reviewing deb-filters-PR from sprint
* no recent updates?
* updated 5 days ago - back on katello to review
* https://github.com/Katello/katello/pull/10072
* [paji] needs-restart PR stalled
* https://github.com/Katello/katello-host-tools/pull/124
* needs help to test?
* talk to Bernard?
* [quba42] AI to pass along "paji would like some manual test steps to see the PR fixing the problem"
* [paji] AI to go directly to PR author
### Action Items:
* [quba42] AI to pass along "paji would like some manual test steps to see the PR fixing the problem"
* [paji] AI to go directly to PR author
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-05-03 1000-1030 GMT-4
### Attendees: ggainey, quba42, mbucher, sjha, iballou, paji
### Regrets:
### Agenda:
* Upgrading Katello nightly to pulp_deb 2.18.0 (including clients):
* https://github.com/Katello/katello/pull/10080
* https://github.com/theforeman/foreman-packaging/pull/7836
* https://github.com/theforeman/foreman-packaging/pull/7856
* new API, needs new client, therefore the above PRs
* is anything missing, or are we ready to do the packaging-dance now?
* looks like we're ready, iballou/quba42 to coord
* DB field size migration and backporting woes:
* https://github.com/pulp/pulp_rpm/pull/2503 (closed)
* https://github.com/pulp/pulp_rpm/pull/2510
* ggainey to work w/ dalley to review
* Debian Errata strategy regarding pulp3 & Katello 4.x
* current draft Katello-only implementation reusing Katello::Erratum model
* question1: should we add them to pulp_deb to more resemble yum-errata
* question2: should we distinguish them more in Katello creating DebErratum and YumErratum models
* feels possible to keep this in katello, make the inheritance/implementation hierarchy make more sense
* maybe ATIX discuss internally, bring something more concrete to this meeting #eventually?
* Discussing pulpcore-packaging minor version bump workflows.
* and by packaged, we mean "get RPMs made"
* how can ATIX make this request less ad-hoc?
* current katello approach is similar to current ATIX - open pulp-packaging PR and then ping folk if ignored
* new pulpcore-Y-release takes more work (since requires new directory)

### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-04-05 1000-1030 GMT-4
### Attendees: iballou, quba42, mbucher, sajha, paji, ggainey
### Regrets:
### Agenda:
* State of aiohttp(s) progress? E.g.: https://github.com/theforeman/pulpcore-packaging/pull/379
* "can't use https proxies w/ Pulp w/out aiohttp/3.8+, puthon3.8+"
* [AI] iballou to inquire and let quba42 know, doc here as well
* [iballou] The aiohttp upgrade is in progress according to Foreman packaging folks.
* [quba42] At least part of it appears to have been merged for the pulpcore 3.16 repo:
* https://github.com/theforeman/pulpcore-packaging/pull/421
* https://github.com/theforeman/pulpcore-packaging/pull/422
* katello-host-tools service restarts:
* https://github.com/Katello/katello-host-tools/pull/124
* https://github.com/Katello/katello-host-tools/pull/126
* paji reviewing, discussion in progress w/ jturel
* When is the next breaking changes pulcore release? How is Katello approaching the changed pulpcore deprecation policy?
* core/3.20 is allowed to have breaking changes. 3.19 to be released "really soon now" (today?)
* katello: doesn't want to get stuck on old versions, will pay attention to the proboem if/when/as it happens
* ~~Smart-proxy download policy streamed:~~ https://github.com/Katello/katello/pull/10005
* Merged!
* 2to3 migration issue
* large migration, Pulp3-orphan-cleanup ran in the middle of it (?!?!?)
* is there any way this could happen in a "vanilla katello/3.18" install?
* poss a cfg-issue (katello-installer shouldn't allow this to happen)
* ATIX has targetted customers in mind to test 2to3
* Pulp moving to "releases on backport-branches" to once a week
* ATIX mostly interested in RPM results
### Action Items:
* iballou to inquire into state of aiohttp/python3.8 in katello
* ggainey to add paji to invite
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-03-01 1000-1030 GMT-5
### Attendees: ggainey, jsherrill, bsutter, jlenz, sajha, jturel, iballou, quba42, mbucher
### Regrets:
### Agenda:
* discussion around/about Simple Content Access
* jlenz, jturel
* With SCA, RH clients can access any content
* as opposed to "specific subscription gives access to specific repos"
* is becoming the default/primary way to gain access to RH content
* concerns
* inadvertent importing of SCA-containing access?
* does SCA give access to other OS/thirdparty repos?
* "experience changes" once an SCA-containing-manifest is imported
* hammer-apis have changed, can impact end-user automation
* questions
* how can we "turn it off" for non-RH repos?
* use lifecycle envs/CVs to control?
* use repository-sets?
* use Activation Keys to help?
* proposal
* "use/don't-use" SCA option in katello prior to manifest-import
* make sure katello "owns" the "use/do not use" SCA button (independent from manifest-import)
* jsherrill announcement - Katello Emeritus
* iballou/sajha will be taking over his position
* https://projects.theforeman.org/issues/34432
* Already has an upstream PR associated with it.
* https://community.theforeman.org/t/possible-stray-package-in-pulpcore-3-16-el8-repo/27514
* how do we tell users to do migration in addition to dnf-update?
* always run installer
* what about client-gems?
* there exist tests to make sure API calls/bindings are still valid
* https://community.theforeman.org/t/validation-failed-cannot-add-deb-repositories-to-a-content-view/27524
* jlenz: import-only CVs, for airgapped systems
* sajha: should we be reflecting 'rules' in the UI?
* jturel: error message is...suboptimal. Prob could use a katello issue to resolve
* yum-repo metadata signatures (e.g. SLES-repos): state in pulp3?
* **passive**: verify signatures from synched repos (https://github.com/pulp/pulp_rpm/issues/2285)
* **active**: sign pulp_rpm repo's metadata; still tech-preview (https://docs.pulpproject.org/pulpcore/workflows/signed-metadata.html)
* hit us up in #pulp-dev and ask
* Does import/export require plugin specific code (at the pulp level)? What about the Katello level?
* yes - see https://hackmd.io/HLptudH9R6S4PCmm8nRmmg#Plugin-API-for-pulpcore-to-call and https://github.com/pulp/pulp_rpm/blob/main/pulp_rpm/app/modelresource.py
* for katello, one liner: https://github.com/Katello/katello/blob/master/app/models/katello/repository.rb#L34

### Action Items:
* jturel to get together w/ quba42/bsuttner to gather/document SCA-related concerns, report back here next month
* jturel to comment on 27524 and open redmine for error msg
* ggainey to add sajha and jlenz to meeting invite
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-02-01 1000-1030 GMT-5
### Attendees: mbucher, quba42, jsherrill, ian
### Regrets: ggainey
### Agenda:
* "verbatim" deb content smart proxy sync: https://github.com/Katello/katello/pull/9891
* PR under review
* Any news on `on_demand`/`streamed` download policy for smart proxy syncs? (What Katello version is this planned for?)
* download policy already exists for capsule syncs
* we don't support streamed yet though, should be easy to add
* Is it possible to have Katello run different smart proxy sync options depending on whether it is a Pulp 2 or Pulp 3 based smart proxy?
* adjust the lists here: https://github.com/Katello/katello/blob/master/app/services/katello/pulp/repository/deb.rb
* What is the Katello Agent deprecation timeline (in Katello versions)?
* rex pull provider needs to be in place for ~2 releases before katello-agent will be removed. The earliest it would be dropped is ~4.6

### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39

## 2022-01-04 1000-1030 GMT-5
### Attendees: ggainey, jsherrill, quba42
### Regrets:
### Agenda:
* A failed Katello upgrade rake task does not appear to cause a failed foreman-installer run. Is this intentional or a bug?
* there is a skipfailure=True
* make sure it's not set to true for the new task
* Why do the packages for the 3.15 and 3.16 versions of the https://yum.theforeman.org/pulpcore/ repo have a `tfm-pulpcore-` prefix relative to prior versions of the same repo?
* to avoid conflicts w/ SCL (which we're using python-3.8 now which isn't in EL7 base)
* do the new packages use 'obsoletes' correctly?
* we believe yes
* Backport candidate: https://community.theforeman.org/t/debian-repo-sync-end-with-the-error-this-field-may-not-be-blank/26603/10
* easily backportable
* to what extent do 'we' (ie, ATIX) want to support backports?
* 3.14 is katello/4.1 and /4.2, 3.16 is katello/4.3
* ATIX has discovered need to build ruby-client-gems on feature branches
* upstream-katello always uses pypi-released bindings
* discussion opened in pulp-discourse
### Action Items:
* ggainey to add minutes to https://discourse.pulpproject.org/t/katello-pulp-community-integration-meeting-minutes/39
###### tags: `Minutes`