# Pulp 2to3 Migration meeting

## Priorities

#### ~~By early March the very latest (prioritized, highest at the top)~~ Resolved
* [bmbouter?] Worker has gone missing during migration
* https://pulp.plan.io/issues/7847
* Ensure a migration can be interrupted within reasonable time at *any* stage
* https://pulp.plan.io/issues/7778
* test if this problem exists, the promise is to be able to cancel pulp tasks within few mins.
* [waiting on the fips box] Ensure migration plugin runs in FIPS mode and respects the ALLOWED_CONTENT_CHECKSUMS configuraiton
* https://pulp.plan.io/issues/7782
* If orphaned content is removed in pulp 2 between migration re-runs, FileNotFoundError is raised
* https://pulp.plan.io/issues/7887

#### ~~In progress~~ Resolved
* [pulpcore] NoneType' object has no attribute 'pk'
* https://pulp.plan.io/issues/7876
* [BLOCKS DOGFOOD TESTING] Migration fails with ForeignKeyViolation: insert or update on table "pulp_2to3_migration_pulp2erratum" violates foreign key constraint "pulp_2to3_migration
* https://pulp.plan.io/issues/8166
* [BLOCKS DOGFOOD TESTING] As a user, a migration re-run is very fast, if there were no or very little changes in pulp 2
* https://pulp.plan.io/issues/7779
* Handle migration when same distributor is being re-used for different repositories in between the plans
* https://pulp.plan.io/issues/7889

#### Resolved

* ~~[Distribution tree issue] "'NoneType' object is not subscriptable" error during migration~~
* ~~https://pulp.plan.io/issues/8084~~
* ~~don't generate sqlite db files for yum metadata if pulp2 exporter didn't use generate them~~
* ~~https://pulp.plan.io/issues/7851~~
* ~~null value in column "stream" violates not-null constraint during migration on Katello~~
* ~~https://pulp.plan.io/issues/7846~~
* ~~ValueError: No declared artifact with relative path "images/boot.iso" for content "<Content (pulp_type=rpm.distribution_tree) ...~~
* ~~https://pulp.plan.io/issues/7681~~

## Agenda template

### date, 2020

Open PRs
* https://github.com/pulp/pulp-2to3-migration/pulls

Un-triaged bugs
* https://pulp.plan.io/projects/migration/issues?query_id=159

## Meeting notes

### November 3, 2020

* Current priorities. Pick from the top 4.
* [in progress] start migration from scratch https://pulp.plan.io/issues/7714
* skip the corrupted content https://pulp.plan.io/issues/7538
* pre-migrate content from mongo ordered by date (in case something fails, so re-run can pick it up from the right place) https://pulp.plan.io/issues/7781
* check indices in pulp 2 for last_updated. If they are absent, we might need another pulp 2 release
* ensure a migration task can be cancelled at any point https://pulp.plan.io/issues/7778
* what to do with long running db queries
* re-run needs to be very fast https://pulp.plan.io/issues/7779
* special handling of no changes or very little changes in pulp 2
* process simple plan as a complex one https://pulp.plan.io/issues/6516
* needed for Pulp community
* fips https://pulp.plan.io/issues/7782
* likely blocked on fips for plugins

* Meetings with customers
* US - Dennis, (Daniel - backup)
* EMEA - Tanya, (Ina - backup)

* Tests
* Depending on how quickly we'll be able to address the items above, we might have time to get to the test backlog.

Open PRs
* https://github.com/pulp/pulp-2to3-migration/pulls

Un-triaged bugs
* https://pulp.plan.io/projects/migration/issues?query_id=159

### October 12, 2020
* running migration on the same machine as pulp 2 production
* control of resources, how fast migration goes
* cgroups?
* one of concerns - shared postgres instance
* control with the number of pulp3 workers?

* 3-month planning
* skip corrupted pulp 2 content (katello) https://pulp.plan.io/issues/7538 on the sprint already
* FIPS https://pulp.plan.io/issues/7536
* optimization not to create child tasks when not necessary https://pulp.plan.io/issues/7009
Improve re-migration time
* speed up no-op re-migration
* speed up few-changes re-migration

Open PRs
* https://github.com/pulp/pulp-2to3-migration/pulls

Un-triaged bugs
* https://pulp.plan.io/projects/migration/issues?query_id=159

### August 27, 2020

* Travis failures
* installing pulpcore and pulp-2to3-migration outside of a container
* func tests depends on configs from ^ and on pulp2 connection initialization
* Getting Pulp 2 repos in tests
* use constants
* Use cases
* on ttereshc todo list
* Current priority items
* Sync after migrating file content throws error https://pulp.plan.io/issues/7264
* Hard links not being used during RPM content type migration https://pulp.plan.io/issues/7244

* 3-month planning
* Current (Jul-Sep)
* Minor features (~~SLES support~~, simple-to-complex migration plan (0.25 FTE/week))
* Known bugs, ongoing
* Tests, in progress
* Sep-Nov
* adjust to pulp_container 2.0 changes (0.25 FTE/week)
* performance testing/work for pulp_file and pulp_container part (1 FTE/week)
* tests (2 FTE/week)

Open PRs
* https://github.com/pulp/pulp-2to3-migration/pulls

Un-triaged bugs
* https://pulp.plan.io/projects/migration/issues?query_id=159