owned this note
owned this note
Published
Linked with GitHub
# Bookmarks
- [Brainstorm Roadmap](https://hackmd.io/@pbrochad/SyisQfcUp): A place to put docs ideas for the future.
- [Pulp Unified Docs 1: The great migration](https://hackmd.io/@pbrochad/SyfGeQc86) - (see also the [Migration Epic](https://github.com/pulp/pulpcore/issues/5037))
- [Pulp Unified Docs 2: Tidying things up](https://hackmd.io/OORLGS8QT9ir6KnteSuYnw)
---
# Agenda
---
# June 05, 2024
- state of things:
- most "essential" stuff done
- https://github.com/pulp/pulp-docs/issues/30
- changelog, odering-mechanism/link-stabiltiy, PRs CI, and misc improvements
- rest api docs:
- mkdocs plugin for swagger-ui works but anchor linking doesnt work. Thats bad
- tried finding javascript redhatter for fix that (slack), but no success
- alternative: try at least unifying the rest api in only one "external page"
- https://redocly.com/blog/api-discovery/#sidebar-navigation
- "must-have" remaining is **publish the docs** and **deactivate-redirect old docs**
- we can see what "nice-to-have" we should prioritize this month
- discussions:
- publish to pulproject.org process
- talk to infra people
- redirect old docs
- keep pulp2
- keep versioned docs if its easy enough
- dont delete old files from the webserver, archive them somewhere public
- content improvement is tomorrows problem, we are good for now
- possibly close the working group and celebrate our accomplishments so a new one can be formed with a new problem statement
- AI:
- create discourse post to ask people what pages (urls) from pulproject.org they think are valuable
- get and archive old docs on a repository
- ask infra people to change publishing in 2/3 weeks and do redirects
- review remaining CI update (changelog) PRs:
- https://github.com/pulp/pulp_maven/pulls
- https://github.com/pulp/pulp_container/pulls
- https://github.com/pulp/pulp_ostree/pulls
# March 13, 2024
- Topic: Entirely replace pulpproject.org website? Yes
- Draft Q1 plan:
Q1
Increase the adoption of Pulp upstream by improving the documentation for new and existing users.
- Create a unified documentation site
- Make contributing to the documentation easier
- Systematically structure the documentation content
Q2 - Proposal
Increase the adoption of Pulp upstream by improving the documentation for new and existing users.
- Make the staging-docs stable and production ready
- Content improvement and de-duplication
- Setup doc-CI and improve current publish workflow
Detailed Q2 discussions:
- Make the staging-docs stable and production ready
- integrate changelog links
- See https://staging-docs.pulpproject.org/pulp-docs/docs/sections/user/
- changelog needs to be generated to .md not .rst
- integrate REST API links
- See https://staging-docs.pulpproject.org/pulp-docs/docs/sections/user/
- maybe add pointer at the top of each plugin section?
- version needs to be filled in
- fix ordering mechanism problem (no renaming files)
- move pulp-docs to pulp organization
- Content improvement and de-duplication
- fill in the "voids" in our pulpcore staging-docs (eg, "Getting Started")
- start migrating content from pulpproject.org into the staging-docs hierarchy
- poss use this content to fill the holes above
- Ultimately - replace current pulpproject.org with the output of staging-docs efforts
- Add base CI and automation infrastructure for auto-build/test/publish of new-docs-location
- doc-only changes should run *only* docs-CI (ie, not full code test suites)
- setup the docs-CI (e.g, test builds)
- pipeline needs to account for "plugin Foo releases, docs-site rebuilds"
# February 02, 2024
Agenda
- Review the work from the last 2 weeks
- Plan the "Intro Tutorial"
- Topic: Move `pulp-docs` to pulp organization?
Notes
- let's start defining a style-guide (ie, workflow-titles are "VERB a NOUN" format)
- ggainey doing initial work/experimentation on pulp_rpm
- dkliban would like "someone else" to get familiar with the pulpdocs tooling and start picking up some support
- ggainey tentative "yes", pending flattening current COPR/Satellite work
- proposal:
- ggainey/dkliban/pbrochado meet next week to get ggainey up to speed
- record and post to youtube
- write up a detailed "how to" to discourse
- host "office hours" of docs-team, to help plugin teams get moving
- in discourse/team-mtg, announce "ready for plugins to start the work"
- announce short twice-wk "office hours" (30 min?)
- one observation: convert the content **as is** and merge
- DO NOT UPDATE THE DOCS, until after the conversion is DONE
- once tmp_docs is EMPTY AND MERGED, **then** you can start editing to correct content
- second observation: diagrams
- what's a better way to handle them?
- mermaid?
- use web-service?
- THINK about this - but let's not DO any thing about it, until CONVERSIONS ARE DONE
- demo: "edit button" takes you (or will take you) directly to the markdown-doc that you want to change, and will open a PR against the right place!!
- discussion RE current TOC
- "Getting Started" - for core, we need an overview page?
- is "Overview" the overture? or is it the ad/preview of the concert?
- it should be "How to use this documentation"
- "tutorial"'s goal, is "do these steps, and at the end, you will have a working repository"
Action Items
- dkliban to set up ofc-hours sched for Q1
- pedro move pulp-docs to pulp org
# January 19, 2024
Agenda
- Last week feedback
- Content-Type design: should we separate content between Admin/User? Some thoughts
1. will it be confusing for a contributor to decide between Admin and User? No
2. is it correct to assume that:
- *Plugins* are usually targeted at *User*? No, they have admin content too
- *Others* are usually targeted at *Admins*? Probably, but not necessarily
- Frontpage:
- It shouldn't be too busy and present the most relevant paths/links
- It's good that we don't have to scroll too much
- New Top navigation experiment:
Home | Getting Started | Usage | Administration | Reference | Development | Help
Action Items:
- [dennis+pedro] Work on pulp-gem togheter
- [dennis+pedro] Work on pulpcore (common material) togheter
- [pedro] re-structure main navigation
# January 12, 2024
Agenda
- **Initial feature definitions**: we should define standard ways of doing some fundamental things within markdown, so we avoid re-work in the future. I've started defining those [here](https://hackmd.io/eE3kG8qhT9eohRYbtooNww?both#Markdown-specifics). Some needs some special discussion:
- *absolute vs relative* links
- *file includes*
- *tabs for http/cli methods*
- Notes
- style-guide enforcement should be enforced/enforceable by CI/scripting
- WG prefers custom-absolute-links vs relative-links
- WG prefers no-include-files
- makes things MUCH easier for contributors
- how to write examples
- CLI/API/bindings are all possibilities
- API examples are confusing/hard-to-write
- "just use pulp-cli -vvv to see examples"
- if there's a gap in the CLI - let's use a bindings-example? instead of API?
- OR - if there's a gap - we don't have an example, until there is CLI coverage
- just link to REST API and have discussion
- CONCLUSION: use CLI (only) for examples, point to REST API for anything not covered
- pulp-docs update
- basic functionality is working
- time for more people to start playing with it!
- currently only works for pulpcore
- "where is this group going?"
- have one example of how a non-core repo now looks
- then farm out to the mini-team repos, with a proposed deadline
- first non-core repo should be "small", but "high-value"
- pulp-oci-images?
- also want a plugin repo
- pulp-gem? pulp-maven?
Action Items
- ggainey|dkliban: use pulp-docs
- dkliban: prepare pulp-oci-images as the pulp-docs example repo
- pedro:
- post style-guide link on discourse (style guide and migration workflow)
- make sure plugins/extensions in style docs work
# January 05, 2024
Topics
- [all] review design docs (and share)
- [pedro] briefly present `pulp-docs`
- Goals for docs building
- requires no setup
- let devs with existing checkouts have their checkouts be used
- lets non-devs easily contribute
- runs linting on all the docs being built
- ideas for improving pulp-docs
- instead of cloning everything to /tmp, check if ../ for the repository and only clone to /tmp if it's not there. Use existing repos when building the docs.
- if all repos are cloned to /tmp emit a message saying that a read only version of the repositories is being used
- if the branch in the existing repository does not match the configuration file, a message about this inconsistency should be emitted. inconsistent being either mismatching branch or mismatching REF
# December 15, 2023
- [pedro] put together a demo of top and left navigation
- https://pedro-psb.github.io/the-docs-demo/
- questions
- can diff repo provide sections to be included (eg into "Fundamentals")? - yes
- do the repos have any way to decide order?
- would be good to be able to "auto-fetch" from repos based on "known locations"
- need a dir-tree of these known-locations
- what content-type should be used in Quickstart?
- pulp_file?
- we can point to fixtures
- BUT - doesn't give end-to-end (ie consumption by a client)
- use "highest use/value" - ie, pulp_rpm?
- OR - plugin we'd like to see most growth in?
- let's use pulp_rpm
- and go all the way through to "dnf install foo"
- User Guides
- provide templates for these
- do we need pulpcore guides?
- two personas, "Pulp Instance Admin" and "Pulp User"
- User Guide should be for the latter, only
- "I just want to create sync and publish repositorioes"
- Admin Guide section
- "I need to get this instance configured and keep it running"
- Maybe Guides\UserGuides\(per-content-type),AdminGuides\blahblahblah
- bring REST API "inside" these docs?
- might want to use a diff docs-gen-tool?
- let's experiment
- "plugins aren't 'real' unless you're in the all-in-one" - generate All The Docs from all-in-one?
- REST useability issue with "{foo-href}" in current REST docs
- there is a fix for this
- can we get this into the plugin template, like, "next week"
- Can we have "edit me" buttons, on the doc site, to make it Really Easy to submit docs-PRs
- GOAL: make doc-contribution as easy as humanly possible
- GOAL: one can set up documentation hub **without** needing a fully-running dev-env
- DO NOT need a live-server just for "building the docs site"
- Reducing friction: introduce githook to lint at PR-time?
- can we bug ddavis' initial experimentation?
- REMINDER: let's stay at the Big Picture/Organizational Level
- once we have Something, we can start on continual improvement
- REMINDER: this group's goal, is to lower the friction OF DOC CONTRIBUTION
- there's a larger issue, to lower contribution-friction generally
- but for THIS WG, stay focused
- One "Contribution" section - yes please
- do we separate "Docs Contributing" and "Developer Guide/Contribution"?
- GOAL: structure around Personas
- User
- Admin
- Developer
- can we get an order-of-implementation publicized
- want to start getting buy-in from the mini-teams
- section-templates
- https://hackmd.io/V7vHsqM6S0-Het87CjaOAw
Action items:
- [dkliban + bmbouter] update the issue https://github.com/pulp/pulpcore/issues/4850
- [pedro] explore mkdocs multirepo prototyping
# December 8, 2023
- we should include docs on how to generate your own bindings
- mkdocs or docusaurus?
- We will start with mkdocs
- How do we bring all the documentation together?
- https://github.com/jdoiro3/mkdocs-multirepo-plugin
- This group needs to come up with a a guide for contributing the docs.
- We should put together a list of all 'deliverables'.
- Contribution
- Installation
- content repos
* pulp_rpm
* pulp_ansible
* pulp_maven
* pulp_certguard
* pulp_deb
* pulp_python
* pulp_ostree
* pulp_npm
* pulp_gem
* pulp_container
* pulp_file
- other repos
* pulpcore
* pulp-operator
* oci-env
* pulp-cli
* k8s-resources
* squeezer
* pulp-openapi-generator
* pulp-oci-images
* pulpcore-selinux
Actions items:
- [dkliban + bmbouter] update the issue https://github.com/pulp/pulpcore/issues/4850
- [pedro] put together a demo of top and left navigation
# December 1, 2023
## Action items
* ~~- [dkliban] get new website set up~~
* ~~- [pedro] post the goals and plan on discourse along with a write up "why are we doing it this way?"~~
* ~~[decko] A way to build markdown from rst https://github.com/pulp/pulp_maven/pull/182~~
## Some questions
- What documentation format do we want to use?
- Markdown (switching from ReStructured Text)
- docs goals
- have everything including general, plugin, developer docs all in one place (organized but one site)
- no longer versioning the site
- add "introduced in" and "legacy" identifiers
- the plan
- the existing documentation sites will be left 100% as is
- same builder, same RST, same domain name sites, etc
- a new docs site created
- built with a new GH runner that publishes to a new domain, that knows how to pull from multiple repos
- write a how-docs-are-organized doc
- each repo with have a new directory created to contain the new markdown docs, organized according to "how organized" doc
- populate new-docs w/ MD conversion/rewrite of existing docs
- all new docs activity (from the working group) will focus on the new site
- not going to have a "versioned" doc-site
- have a static docs-gen per-repo for each version/release?
- it's .md, and lives in the individual repos - just go to the branch and read it
-----
- reasoning
-
- how do we get there?
- focus areas
- onboarding experience/day-0/install-setup needs Work
- "best practices" workflows
- pulp-administration workflows (e.g., backup/restore)
- framework for effective contributor-contribution
- task-oriented guide for "how to write pulp docs"
- https://diataxis.fr/needs/#characteristics-of-documentation
- https://mystmd.org/
- https://pypi.org/project/sphinx-markdown-builder/
- Where each plugin documentation should live?
- monorepo docs - more hard for each team to maintain, easier to build
- multi-repo docs - more easy for each team to maintain, more hard to build
- How to handle multiple versions for each plugin? (single site docs)
- use “introduced in v1.2.3” and legacy section for relevant stuff
- two builds:
- aggregation build on the main doc-site (build/versioned on pulp-core releases, because it’s frequent)
- stand-alone for archiving purposes (like published with github pages for each plugin, most reliable if someone is looking for a specific old-release thing).
- How can the migration happen?
- gradual-migration:
- each plugin migrates to a stand-alone version (complying with the unified doc stack)
- pulpcore (assuming it hosts the main “doc”) migrates last with the aggregation step.
- instant-migration
- each plugin creates an alternative offline doc version but keeps the old one running
- synced up deprecation of old docs and activation of new
- How to handle redirect from old pages?
…
- What doc building technology should we use?
- mkdocs - good plugin ecosystem and uses markdown (used in CLI, operator)
- static content to upload
- does this support templates/boilerplates to be reused in plugins?
- docusaurus (md/js) - really like UI, uses markdown but JS
- uses React
- overkill "for now"
- sphinx - rst (used everywhere else)
- Used to be the standard in Python world
- https://pypi.org/project/sphinx-markdown-builder/
…
- [decko] Should we have a diagnosys of the actual state of the documentation?
- Obeys a standart?
- Exposes what is the Pulp project?
- Have API usage examples?
- ...
- notes
- ggainey : what is the focus for this specific docs-effort?
- pedro: prepped a presentation
- [Discourse thread](https://discourse.pulpproject.org/t/pulp-documentation-working-group-forming/1040/3)
- let's be explicit: implied goal of this group is "move to markdown"
- build technology is a second discussion/goal
- reduce the number of clicks a user needs to make, to get from (say) a container-registry page to "pulp is installed"
- this is prob a "later" goal - let's get our pulpproj.org house in order first
- maybe `pandoc` to automatically convert rst to md.
- a gh action would be amazing
- sphinx to build rst and md at the same time
- https://pypi.org/project/sphinx-markdown-builder/
# November 17, 2023
- dkliban will setup newdocs.pulpproject.org and have pulpcore repository start publishing there.