---
# System prepended metadata

title: COMMON collect-log / tempest mtg
tags: [Meeting]

---

# COMMON collect-log / tempest mtg
###### tags: `Meeting`

## Update... ansible-role-collect-logs is going to ship :)
https://bugzilla.redhat.com/show_bug.cgi?id=1901845
https://bugzilla.redhat.com/show_bug.cgi?id=1899476


Attendees: wes,

## collect logs status 4/23/2020
@B_hkIsryS2Sxpv62Mkw57Q 
Today I've switched Infrared Nightly jobs to use new
ansible-role-collect-logs based ir_collect_logs stage.
Will do same also all RelDel phase1/2 jobs.

This should be in the next days rolled out to ALL jobs,
based on if any issues appear in nightly jobs.

== Known issues ===
There are still few known issues / missing logs (Martin pls correct me where needed):
- not all of /var/log/extra is collected
-- ongoing work porting missing parts
- resurrect_hosts feature not available
-- this will need to be figured out yet where it belongs
- logs are atm collected as individually gzipped files
-- needs more space, in CI we may add re-compression on storage server
--- on laptopts or otherwise special envs one may need to keep eye on this
- if any host from topology is unavailable (e.g. controller/compute etc due to tripleo deployment error),
  ansible-role-collect-logs has exit code 1, so in jenkins stage we cannot distinguish
  between error/bug in ansible-role-collect-logs itself and failed tripleo/test run
  so if you see log-collection stage failing,
  check if there was failure in previous stage (e.g. OC provision/deploy)


== No more archiveArtifacts ==
About removal of archiveArtifacts from our jobs (not collecting artifacts on jenkins itself):
- some log files will stay on master, generally all small console logs
  (esp. pip/ir-setup/... ones, since if those fail no log collection neither publishing works)
- main publish/collect_logs stage is switched to only publish to storage server
- but there is >200 references to archiveArtifacts in individual dfg jobs and such
-- those will be rewritten in few batches
-- focus will be esp on any which collect big or lot of files
- this is done by s/archiveArtifacts/addToArtifacts/ which instead of archiving
  registers the file paths/patterns to be later in collect_logs stage
  published using ansible-role-collect-logs too
-- it does not support Ant style patterns, only shell glob patterns with 'globstar' enabled
   so mostly is compatible (e.g. **/something works) but not same special may need updating

### to-do's from jira
* RHOSINFRA-3163	Ansible-role-collect-logs is missing Build marks for OSP CI	Task	IN PROGRESS	Pavel Sedlak
    	

* RHOSINFRA-3170	Update core rights on openstack/ansible-role-collect-logs	Task	NEW	Wesley Hayutin	

* RHOSINFRA-3199	Collection commands, part 2	Task	IN PROGRESS	Martin Kopec	

* RHOSINFRA-3201	Speed and disk space comparison of common-logging	Task	NEW	Martin Kopec	

* RHOSINFRA-3204	console.log from jenkins as produced by common-logging is not complete	Bug	NEW	Amnon Maimon	

* RHOSINFRA-3205	common-logging ansible fails if any host is not reachable	Bug	NEW	Amnon Maimon	

* RHOSINFRA-3212	Identify long output generated commands	Task	NEW	Martin Kopec

   
## Common Tempest Design
* https://hackmd.io/LOk-8PzQQ1Wu5PwgKlBw3w

