# COMMON collect-log / tempest mtg ###### tags: `Meeting` ## Update... ansible-role-collect-logs is going to ship :) https://bugzilla.redhat.com/show_bug.cgi?id=1901845 https://bugzilla.redhat.com/show_bug.cgi?id=1899476 Attendees: wes, ## collect logs status 4/23/2020 @B_hkIsryS2Sxpv62Mkw57Q Today I've switched Infrared Nightly jobs to use new ansible-role-collect-logs based ir_collect_logs stage. Will do same also all RelDel phase1/2 jobs. This should be in the next days rolled out to ALL jobs, based on if any issues appear in nightly jobs. == Known issues === There are still few known issues / missing logs (Martin pls correct me where needed): - not all of /var/log/extra is collected -- ongoing work porting missing parts - resurrect_hosts feature not available -- this will need to be figured out yet where it belongs - logs are atm collected as individually gzipped files -- needs more space, in CI we may add re-compression on storage server --- on laptopts or otherwise special envs one may need to keep eye on this - if any host from topology is unavailable (e.g. controller/compute etc due to tripleo deployment error), ansible-role-collect-logs has exit code 1, so in jenkins stage we cannot distinguish between error/bug in ansible-role-collect-logs itself and failed tripleo/test run so if you see log-collection stage failing, check if there was failure in previous stage (e.g. OC provision/deploy) == No more archiveArtifacts == About removal of archiveArtifacts from our jobs (not collecting artifacts on jenkins itself): - some log files will stay on master, generally all small console logs (esp. pip/ir-setup/... ones, since if those fail no log collection neither publishing works) - main publish/collect_logs stage is switched to only publish to storage server - but there is >200 references to archiveArtifacts in individual dfg jobs and such -- those will be rewritten in few batches -- focus will be esp on any which collect big or lot of files - this is done by s/archiveArtifacts/addToArtifacts/ which instead of archiving registers the file paths/patterns to be later in collect_logs stage published using ansible-role-collect-logs too -- it does not support Ant style patterns, only shell glob patterns with 'globstar' enabled so mostly is compatible (e.g. **/something works) but not same special may need updating ### to-do's from jira * RHOSINFRA-3163 Ansible-role-collect-logs is missing Build marks for OSP CI Task IN PROGRESS Pavel Sedlak * RHOSINFRA-3170 Update core rights on openstack/ansible-role-collect-logs Task NEW Wesley Hayutin * RHOSINFRA-3199 Collection commands, part 2 Task IN PROGRESS Martin Kopec * RHOSINFRA-3201 Speed and disk space comparison of common-logging Task NEW Martin Kopec * RHOSINFRA-3204 console.log from jenkins as produced by common-logging is not complete Bug NEW Amnon Maimon * RHOSINFRA-3205 common-logging ansible fails if any host is not reachable Bug NEW Amnon Maimon * RHOSINFRA-3212 Identify long output generated commands Task NEW Martin Kopec ## Common Tempest Design * https://hackmd.io/LOk-8PzQQ1Wu5PwgKlBw3w