2026-04-07 06:25:00.442803 | Job console starting
2026-04-07 06:25:00.453002 | Updating git repos
2026-04-07 06:25:00.508327 | Cloning repos into workspace
2026-04-07 06:25:00.572617 | Restoring repo states
2026-04-07 06:25:00.595013 | Merging changes
2026-04-07 06:25:01.384817 | Checking out repos
2026-04-07 06:25:01.473700 | Preparing playbooks
2026-04-07 06:25:03.472979 | Running Ansible setup
2026-04-07 06:25:06.552725 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-07 06:25:07.089822 | 
2026-04-07 06:25:07.089935 | PLAY [localhost]
2026-04-07 06:25:07.096877 | 
2026-04-07 06:25:07.096947 | TASK [Gathering Facts]
2026-04-07 06:25:07.924073 | localhost | ok
2026-04-07 06:25:07.934748 | 
2026-04-07 06:25:07.934848 | TASK [Setup log path fact]
2026-04-07 06:25:07.954837 | localhost | ok
2026-04-07 06:25:07.965588 | 
2026-04-07 06:25:07.965662 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-07 06:25:07.993276 | localhost | ok
2026-04-07 06:25:08.002385 | 
2026-04-07 06:25:08.002473 | TASK [emit-job-header : Print job information]
2026-04-07 06:25:08.039446 | # Job Information
2026-04-07 06:25:08.039645 | Ansible Version: 2.16.16
2026-04-07 06:25:08.039699 | Job: atmosphere-molecule-keycloak
2026-04-07 06:25:08.039735 | Pipeline: check
2026-04-07 06:25:08.039764 | Executor: 0a8996d2b663
2026-04-07 06:25:08.039792 | Triggered by: https://github.com/vexxhost/atmosphere/pull/3809
2026-04-07 06:25:08.039824 | Event ID: 54ad5390-324a-11f1-96b9-49e0a9859ca2
2026-04-07 06:25:08.043549 | 
2026-04-07 06:25:08.043636 | LOOP [emit-job-header : Print node information]
2026-04-07 06:25:08.135036 | localhost | ok:
2026-04-07 06:25:08.135323 | localhost | # Node Information
2026-04-07 06:25:08.135387 | localhost | Inventory Hostname: instance
2026-04-07 06:25:08.135435 | localhost | Hostname: np0000163868
2026-04-07 06:25:08.135479 | localhost | Username: zuul
2026-04-07 06:25:08.135527 | localhost | Distro: Ubuntu 22.04
2026-04-07 06:25:08.135570 | localhost | Provider: yul1
2026-04-07 06:25:08.135612 | localhost | Region: ca-ymq-1
2026-04-07 06:25:08.135652 | localhost | Label: ubuntu-jammy
2026-04-07 06:25:08.135693 | localhost | Product Name: OpenStack Nova
2026-04-07 06:25:08.135734 | localhost | Interface IP: 162.253.55.36
2026-04-07 06:25:08.148597 | 
2026-04-07 06:25:08.148692 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-07 06:25:09.299395 | localhost -> localhost | changed
2026-04-07 06:25:09.309505 | 
2026-04-07 06:25:09.309578 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-07 06:25:10.067324 | localhost -> localhost | changed
2026-04-07 06:25:10.077014 | 
2026-04-07 06:25:10.077074 | PLAY [all]
2026-04-07 06:25:10.084425 | 
2026-04-07 06:25:10.084486 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-07 06:25:10.292427 | instance -> localhost | ok
2026-04-07 06:25:10.303629 | 
2026-04-07 06:25:10.303765 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-07 06:25:10.335507 | instance | ok
2026-04-07 06:25:10.356198 | instance | included: /var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-07 06:25:10.362095 | 
2026-04-07 06:25:10.362154 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-07 06:25:12.287310 | instance -> localhost | Generating public/private rsa key pair.
2026-04-07 06:25:12.287567 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/b7a39eb47e5c46e48eae1d13ffd903e0_id_rsa
2026-04-07 06:25:12.287619 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/b7a39eb47e5c46e48eae1d13ffd903e0_id_rsa.pub
2026-04-07 06:25:12.287642 | instance -> localhost | The key fingerprint is:
2026-04-07 06:25:12.287669 | instance -> localhost | SHA256:aGoKYBR8LVPLOLSjngnTZ85DNq0Eq/Dw8lWjOxfCVh4 zuul-build-sshkey
2026-04-07 06:25:12.287702 | instance -> localhost | The key's randomart image is:
2026-04-07 06:25:12.287723 | instance -> localhost | +---[RSA 3072]----+
2026-04-07 06:25:12.287749 | instance -> localhost | |.. .o.           |
2026-04-07 06:25:12.287771 | instance -> localhost | | .o++..          |
2026-04-07 06:25:12.287791 | instance -> localhost | | .o=oo           |
2026-04-07 06:25:12.287811 | instance -> localhost | |...oo.E.         |
2026-04-07 06:25:12.287831 | instance -> localhost | |*oo.Bo*.S        |
2026-04-07 06:25:12.287850 | instance -> localhost | |**oO+Bo.         |
2026-04-07 06:25:12.287870 | instance -> localhost | |++o.X. .         |
2026-04-07 06:25:12.287890 | instance -> localhost | | + +.o.          |
2026-04-07 06:25:12.287912 | instance -> localhost | |  o .o           |
2026-04-07 06:25:12.287932 | instance -> localhost | +----[SHA256]-----+
2026-04-07 06:25:12.287978 | instance -> localhost | ok: Runtime: 0:00:01.553285
2026-04-07 06:25:12.292829 | 
2026-04-07 06:25:12.292891 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-07 06:25:12.323502 | instance | ok
2026-04-07 06:25:12.332936 | instance | included: /var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-07 06:25:12.339976 | 
2026-04-07 06:25:12.340036 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-07 06:25:12.353930 | instance | skipping: Conditional result was False
2026-04-07 06:25:12.363638 | 
2026-04-07 06:25:12.363696 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-07 06:25:12.769728 | instance | changed
2026-04-07 06:25:12.776245 | 
2026-04-07 06:25:12.776327 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-07 06:25:12.952039 | instance | ok
2026-04-07 06:25:12.958561 | 
2026-04-07 06:25:12.958659 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-07 06:25:13.426400 | instance | changed
2026-04-07 06:25:13.432401 | 
2026-04-07 06:25:13.432503 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-07 06:25:13.900353 | instance | changed
2026-04-07 06:25:13.908361 | 
2026-04-07 06:25:13.908428 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-07 06:25:13.931709 | instance | skipping: Conditional result was False
2026-04-07 06:25:13.941051 | 
2026-04-07 06:25:13.941114 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-07 06:25:14.273514 | instance -> localhost | changed
2026-04-07 06:25:14.286793 | 
2026-04-07 06:25:14.286858 | TASK [add-build-sshkey : Add back temp key]
2026-04-07 06:25:14.548320 | instance -> localhost | Identity added: /var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/b7a39eb47e5c46e48eae1d13ffd903e0_id_rsa (zuul-build-sshkey)
2026-04-07 06:25:14.548530 | instance -> localhost | ok: Runtime: 0:00:00.013574
2026-04-07 06:25:14.554762 | 
2026-04-07 06:25:14.554822 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-07 06:25:14.842624 | instance | ok
2026-04-07 06:25:14.853467 | 
2026-04-07 06:25:14.853560 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-07 06:25:14.877705 | instance | skipping: Conditional result was False
2026-04-07 06:25:14.892521 | 
2026-04-07 06:25:14.892585 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-07 06:25:15.244177 | instance | ok
2026-04-07 06:25:15.251646 | 
2026-04-07 06:25:15.251741 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-07 06:25:16.876895 | instance | Output suppressed because no_log was given
2026-04-07 06:25:16.886121 | 
2026-04-07 06:25:16.886182 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-07 06:25:17.064421 | instance | ok: "logs"
2026-04-07 06:25:17.064717 | instance | ok: All items complete
2026-04-07 06:25:17.064758 | 
2026-04-07 06:25:17.213502 | instance | ok: "artifacts"
2026-04-07 06:25:17.362482 | instance | ok: "docs"
2026-04-07 06:25:17.383540 | 
2026-04-07 06:25:17.383659 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-07 06:25:17.569063 | instance | changed: "logs"
2026-04-07 06:25:17.723512 | instance | changed: "artifacts"
2026-04-07 06:25:17.882492 | instance | changed: "docs"
2026-04-07 06:25:17.901225 | 
2026-04-07 06:25:17.901303 | PLAY RECAP
2026-04-07 06:25:17.901348 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-07 06:25:17.901377 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-07 06:25:17.901399 | 
2026-04-07 06:25:18.000888 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-07 06:25:18.005610 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-07 06:25:18.561228 | 
2026-04-07 06:25:18.561373 | PLAY [all]
2026-04-07 06:25:18.572825 | 
2026-04-07 06:25:18.572902 | TASK [setup-uv : Extract archive]
2026-04-07 06:25:20.728124 | instance | changed
2026-04-07 06:25:20.735126 | 
2026-04-07 06:25:20.735202 | TASK [setup-uv : Print version]
2026-04-07 06:25:21.047108 | instance | uv 0.8.13
2026-04-07 06:25:21.269469 | instance | ok: Runtime: 0:00:00.008250
2026-04-07 06:25:21.277038 | 
2026-04-07 06:25:21.277087 | PLAY RECAP
2026-04-07 06:25:21.277133 | instance | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-07 06:25:21.277157 | 
2026-04-07 06:25:21.368084 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-07 06:25:21.372541 | PRE-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-07 06:25:21.896015 | 
2026-04-07 06:25:21.896122 | PLAY [all]
2026-04-07 06:25:21.906764 | 
2026-04-07 06:25:21.906835 | TASK [Install "jq" for log collection]
2026-04-07 06:25:35.907769 | instance | changed
2026-04-07 06:25:35.910066 | 
2026-04-07 06:25:35.910129 | PLAY RECAP
2026-04-07 06:25:35.910182 | instance | ok: 1 changed: 1 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-07 06:25:35.910231 | 
2026-04-07 06:25:35.999810 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/pre.yml@main]
2026-04-07 06:25:36.004526 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-07 06:25:36.537017 | 
2026-04-07 06:25:36.537137 | PLAY [all]
2026-04-07 06:25:36.548123 | 
2026-04-07 06:25:36.548194 | TASK [Copy inventory file for Zuul]
2026-04-07 06:25:37.370702 | instance | changed
2026-04-07 06:25:37.375496 | 
2026-04-07 06:25:37.375568 | TASK [Switch "ansible_host" to private IP]
2026-04-07 06:25:37.642093 | instance | changed: 1 replacements made
2026-04-07 06:25:37.648179 | 
2026-04-07 06:25:37.648242 | TASK [Run Molecule scenario]
2026-04-07 06:25:38.016713 | instance | Using CPython 3.10.12 interpreter at: /usr/bin/python3
2026-04-07 06:25:38.016810 | instance | Creating virtual environment at: .venv
2026-04-07 06:25:38.040498 | instance |    Building atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-07 06:25:38.055991 | instance | Downloading ansible-core (2.1MiB)
2026-04-07 06:25:38.056266 | instance | Downloading pydantic-core (2.0MiB)
2026-04-07 06:25:38.056351 | instance | Downloading kubernetes (1.9MiB)
2026-04-07 06:25:38.063992 | instance | Downloading netaddr (2.2MiB)
2026-04-07 06:25:38.065012 | instance | Downloading rjsonnet (1.2MiB)
2026-04-07 06:25:38.065422 | instance | Downloading setuptools (1.1MiB)
2026-04-07 06:25:38.065691 | instance | Downloading openstacksdk (1.7MiB)
2026-04-07 06:25:38.066867 | instance | Downloading pygments (1.2MiB)
2026-04-07 06:25:38.067106 | instance | Downloading cryptography (4.2MiB)
2026-04-07 06:25:38.346408 | instance |    Building pyperclip==1.9.0
2026-04-07 06:25:38.361369 | instance |  Downloading rjsonnet
2026-04-07 06:25:38.459469 | instance |  Downloading pydantic-core
2026-04-07 06:25:38.499748 | instance |  Downloading netaddr
2026-04-07 06:25:38.509187 | instance |  Downloading pygments
2026-04-07 06:25:38.519101 | instance |  Downloading cryptography
2026-04-07 06:25:38.552555 | instance |  Downloading setuptools
2026-04-07 06:25:38.603557 | instance |  Downloading kubernetes
2026-04-07 06:25:38.628522 | instance |  Downloading ansible-core
2026-04-07 06:25:38.656776 | instance |  Downloading openstacksdk
2026-04-07 06:25:39.017115 | instance |       Built pyperclip==1.9.0
2026-04-07 06:25:39.206593 | instance |       Built atmosphere @ file:///home/zuul/src/github.com/vexxhost/atmosphere
2026-04-07 06:25:39.241705 | instance | Installed 83 packages in 33ms
2026-04-07 06:25:39.882834 | instance | WARNING  Molecule scenarios should migrate to 'extensions/molecule'
2026-04-07 06:25:40.566911 | instance | INFO     [keycloak > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-07 06:25:40.567032 | instance | INFO     [keycloak > prerun] Performing prerun with role_name_check=0...
2026-04-07 06:26:14.275619 | instance | CRITICAL The source path '/home/zuul/src/github.com/vexxhost/atmosphere/molecule/keycloak/host_vars' does not exist.
2026-04-07 06:26:14.276027 | instance | Traceback (most recent call last):
2026-04-07 06:26:14.276160 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/bin/molecule", line 10, in <module>
2026-04-07 06:26:14.276375 | instance |     sys.exit(main())
2026-04-07 06:26:14.276505 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1442, in __call__
2026-04-07 06:26:14.276924 | instance |     return self.main(*args, **kwargs)
2026-04-07 06:26:14.277030 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1363, in main
2026-04-07 06:26:14.277338 | instance |     rv = self.invoke(ctx)
2026-04-07 06:26:14.277453 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1830, in invoke
2026-04-07 06:26:14.277817 | instance |     return _process_result(sub_ctx.command.invoke(sub_ctx))
2026-04-07 06:26:14.277922 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 1226, in invoke
2026-04-07 06:26:14.278225 | instance |     return ctx.invoke(self.callback, **ctx.params)
2026-04-07 06:26:14.278333 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/core.py", line 794, in invoke
2026-04-07 06:26:14.278560 | instance |     return callback(*args, **kwargs)
2026-04-07 06:26:14.278686 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 583, in wrapper
2026-04-07 06:26:14.278905 | instance |     return func(*args, **kwargs)
2026-04-07 06:26:14.279031 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/click/decorators.py", line 34, in new_func
2026-04-07 06:26:14.279187 | instance |     return f(get_current_context(), *args, **kwargs)
2026-04-07 06:26:14.279310 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/click_cfg.py", line 418, in wrapper
2026-04-07 06:26:14.279506 | instance |     return func(ctx)
2026-04-07 06:26:14.279631 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/test.py", line 81, in test
2026-04-07 06:26:14.279847 | instance |     base.execute_cmdline_scenarios(scenario_name, args, command_args, ansible_args, exclude)
2026-04-07 06:26:14.279967 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 169, in execute_cmdline_scenarios
2026-04-07 06:26:14.280151 | instance |     _run_scenarios(scenarios, command_args, default_config)
2026-04-07 06:26:14.280275 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 254, in _run_scenarios
2026-04-07 06:26:14.280463 | instance |     execute_scenario(scenario, shared_state=scenarios.shared_state)
2026-04-07 06:26:14.280588 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 373, in execute_scenario
2026-04-07 06:26:14.280785 | instance |     execute_subcommand(scenario.config, action)
2026-04-07 06:26:14.280976 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 358, in execute_subcommand
2026-04-07 06:26:14.281175 | instance |     return command(current_config).execute(args)
2026-04-07 06:26:14.281298 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 77, in __init__
2026-04-07 06:26:14.281466 | instance |     self._setup()
2026-04-07 06:26:14.281589 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/command/base.py", line 111, in _setup
2026-04-07 06:26:14.281760 | instance |     self._config.provisioner.manage_inventory()
2026-04-07 06:26:14.281889 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/provisioner/ansible.py", line 445, in manage_inventory
2026-04-07 06:26:14.282113 | instance |     self._link_or_update_vars()
2026-04-07 06:26:14.282223 | instance |   File "/home/zuul/src/github.com/vexxhost/atmosphere/.venv/lib/python3.10/site-packages/molecule/provisioner/ansible.py", line 513, in _link_or_update_vars
2026-04-07 06:26:14.282431 | instance |     raise MoleculeError(msg)
2026-04-07 06:26:14.282551 | instance | molecule.exceptions.MoleculeError
2026-04-07 06:26:14.737855 | instance | ERROR
2026-04-07 06:26:14.738547 | instance | {
2026-04-07 06:26:14.738621 | instance |   "delta": "0:00:36.423570",
2026-04-07 06:26:14.738674 | instance |   "end": "2026-04-07 06:26:14.378278",
2026-04-07 06:26:14.738722 | instance |   "msg": "non-zero return code",
2026-04-07 06:26:14.738767 | instance |   "rc": 1,
2026-04-07 06:26:14.738816 | instance |   "start": "2026-04-07 06:25:37.954708"
2026-04-07 06:26:14.738861 | instance | }
failure
2026-04-07 06:26:14.743377 | 
2026-04-07 06:26:14.743530 | PLAY RECAP
2026-04-07 06:26:14.743624 | instance | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-07 06:26:14.743673 | 
2026-04-07 06:26:14.834742 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-07 06:26:14.839288 | POST-RUN START: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-07 06:26:15.394413 | 
2026-04-07 06:26:15.394735 | PLAY [all]
2026-04-07 06:26:15.408086 | 
2026-04-07 06:26:15.408162 | TASK [gather-host-logs : creating directory for system status]
2026-04-07 06:26:15.748707 | instance | changed
2026-04-07 06:26:15.754142 | 
2026-04-07 06:26:15.754215 | TASK [gather-host-logs : Get logs for each host]
2026-04-07 06:26:16.131339 | instance | + systemd-cgls --full --all --no-pager
2026-04-07 06:26:16.141094 | instance | + ip addr
2026-04-07 06:26:16.142886 | instance | + ip route
2026-04-07 06:26:16.144395 | instance | + lsblk
2026-04-07 06:26:16.146451 | instance | + mount
2026-04-07 06:26:16.147786 | instance | + docker images
2026-04-07 06:26:16.148119 | instance | /bin/bash: line 7: docker: command not found
2026-04-07 06:26:16.148274 | instance | + brctl show
2026-04-07 06:26:16.148592 | instance | /bin/bash: line 8: brctl: command not found
2026-04-07 06:26:16.148779 | instance | + ps aux --sort=-%mem
2026-04-07 06:26:16.159906 | instance | + dpkg -l
2026-04-07 06:26:16.165624 | instance | + CONTAINERS=($(docker ps -a --format '{{ .Names }}' --filter label=zuul))
2026-04-07 06:26:16.165982 | instance | ++ docker ps -a --format '{{ .Names }}' --filter label=zuul
2026-04-07 06:26:16.165999 | instance | /bin/bash: line 11: docker: command not found
2026-04-07 06:26:16.166258 | instance | + '[' '!' -z '' ']'
2026-04-07 06:26:16.288719 | instance | ok: Runtime: 0:00:00.040544
2026-04-07 06:26:16.297205 | 
2026-04-07 06:26:16.297272 | TASK [gather-host-logs : Downloads logs to executor]
2026-04-07 06:26:16.936553 | instance | changed:
2026-04-07 06:26:16.936748 | instance | created directory /var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/logs/instance
2026-04-07 06:26:16.936777 | instance | cd+++++++++ system/
2026-04-07 06:26:16.936800 | instance | >f+++++++++ system/brctl-show.txt
2026-04-07 06:26:16.936824 | instance | >f+++++++++ system/docker-images.txt
2026-04-07 06:26:16.936845 | instance | >f+++++++++ system/ip-addr.txt
2026-04-07 06:26:16.936869 | instance | >f+++++++++ system/ip-route.txt
2026-04-07 06:26:16.936891 | instance | >f+++++++++ system/lsblk.txt
2026-04-07 06:26:16.936912 | instance | >f+++++++++ system/mount.txt
2026-04-07 06:26:16.936933 | instance | >f+++++++++ system/packages.txt
2026-04-07 06:26:16.936953 | instance | >f+++++++++ system/ps.txt
2026-04-07 06:26:16.936973 | instance | >f+++++++++ system/systemd-cgls.txt
2026-04-07 06:26:16.945724 | 
2026-04-07 06:26:16.945787 | LOOP [helm-release-status : creating directory for helm release status]
2026-04-07 06:26:17.146028 | instance | changed: "values"
2026-04-07 06:26:17.303460 | instance | changed: "releases"
2026-04-07 06:26:17.319138 | 
2026-04-07 06:26:17.319251 | TASK [helm-release-status : Gather get release status for helm charts]
2026-04-07 06:26:17.524960 | instance | /bin/bash: line 3: kubectl: command not found
2026-04-07 06:26:17.860810 | instance | ok: Runtime: 0:00:00.006716
2026-04-07 06:26:17.866310 | 
2026-04-07 06:26:17.866382 | TASK [helm-release-status : Downloads logs to executor]
2026-04-07 06:26:18.327549 | instance | changed:
2026-04-07 06:26:18.327710 | instance | cd+++++++++ helm/
2026-04-07 06:26:18.327738 | instance | cd+++++++++ helm/releases/
2026-04-07 06:26:18.327760 | instance | cd+++++++++ helm/values/
2026-04-07 06:26:18.337115 | 
2026-04-07 06:26:18.337235 | TASK [describe-kubernetes-objects : creating directory for cluster scoped objects]
2026-04-07 06:26:18.532398 | instance | changed
2026-04-07 06:26:18.538507 | 
2026-04-07 06:26:18.538575 | TASK [describe-kubernetes-objects : Gathering descriptions for cluster scoped objects]
2026-04-07 06:26:18.736956 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 06:26:18.737289 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 06:26:18.742544 | instance | environment: line 1: kubectl: command not found
2026-04-07 06:26:18.743951 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 06:26:18.745375 | instance | environment: line 1: kubectl: command not found
2026-04-07 06:26:18.746587 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 06:26:18.746669 | instance | environment: line 1: kubectl: command not found
2026-04-07 06:26:18.748132 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 06:26:18.749120 | instance | environment: line 1: kubectl: command not found
2026-04-07 06:26:18.749987 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 06:26:18.750378 | instance | environment: line 1: kubectl: command not found
2026-04-07 06:26:18.751212 | instance | xargs: warning: options --max-lines and --replace/-I/-i are mutually exclusive, ignoring previous --max-lines value
2026-04-07 06:26:19.077344 | instance | ok: Runtime: 0:00:00.024129
2026-04-07 06:26:19.082299 | 
2026-04-07 06:26:19.082362 | TASK [describe-kubernetes-objects : creating directory for namespace scoped objects]
2026-04-07 06:26:19.276824 | instance | changed
2026-04-07 06:26:19.283148 | 
2026-04-07 06:26:19.283218 | TASK [describe-kubernetes-objects : Gathering descriptions for namespace scoped objects]
2026-04-07 06:26:19.523705 | instance | environment: line 5: kubectl: command not found
2026-04-07 06:26:19.524385 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 06:26:19.524516 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 06:26:19.524658 | instance | xargs: warning: options --max-args and --replace/-I/-i are mutually exclusive, ignoring previous --max-args value
2026-04-07 06:26:19.849086 | instance | ok: Runtime: 0:00:00.009440
2026-04-07 06:26:19.857063 | 
2026-04-07 06:26:19.857184 | TASK [describe-kubernetes-objects : Downloads logs to executor]
2026-04-07 06:26:20.328472 | instance | changed:
2026-04-07 06:26:20.328616 | instance | cd+++++++++ objects/
2026-04-07 06:26:20.328643 | instance | cd+++++++++ objects/cluster/
2026-04-07 06:26:20.328666 | instance | cd+++++++++ objects/namespaced/
2026-04-07 06:26:20.337729 | 
2026-04-07 06:26:20.337800 | TASK [gather-pod-logs : creating directory for pod logs]
2026-04-07 06:26:20.530082 | instance | changed
2026-04-07 06:26:20.535778 | 
2026-04-07 06:26:20.535838 | TASK [gather-pod-logs : creating directory for failed pod logs]
2026-04-07 06:26:20.744820 | instance | changed
2026-04-07 06:26:20.749659 | 
2026-04-07 06:26:20.749727 | TASK [gather-pod-logs : retrieve all kubernetes logs, current and previous (if they exist)]
2026-04-07 06:26:20.964571 | instance | environment: line 3: kubectl: command not found
2026-04-07 06:26:21.286816 | instance | ok: Runtime: 0:00:00.009360
2026-04-07 06:26:21.292965 | 
2026-04-07 06:26:21.293047 | TASK [gather-pod-logs : Downloads pod logs to executor]
2026-04-07 06:26:21.762496 | instance | changed:
2026-04-07 06:26:21.762663 | instance | cd+++++++++ pod-logs/
2026-04-07 06:26:21.762702 | instance | cd+++++++++ pod-logs/failed-pods/
2026-04-07 06:26:21.774737 | 
2026-04-07 06:26:21.774799 | TASK [gather-prom-metrics : creating directory for helm release descriptions]
2026-04-07 06:26:21.970491 | instance | changed
2026-04-07 06:26:21.975242 | 
2026-04-07 06:26:21.975305 | TASK [gather-prom-metrics : Get metrics from exporter services in all namespaces]
2026-04-07 06:26:22.172719 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-07 06:26:22.512761 | instance | ok: Runtime: 0:00:00.035320
2026-04-07 06:26:22.518246 | 
2026-04-07 06:26:22.518318 | TASK [gather-prom-metrics : Get ceph metrics from ceph-mgr]
2026-04-07 06:26:22.726179 | instance | /bin/bash: line 2: kubectl: command not found
2026-04-07 06:26:22.752680 | instance | ceph-mgr endpoints:
2026-04-07 06:26:23.056446 | instance | ok: Runtime: 0:00:00.032223
2026-04-07 06:26:23.062289 | 
2026-04-07 06:26:23.062355 | TASK [gather-prom-metrics : Get metrics from fluentd pods]
2026-04-07 06:26:23.250634 | instance | /bin/bash: line 4: kubectl: command not found
2026-04-07 06:26:23.595679 | instance | ok: Runtime: 0:00:00.034521
2026-04-07 06:26:23.601153 | 
2026-04-07 06:26:23.601217 | TASK [gather-prom-metrics : Downloads logs to executor]
2026-04-07 06:26:24.067680 | instance | changed: cd+++++++++ prometheus/
2026-04-07 06:26:24.079907 | 
2026-04-07 06:26:24.079980 | TASK [gather-selenium-data : creating directory for helm release descriptions]
2026-04-07 06:26:24.285718 | instance | changed
2026-04-07 06:26:24.291597 | 
2026-04-07 06:26:24.291659 | TASK [gather-selenium-data : Get selenium data]
2026-04-07 06:26:24.481773 | instance | + cp '/tmp/artifacts/*' /tmp/logs/selenium/.
2026-04-07 06:26:24.483332 | instance | cp: cannot stat '/tmp/artifacts/*': No such file or directory
2026-04-07 06:26:24.829443 | instance | ERROR
2026-04-07 06:26:24.829752 | instance | {
2026-04-07 06:26:24.829822 | instance |   "delta": "0:00:00.006437",
2026-04-07 06:26:24.829877 | instance |   "end": "2026-04-07 06:26:24.483711",
2026-04-07 06:26:24.829970 | instance |   "msg": "non-zero return code",
2026-04-07 06:26:24.830019 | instance |   "rc": 1,
2026-04-07 06:26:24.830061 | instance |   "start": "2026-04-07 06:26:24.477274"
2026-04-07 06:26:24.830100 | instance | }
2026-04-07 06:26:24.830151 | instance | ERROR: Ignoring Errors
2026-04-07 06:26:24.835948 | 
2026-04-07 06:26:24.836015 | TASK [gather-selenium-data : Downloads logs to executor]
2026-04-07 06:26:25.309974 | instance | changed: cd+++++++++ selenium/
2026-04-07 06:26:25.317350 | 
2026-04-07 06:26:25.317413 | PLAY RECAP
2026-04-07 06:26:25.317472 | instance | ok: 23 changed: 23 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 1
2026-04-07 06:26:25.317501 | 
2026-04-07 06:26:25.425484 | POST-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere/test-playbooks/molecule/post.yml@main]
2026-04-07 06:26:25.428802 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-07 06:26:26.018547 | 
2026-04-07 06:26:26.018656 | PLAY [all]
2026-04-07 06:26:26.029603 | 
2026-04-07 06:26:26.029672 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-07 06:26:26.073315 | instance | skipping: Conditional result was False
2026-04-07 06:26:26.080429 | 
2026-04-07 06:26:26.080533 | TASK [fetch-output : Set log path for single node]
2026-04-07 06:26:26.121326 | instance | ok
2026-04-07 06:26:26.126375 | 
2026-04-07 06:26:26.126445 | LOOP [fetch-output : Ensure local output dirs]
2026-04-07 06:26:26.483472 | instance -> localhost | ok: "/var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/logs"
2026-04-07 06:26:26.679777 | instance -> localhost | changed: "/var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/artifacts"
2026-04-07 06:26:26.868946 | instance -> localhost | changed: "/var/lib/zuul/builds/b7a39eb47e5c46e48eae1d13ffd903e0/work/docs"
2026-04-07 06:26:26.886069 | 
2026-04-07 06:26:26.886212 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-07 06:26:27.468686 | instance | changed: .d..t...... ./
2026-04-07 06:26:27.468936 | instance | changed: All items complete
2026-04-07 06:26:27.469000 | 
2026-04-07 06:26:27.897683 | instance | changed: .d..t...... ./
2026-04-07 06:26:28.322331 | instance | changed: .d..t...... ./
2026-04-07 06:26:28.338358 | 
2026-04-07 06:26:28.338480 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-07 06:26:28.720963 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.005857
2026-04-07 06:26:28.924713 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.005285
2026-04-07 06:26:28.944855 | 
2026-04-07 06:26:28.944964 | PLAY [all]
2026-04-07 06:26:28.950534 | 
2026-04-07 06:26:28.950596 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-07 06:26:29.339112 | instance | changed
2026-04-07 06:26:29.344455 | 
2026-04-07 06:26:29.344512 | PLAY RECAP
2026-04-07 06:26:29.344555 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-07 06:26:29.344577 | 
2026-04-07 06:26:29.439469 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-07 06:26:29.444484 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-07 06:26:29.975455 | 
2026-04-07 06:26:29.975570 | PLAY [localhost]
2026-04-07 06:26:29.985316 | 
2026-04-07 06:26:29.985383 | TASK [Generate Zuul manifest]
2026-04-07 06:26:30.001303 | localhost | ok
2026-04-07 06:26:30.014430 | 
2026-04-07 06:26:30.014506 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-07 06:26:30.358814 | localhost | changed
2026-04-07 06:26:30.370199 | 
2026-04-07 06:26:30.370274 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-07 06:26:30.460564 | localhost | ok
2026-04-07 06:26:30.469381 | 
2026-04-07 06:26:30.469442 | TASK [Upload logs]
2026-04-07 06:26:30.487340 | localhost | ok
2026-04-07 06:26:30.542244 | 
2026-04-07 06:26:30.542352 | TASK [Set zuul-log-path fact]
2026-04-07 06:26:30.562986 | localhost | ok
2026-04-07 06:26:30.573596 | 
2026-04-07 06:26:30.573657 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-07 06:26:30.602726 | localhost | ok
2026-04-07 06:26:30.611335 | 
2026-04-07 06:26:30.611398 | TASK [upload-logs : Create log directories]
2026-04-07 06:26:30.982787 | localhost | changed
2026-04-07 06:26:30.990001 | 
2026-04-07 06:26:30.990070 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-07 06:26:31.355296 | localhost -> localhost | ok: Runtime: 0:00:00.005376
2026-04-07 06:26:31.361281 | 
2026-04-07 06:26:31.361345 | TASK [upload-logs : Upload logs to log server]
2026-04-07 06:26:31.775150 | localhost | Output suppressed because no_log was given
2026-04-07 06:26:31.778665 | 
2026-04-07 06:26:31.778730 | LOOP [upload-logs : Compress console log and json output]
2026-04-07 06:26:31.827992 | localhost | skipping: Conditional result was False
2026-04-07 06:26:31.835251 | localhost | skipping: Conditional result was False
2026-04-07 06:26:31.849430 | 
2026-04-07 06:26:31.849555 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-07 06:26:31.890557 | localhost | skipping: Conditional result was False
2026-04-07 06:26:31.890910 | 
2026-04-07 06:26:31.894680 | localhost | skipping: Conditional result was False
2026-04-07 06:26:31.904949 | 
2026-04-07 06:26:31.905194 | LOOP [upload-logs : Upload console log and json output]