2026-04-18 16:15:56.897698 | Job console starting
2026-04-18 16:15:56.922502 | Updating git repos
2026-04-18 16:15:56.945238 | Cloning repos into workspace
2026-04-18 16:15:59.566780 | Restoring repo states
2026-04-18 16:15:59.573700 | Merging changes
2026-04-18 16:16:00.680520 | Checking out repos
2026-04-18 16:16:00.772136 | Preparing playbooks
2026-04-18 16:16:18.089952 | Running Ansible setup
2026-04-18 16:16:22.760934 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:16:23.342857 | 
2026-04-18 16:16:23.342991 | PLAY [localhost]
2026-04-18 16:16:23.350693 | 
2026-04-18 16:16:23.350760 | TASK [Gathering Facts]
2026-04-18 16:16:24.190902 | localhost | ok
2026-04-18 16:16:24.200412 | 
2026-04-18 16:16:24.200595 | TASK [Setup log path fact]
2026-04-18 16:16:24.217894 | localhost | ok
2026-04-18 16:16:24.230499 | 
2026-04-18 16:16:24.230566 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:16:24.259196 | localhost | ok
2026-04-18 16:16:24.266318 | 
2026-04-18 16:16:24.266380 | TASK [emit-job-header : Print job information]
2026-04-18 16:16:24.306069 | # Job Information
2026-04-18 16:16:24.306284 | Ansible Version: 2.16.16
2026-04-18 16:16:24.306355 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-04-18 16:16:24.306404 | Pipeline: check
2026-04-18 16:16:24.306448 | Executor: 0a8996d2b663
2026-04-18 16:16:24.306492 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/103
2026-04-18 16:16:24.306541 | Event ID: bcf0b280-3b41-11f1-9349-0bdc5a4d9f14
2026-04-18 16:16:24.311033 | 
2026-04-18 16:16:24.311096 | LOOP [emit-job-header : Print node information]
2026-04-18 16:16:24.405963 | localhost | ok:
2026-04-18 16:16:24.406366 | localhost | # Node Information
2026-04-18 16:16:24.406517 | localhost | Inventory Hostname: mon1
2026-04-18 16:16:24.406601 | localhost | Hostname: np0000167282
2026-04-18 16:16:24.406677 | localhost | Username: zuul
2026-04-18 16:16:24.406757 | localhost | Distro: Ubuntu 24.04
2026-04-18 16:16:24.406828 | localhost | Provider: yul1
2026-04-18 16:16:24.406898 | localhost | Region: ca-ymq-1
2026-04-18 16:16:24.406964 | localhost | Label: ubuntu-noble
2026-04-18 16:16:24.407034 | localhost | Product Name: OpenStack Nova
2026-04-18 16:16:24.407078 | localhost | Interface IP: 199.204.45.89
2026-04-18 16:16:24.453552 | localhost | ok:
2026-04-18 16:16:24.453652 | localhost | # Node Information
2026-04-18 16:16:24.453708 | localhost | Inventory Hostname: osd1
2026-04-18 16:16:24.453753 | localhost | Hostname: np0000167283
2026-04-18 16:16:24.453795 | localhost | Username: zuul
2026-04-18 16:16:24.453851 | localhost | Distro: Ubuntu 24.04
2026-04-18 16:16:24.453894 | localhost | Provider: yul1
2026-04-18 16:16:24.453934 | localhost | Region: ca-ymq-1
2026-04-18 16:16:24.453973 | localhost | Label: ubuntu-noble
2026-04-18 16:16:24.454012 | localhost | Product Name: OpenStack Nova
2026-04-18 16:16:24.454053 | localhost | Interface IP: 199.204.45.157
2026-04-18 16:16:24.465605 | 
2026-04-18 16:16:24.465692 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-04-18 16:16:24.847757 | localhost -> localhost | changed
2026-04-18 16:16:24.855355 | 
2026-04-18 16:16:24.855457 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-04-18 16:16:25.714184 | localhost -> localhost | changed
2026-04-18 16:16:25.720069 | 
2026-04-18 16:16:25.720125 | PLAY [all]
2026-04-18 16:16:25.729098 | 
2026-04-18 16:16:25.729169 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-04-18 16:16:25.955403 | mon1 -> localhost | ok
2026-04-18 16:16:25.961760 | 
2026-04-18 16:16:25.961824 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-04-18 16:16:25.994882 | mon1 | ok
2026-04-18 16:16:26.000461 | osd1 | ok
2026-04-18 16:16:26.021827 | mon1 | included: /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:16:26.021881 | osd1 | included: /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-04-18 16:16:26.028077 | 
2026-04-18 16:16:26.028136 | TASK [add-build-sshkey : Create Temp SSH key]
2026-04-18 16:16:26.752277 | mon1 -> localhost | Generating public/private rsa key pair.
2026-04-18 16:16:26.752493 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/5e6cc9ba81114d9281987ae2a7c74bf8_id_rsa
2026-04-18 16:16:26.752526 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/5e6cc9ba81114d9281987ae2a7c74bf8_id_rsa.pub
2026-04-18 16:16:26.752549 | mon1 -> localhost | The key fingerprint is:
2026-04-18 16:16:26.752572 | mon1 -> localhost | SHA256:36KS7Fkdfdzjw8hfoR5O7aXtZPEubx5ECh2PQ69Fb94 zuul-build-sshkey
2026-04-18 16:16:26.752593 | mon1 -> localhost | The key's randomart image is:
2026-04-18 16:16:26.752612 | mon1 -> localhost | +---[RSA 3072]----+
2026-04-18 16:16:26.752632 | mon1 -> localhost | |             o . |
2026-04-18 16:16:26.752652 | mon1 -> localhost | |            o * .|
2026-04-18 16:16:26.752672 | mon1 -> localhost | |           . + =o|
2026-04-18 16:16:26.752692 | mon1 -> localhost | |           ...*+.|
2026-04-18 16:16:26.752711 | mon1 -> localhost | |        S . .oo=E|
2026-04-18 16:16:26.752730 | mon1 -> localhost | |         o o..B =|
2026-04-18 16:16:26.752749 | mon1 -> localhost | |     . .. + .* **|
2026-04-18 16:16:26.752768 | mon1 -> localhost | |      +o . .+ =**|
2026-04-18 16:16:26.752787 | mon1 -> localhost | |     .o..    o.O*|
2026-04-18 16:16:26.752806 | mon1 -> localhost | +----[SHA256]-----+
2026-04-18 16:16:26.752857 | mon1 -> localhost | ok: Runtime: 0:00:00.269222
2026-04-18 16:16:26.759890 | 
2026-04-18 16:16:26.759957 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-04-18 16:16:26.796521 | mon1 | ok
2026-04-18 16:16:26.801060 | osd1 | ok
2026-04-18 16:16:26.817198 | mon1 | included: /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:16:26.825120 | osd1 | included: /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-04-18 16:16:26.837881 | 
2026-04-18 16:16:26.837948 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-04-18 16:16:26.866705 | mon1 | skipping: Conditional result was False
2026-04-18 16:16:26.877783 | osd1 | skipping: Conditional result was False
2026-04-18 16:16:26.884297 | 
2026-04-18 16:16:26.884364 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-04-18 16:16:27.416326 | mon1 | changed
2026-04-18 16:16:27.421614 | osd1 | changed
2026-04-18 16:16:27.426812 | 
2026-04-18 16:16:27.426874 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-04-18 16:16:27.640647 | mon1 | ok
2026-04-18 16:16:27.657700 | osd1 | ok
2026-04-18 16:16:27.666102 | 
2026-04-18 16:16:27.666230 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-04-18 16:16:28.221720 | osd1 | changed
2026-04-18 16:16:28.226656 | mon1 | changed
2026-04-18 16:16:28.231891 | 
2026-04-18 16:16:28.231962 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-04-18 16:16:28.834722 | mon1 | changed
2026-04-18 16:16:28.839606 | osd1 | changed
2026-04-18 16:16:28.844779 | 
2026-04-18 16:16:28.844854 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-04-18 16:16:28.872724 | mon1 | skipping: Conditional result was False
2026-04-18 16:16:28.884382 | osd1 | skipping: Conditional result was False
2026-04-18 16:16:28.894332 | 
2026-04-18 16:16:28.894403 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-04-18 16:16:29.202614 | mon1 -> localhost | changed
2026-04-18 16:16:29.225275 | 
2026-04-18 16:16:29.225358 | TASK [add-build-sshkey : Add back temp key]
2026-04-18 16:16:29.521520 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/5e6cc9ba81114d9281987ae2a7c74bf8_id_rsa (zuul-build-sshkey)
2026-04-18 16:16:29.521756 | mon1 -> localhost | ok: Runtime: 0:00:00.013611
2026-04-18 16:16:29.527493 | 
2026-04-18 16:16:29.527558 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-04-18 16:16:29.825793 | osd1 | ok
2026-04-18 16:16:29.832304 | mon1 | ok
2026-04-18 16:16:29.837234 | 
2026-04-18 16:16:29.837297 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-04-18 16:16:29.861190 | mon1 | skipping: Conditional result was False
2026-04-18 16:16:29.872287 | osd1 | skipping: Conditional result was False
2026-04-18 16:16:29.889978 | 
2026-04-18 16:16:29.890043 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-04-18 16:16:30.218033 | mon1 | ok
2026-04-18 16:16:30.223657 | osd1 | ok
2026-04-18 16:16:30.229906 | 
2026-04-18 16:16:30.229977 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-04-18 16:16:30.979481 | mon1 | Output suppressed because no_log was given
2026-04-18 16:16:31.024383 | osd1 | Output suppressed because no_log was given
2026-04-18 16:16:31.050055 | 
2026-04-18 16:16:31.050236 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-04-18 16:16:31.269486 | mon1 | ok: "logs"
2026-04-18 16:16:31.270151 | mon1 | ok: All items complete
2026-04-18 16:16:31.270227 | 
2026-04-18 16:16:31.298641 | osd1 | ok: "logs"
2026-04-18 16:16:31.470376 | mon1 | ok: "artifacts"
2026-04-18 16:16:31.498462 | osd1 | ok: "artifacts"
2026-04-18 16:16:31.673499 | mon1 | ok: "docs"
2026-04-18 16:16:31.710893 | osd1 | ok: "docs"
2026-04-18 16:16:31.730395 | 
2026-04-18 16:16:31.730553 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-04-18 16:16:31.958541 | mon1 | changed: "logs"
2026-04-18 16:16:31.959007 | mon1 | ok: All items complete
2026-04-18 16:16:31.959066 | 
2026-04-18 16:16:31.979126 | osd1 | changed: "logs"
2026-04-18 16:16:32.159313 | mon1 | changed: "artifacts"
2026-04-18 16:16:32.193715 | osd1 | changed: "artifacts"
2026-04-18 16:16:32.358235 | mon1 | changed: "docs"
2026-04-18 16:16:32.400536 | osd1 | changed: "docs"
2026-04-18 16:16:32.417864 | 
2026-04-18 16:16:32.417932 | PLAY RECAP
2026-04-18 16:16:32.417974 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:16:32.418002 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:16:32.418026 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-04-18 16:16:32.418044 | 
2026-04-18 16:16:32.539654 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-04-18 16:16:32.543166 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:16:33.089155 | 
2026-04-18 16:16:33.089296 | PLAY [all]
2026-04-18 16:16:33.100925 | 
2026-04-18 16:16:33.101066 | TASK [setup-uv : Extract archive]
2026-04-18 16:16:35.597637 | mon1 | changed
2026-04-18 16:16:44.089070 | osd1 | changed
2026-04-18 16:16:44.095506 | 
2026-04-18 16:16:44.095588 | TASK [setup-uv : Print version]
2026-04-18 16:16:44.514647 | mon1 | uv 0.8.13
2026-04-18 16:16:44.518230 | osd1 | uv 0.8.13
2026-04-18 16:16:44.670899 | mon1 | ok: Runtime: 0:00:00.014992
2026-04-18 16:16:44.681686 | osd1 | ok: Runtime: 0:00:00.017169
2026-04-18 16:16:44.692235 | 
2026-04-18 16:16:44.692282 | PLAY RECAP
2026-04-18 16:16:44.692327 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:16:44.692354 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:16:44.692372 | 
2026-04-18 16:16:44.827555 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-04-18 16:16:44.831492 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-18 16:16:45.376095 | 
2026-04-18 16:16:45.394135 | PLAY [all]
2026-04-18 16:16:45.412338 | 
2026-04-18 16:16:45.412439 | TASK [Copy inventory file for Zuul]
2026-04-18 16:16:46.392464 | mon1 | changed
2026-04-18 16:16:46.398136 | 
2026-04-18 16:16:46.398211 | TASK [Switch "ansible_host" to private IP]
2026-04-18 16:16:46.756148 | mon1 | changed: 2 replacements made
2026-04-18 16:16:46.763274 | 
2026-04-18 16:16:46.763340 | TASK [Run Molecule scenario]
2026-04-18 16:16:47.206169 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-04-18 16:16:47.206387 | mon1 | Creating virtual environment at: .venv
2026-04-18 16:16:47.471376 | mon1 | Downloading ansible-core (2.1MiB)
2026-04-18 16:16:47.473670 | mon1 | Downloading pygments (1.2MiB)
2026-04-18 16:16:47.474482 | mon1 | Downloading cryptography (4.3MiB)
2026-04-18 16:16:47.482087 | mon1 | Downloading netaddr (2.2MiB)
2026-04-18 16:16:47.664900 | mon1 |  Downloading netaddr
2026-04-18 16:16:47.675131 | mon1 |  Downloading cryptography
2026-04-18 16:16:47.735584 | mon1 |  Downloading pygments
2026-04-18 16:16:47.884439 | mon1 |  Downloading ansible-core
2026-04-18 16:16:47.934013 | mon1 | Installed 37 packages in 48ms
2026-04-18 16:16:48.756481 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-04-18 16:16:48.756572 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-04-18 16:16:49.394705 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-04-18 16:16:49.394775 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-04-18 16:17:03.458481 | mon1 | INFO     [default > dependency] Executing
2026-04-18 16:17:03.458647 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-04-18 16:17:03.458871 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-04-18 16:17:03.458996 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-04-18 16:17:03.464991 | mon1 | INFO     [default > cleanup] Executing
2026-04-18 16:17:03.465314 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-18 16:17:03.471044 | mon1 | INFO     [default > destroy] Executing
2026-04-18 16:17:03.471078 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-04-18 16:17:03.471190 | mon1 | INFO     [default > destroy] Executed: Successful
2026-04-18 16:17:03.476725 | mon1 | INFO     [default > syntax] Executing
2026-04-18 16:17:04.513629 | mon1 |
2026-04-18 16:17:04.513964 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:17:04.564257 | mon1 | INFO     [default > syntax] Executed: Successful
2026-04-18 16:17:04.581402 | mon1 | INFO     [default > create] Executing
2026-04-18 16:17:04.583632 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-04-18 16:17:04.591848 | mon1 | INFO     [default > prepare] Executing
2026-04-18 16:17:05.384200 | mon1 |
2026-04-18 16:17:05.384462 | mon1 | PLAY [Prepare] *****************************************************************
2026-04-18 16:17:05.384679 | mon1 |
2026-04-18 16:17:05.384982 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:17:05.385240 | mon1 | Saturday 18 April 2026  16:17:05 +0000 (0:00:00.034)       0:00:00.034 ********
2026-04-18 16:17:06.607979 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-18 16:17:06.608034 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-04-18 16:17:06.608270 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:17:06.608397 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:17:06.608563 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:17:07.691589 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-04-18 16:17:07.691841 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-04-18 16:17:07.692092 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:17:07.692361 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:17:07.692705 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:17:07.701544 | mon1 | ok: [mon1]
2026-04-18 16:17:07.701769 | mon1 | ok: [osd1]
2026-04-18 16:17:07.701988 | mon1 |
2026-04-18 16:17:07.702230 | mon1 | TASK [Configure short hostname] ************************************************
2026-04-18 16:17:07.702506 | mon1 | Saturday 18 April 2026  16:17:07 +0000 (0:00:02.322)       0:00:02.357 ********
2026-04-18 16:17:08.502407 | mon1 | changed: [mon1]
2026-04-18 16:17:08.502477 | mon1 | changed: [osd1]
2026-04-18 16:17:08.502651 | mon1 |
2026-04-18 16:17:08.502801 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-04-18 16:17:08.502957 | mon1 | Saturday 18 April 2026  16:17:08 +0000 (0:00:00.800)       0:00:03.158 ********
2026-04-18 16:17:08.821381 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-04-18 16:17:08.821421 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-04-18 16:17:08.821428 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-04-18 16:17:08.830362 | mon1 | changed: [mon1]
2026-04-18 16:17:08.830619 | mon1 | changed: [osd1]
2026-04-18 16:17:08.830834 | mon1 |
2026-04-18 16:17:08.831067 | mon1 | TASK [Update apt cache] ********************************************************
2026-04-18 16:17:08.831307 | mon1 | Saturday 18 April 2026  16:17:08 +0000 (0:00:00.328)       0:00:03.486 ********
2026-04-18 16:17:17.399999 | mon1 | changed: [mon1]
2026-04-18 16:17:17.400209 | mon1 | changed: [osd1]
2026-04-18 16:17:17.400456 | mon1 |
2026-04-18 16:17:17.400699 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-04-18 16:17:17.400912 | mon1 |
2026-04-18 16:17:17.401153 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:17:17.401432 | mon1 | Saturday 18 April 2026  16:17:17 +0000 (0:00:08.569)       0:00:12.055 ********
2026-04-18 16:17:18.284551 | mon1 | ok: [osd1]
2026-04-18 16:17:18.284738 | mon1 |
2026-04-18 16:17:18.285003 | mon1 | TASK [Install depedencies] *****************************************************
2026-04-18 16:17:18.285269 | mon1 | Saturday 18 April 2026  16:17:18 +0000 (0:00:00.884)       0:00:12.940 ********
2026-04-18 16:17:46.196280 | mon1 | changed: [osd1]
2026-04-18 16:17:46.196386 | mon1 |
2026-04-18 16:17:46.196554 | mon1 | TASK [Start up service] ********************************************************
2026-04-18 16:17:46.196841 | mon1 | Saturday 18 April 2026  16:17:46 +0000 (0:00:27.908)       0:00:40.848 ********
2026-04-18 16:17:46.845548 | mon1 | ok: [osd1]
2026-04-18 16:17:46.845612 | mon1 |
2026-04-18 16:17:46.845797 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-04-18 16:17:46.845943 | mon1 | Saturday 18 April 2026  16:17:46 +0000 (0:00:00.652)       0:00:41.501 ********
2026-04-18 16:17:47.199510 | mon1 | ok: [osd1]
2026-04-18 16:17:47.199570 | mon1 |
2026-04-18 16:17:47.199583 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-04-18 16:17:47.199600 | mon1 | Saturday 18 April 2026  16:17:47 +0000 (0:00:00.353)       0:00:41.855 ********
2026-04-18 16:17:47.972372 | mon1 | changed: [osd1]
2026-04-18 16:17:47.972411 | mon1 |
2026-04-18 16:17:47.972420 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-04-18 16:17:47.972429 | mon1 | Saturday 18 April 2026  16:17:47 +0000 (0:00:00.771)       0:00:42.627 ********
2026-04-18 16:17:48.210170 | mon1 | ok: [osd1]
2026-04-18 16:17:48.210423 | mon1 |
2026-04-18 16:17:48.210722 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-04-18 16:17:48.211007 | mon1 | Saturday 18 April 2026  16:17:48 +0000 (0:00:00.238)       0:00:42.865 ********
2026-04-18 16:17:48.229851 | mon1 | skipping: [osd1]
2026-04-18 16:17:48.229995 | mon1 |
2026-04-18 16:17:48.230160 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-04-18 16:17:48.230339 | mon1 | Saturday 18 April 2026  16:17:48 +0000 (0:00:00.020)       0:00:42.886 ********
2026-04-18 16:17:48.899952 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:48.900189 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:48.900477 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:48.900709 | mon1 |
2026-04-18 16:17:48.900964 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-04-18 16:17:48.901228 | mon1 | Saturday 18 April 2026  16:17:48 +0000 (0:00:00.669)       0:00:43.555 ********
2026-04-18 16:17:49.660655 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:49.661007 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:49.661392 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:49.661688 | mon1 |
2026-04-18 16:17:49.662051 | mon1 | TASK [Start loop devices] ******************************************************
2026-04-18 16:17:49.662460 | mon1 | Saturday 18 April 2026  16:17:49 +0000 (0:00:00.760)       0:00:44.316 ********
2026-04-18 16:17:50.489748 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:50.489961 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:50.490204 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:50.490466 | mon1 |
2026-04-18 16:17:50.490715 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-04-18 16:17:50.490959 | mon1 | Saturday 18 April 2026  16:17:50 +0000 (0:00:00.829)       0:00:45.145 ********
2026-04-18 16:17:53.004561 | mon1 | changed: [osd1] => (item=osd0)
2026-04-18 16:17:53.004777 | mon1 | changed: [osd1] => (item=osd1)
2026-04-18 16:17:53.005030 | mon1 | changed: [osd1] => (item=osd2)
2026-04-18 16:17:53.005321 | mon1 |
2026-04-18 16:17:53.005617 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-04-18 16:17:53.005821 | mon1 | Saturday 18 April 2026  16:17:53 +0000 (0:00:02.514)       0:00:47.659 ********
2026-04-18 16:17:54.315972 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-04-18 16:17:54.316159 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-04-18 16:17:54.316428 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-04-18 16:17:54.316672 | mon1 |
2026-04-18 16:17:54.316938 | mon1 | PLAY RECAP *********************************************************************
2026-04-18 16:17:54.317220 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-04-18 16:17:54.317591 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-04-18 16:17:54.317828 | mon1 |
2026-04-18 16:17:54.318011 | mon1 |
2026-04-18 16:17:54.318259 | mon1 | TASKS RECAP ********************************************************************
2026-04-18 16:17:54.318562 | mon1 | Saturday 18 April 2026  16:17:54 +0000 (0:00:01.312)       0:00:48.972 ********
2026-04-18 16:17:54.318797 | mon1 | ===============================================================================
2026-04-18 16:17:54.319063 | mon1 | Install depedencies ---------------------------------------------------- 27.91s
2026-04-18 16:17:54.319320 | mon1 | Update apt cache -------------------------------------------------------- 8.57s
2026-04-18 16:17:54.319637 | mon1 | Create a volume group for each loop device ------------------------------ 2.51s
2026-04-18 16:17:54.319891 | mon1 | Gathering Facts --------------------------------------------------------- 2.32s
2026-04-18 16:17:54.320149 | mon1 | Create a logical volume for each loop device ---------------------------- 1.31s
2026-04-18 16:17:54.320429 | mon1 | Gathering Facts --------------------------------------------------------- 0.88s
2026-04-18 16:17:54.320775 | mon1 | Start loop devices ------------------------------------------------------ 0.83s
2026-04-18 16:17:54.321113 | mon1 | Configure short hostname ------------------------------------------------ 0.80s
2026-04-18 16:17:54.321491 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.77s
2026-04-18 16:17:54.321808 | mon1 | Set permissions on loopback devices ------------------------------------- 0.76s
2026-04-18 16:17:54.322146 | mon1 | Create devices for Ceph ------------------------------------------------- 0.67s
2026-04-18 16:17:54.322486 | mon1 | Start up service -------------------------------------------------------- 0.65s
2026-04-18 16:17:54.322823 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s
2026-04-18 16:17:54.323132 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.33s
2026-04-18 16:17:54.323418 | mon1 | Get list of all loopback devices ---------------------------------------- 0.24s
2026-04-18 16:17:54.323833 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-04-18 16:17:54.386895 | mon1 | INFO     [default > prepare] Executed: Successful
2026-04-18 16:17:54.396010 | mon1 | INFO     [default > converge] Executing
2026-04-18 16:17:55.360517 | mon1 |
2026-04-18 16:17:55.360715 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-04-18 16:17:55.360927 | mon1 |
2026-04-18 16:17:55.361167 | mon1 | TASK [Gathering Facts] *********************************************************
2026-04-18 16:17:55.361450 | mon1 | Saturday 18 April 2026  16:17:55 +0000 (0:00:00.051)       0:00:00.051 ********
2026-04-18 16:17:57.412614 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-04-18 16:17:57.412819 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-04-18 16:17:57.413071 | mon1 | interpreter could change the meaning of that path. See
2026-04-18 16:17:57.413303 | mon1 | https://docs.ansible.com/ansible-
2026-04-18 16:17:57.413580 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-04-18 16:17:57.427372 | mon1 | ok: [mon1]
2026-04-18 16:17:57.427517 | mon1 |
2026-04-18 16:17:57.427691 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-04-18 16:17:57.427862 | mon1 | Saturday 18 April 2026  16:17:57 +0000 (0:00:02.066)       0:00:02.118 ********
2026-04-18 16:17:57.777734 | mon1 | ok: [mon1]
2026-04-18 16:17:57.777940 | mon1 |
2026-04-18 16:17:57.778198 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-04-18 16:17:57.778482 | mon1 | Saturday 18 April 2026  16:17:57 +0000 (0:00:00.350)       0:00:02.468 ********
2026-04-18 16:17:57.820882 | mon1 | skipping: [mon1]
2026-04-18 16:17:57.821031 | mon1 |
2026-04-18 16:17:57.821270 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-04-18 16:17:57.821549 | mon1 | Saturday 18 April 2026  16:17:57 +0000 (0:00:00.043)       0:00:02.511 ********
2026-04-18 16:17:58.183190 | mon1 | changed: [mon1]
2026-04-18 16:17:58.183305 | mon1 |
2026-04-18 16:17:58.183681 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-04-18 16:17:58.183957 | mon1 | Saturday 18 April 2026  16:17:58 +0000 (0:00:00.361)       0:00:02.873 ********
2026-04-18 16:17:58.284491 | mon1 | ok: [mon1] => {
2026-04-18 16:17:58.284657 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-04-18 16:17:58.284942 | mon1 | }
2026-04-18 16:17:58.285161 | mon1 |
2026-04-18 16:17:58.285413 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-04-18 16:17:58.285705 | mon1 | Saturday 18 April 2026  16:17:58 +0000 (0:00:00.101)       0:00:02.975 ********
2026-04-18 16:18:20.537657 | mon1 | fatal: [mon1]: FAILED! => {"attempts": 4, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2026-04-18 16:18:20.539291 | mon1 | FAILED - RETRYING: [mon1]: Download item (4 retries left).
2026-04-18 16:18:20.539610 | mon1 | FAILED - RETRYING: [mon1]: Download item (3 retries left).
2026-04-18 16:18:20.539859 | mon1 | FAILED - RETRYING: [mon1]: Download item (2 retries left).
2026-04-18 16:18:20.540114 | mon1 | FAILED - RETRYING: [mon1]: Download item (1 retries left).
2026-04-18 16:18:20.540370 | mon1 |
2026-04-18 16:18:20.540640 | mon1 | PLAY RECAP *********************************************************************
2026-04-18 16:18:20.540896 | mon1 | mon1                       : ok=4    changed=1    unreachable=0    failed=1    skipped=1    rescued=0    ignored=0
2026-04-18 16:18:20.541196 | mon1 |
2026-04-18 16:18:20.541382 | mon1 |
2026-04-18 16:18:20.541692 | mon1 | TASKS RECAP ********************************************************************
2026-04-18 16:18:20.541945 | mon1 | Saturday 18 April 2026  16:18:20 +0000 (0:00:22.255)       0:00:25.230 ********
2026-04-18 16:18:20.542181 | mon1 | ===============================================================================
2026-04-18 16:18:20.542471 | mon1 | vexxhost.containers.download_artifact : Download item ------------------ 22.26s
2026-04-18 16:18:20.542680 | mon1 | Gathering Facts --------------------------------------------------------- 2.07s
2026-04-18 16:18:20.542932 | mon1 | vexxhost.containers.directory : Create directory (/var/lib/downloads) --- 0.36s
2026-04-18 16:18:20.543186 | mon1 | vexxhost.containers.forget_package : Forget package --------------------- 0.35s
2026-04-18 16:18:20.543552 | mon1 | vexxhost.containers.download_artifact : Starting download of file ------- 0.10s
2026-04-18 16:18:20.543807 | mon1 | vexxhost.containers.package : Update state for tar ---------------------- 0.04s
2026-04-18 16:18:20.626245 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:18:20.626376 | mon1 | ERROR    [default > converge] Executed: Failed
2026-04-18 16:18:20.626595 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-04-18 16:18:30.910699 | mon1 | ERROR
2026-04-18 16:18:30.910967 | mon1 | {
2026-04-18 16:18:30.911011 | mon1 |   "delta": "0:01:33.552891",
2026-04-18 16:18:30.911040 | mon1 |   "end": "2026-04-18 16:18:20.690493",
2026-04-18 16:18:30.911067 | mon1 |   "msg": "non-zero return code",
2026-04-18 16:18:30.911093 | mon1 |   "rc": 2,
2026-04-18 16:18:30.911120 | mon1 |   "start": "2026-04-18 16:16:47.137602"
2026-04-18 16:18:30.911146 | mon1 | }
failure
2026-04-18 16:18:30.915622 | 
2026-04-18 16:18:30.915693 | PLAY RECAP
2026-04-18 16:18:30.915757 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-04-18 16:18:30.915859 | 
2026-04-18 16:18:31.072374 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-04-18 16:18:31.077596 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:18:31.643843 | 
2026-04-18 16:18:31.643981 | PLAY [all]
2026-04-18 16:18:31.656288 | 
2026-04-18 16:18:31.656362 | TASK [fetch-output : Set log path for multiple nodes]
2026-04-18 16:18:31.704228 | mon1 | ok
2026-04-18 16:18:31.719114 | osd1 | ok
2026-04-18 16:18:31.724216 | 
2026-04-18 16:18:31.724289 | TASK [fetch-output : Set log path for single node]
2026-04-18 16:18:31.746860 | mon1 | skipping: Conditional result was False
2026-04-18 16:18:31.757622 | osd1 | skipping: Conditional result was False
2026-04-18 16:18:31.763291 | 
2026-04-18 16:18:31.763359 | LOOP [fetch-output : Ensure local output dirs]
2026-04-18 16:18:32.146217 | mon1 -> localhost | changed: "/var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/logs/mon1"
2026-04-18 16:18:32.150269 | osd1 -> localhost | changed: "/var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/logs/osd1"
2026-04-18 16:18:32.357293 | osd1 -> localhost | ok: "/var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/artifacts"
2026-04-18 16:18:32.358297 | mon1 -> localhost | changed: "/var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/artifacts"
2026-04-18 16:18:32.574945 | osd1 -> localhost | changed: "/var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/docs"
2026-04-18 16:18:32.597553 | mon1 -> localhost | ok: "/var/lib/zuul/builds/5e6cc9ba81114d9281987ae2a7c74bf8/work/docs"
2026-04-18 16:18:32.597700 | mon1 -> localhost | changed: All items complete
2026-04-18 16:18:32.597799 | 
2026-04-18 16:18:32.615692 | 
2026-04-18 16:18:32.615764 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-04-18 16:18:33.244355 | mon1 | changed: .d..t...... ./
2026-04-18 16:18:33.268030 | osd1 | changed: .d..t...... ./
2026-04-18 16:18:33.718233 | mon1 | changed: .d..t...... ./
2026-04-18 16:18:33.724556 | osd1 | ok
2026-04-18 16:18:34.172827 | osd1 | changed: .d..t...... ./
2026-04-18 16:18:34.185862 | mon1 | ok
2026-04-18 16:18:34.205597 | 
2026-04-18 16:18:34.205742 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-04-18 16:18:34.624591 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007248
2026-04-18 16:18:34.624841 | mon1 -> localhost | changed: All items complete
2026-04-18 16:18:34.624879 | 
2026-04-18 16:18:34.834105 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008405
2026-04-18 16:18:34.865995 | 
2026-04-18 16:18:34.866149 | PLAY [all]
2026-04-18 16:18:34.873098 | 
2026-04-18 16:18:34.873167 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-04-18 16:18:35.367353 | mon1 | changed
2026-04-18 16:18:35.570632 | osd1 | changed
2026-04-18 16:18:35.580771 | 
2026-04-18 16:18:35.580817 | PLAY RECAP
2026-04-18 16:18:35.580862 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:18:35.580890 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-04-18 16:18:35.580909 | 
2026-04-18 16:18:35.690076 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-04-18 16:18:35.695551 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-04-18 16:18:36.250752 | 
2026-04-18 16:18:36.250909 | PLAY [localhost]
2026-04-18 16:18:36.261201 | 
2026-04-18 16:18:36.261306 | TASK [Generate Zuul manifest]
2026-04-18 16:18:36.282571 | localhost | ok
2026-04-18 16:18:36.299153 | 
2026-04-18 16:18:36.299236 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-04-18 16:18:36.605515 | localhost | changed
2026-04-18 16:18:36.618616 | 
2026-04-18 16:18:36.618687 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-04-18 16:18:36.665484 | localhost | ok
2026-04-18 16:18:36.682636 | 
2026-04-18 16:18:36.682706 | TASK [Upload logs]
2026-04-18 16:18:36.717666 | localhost | ok
2026-04-18 16:18:36.801157 | 
2026-04-18 16:18:36.801300 | TASK [Set zuul-log-path fact]
2026-04-18 16:18:36.824070 | localhost | ok
2026-04-18 16:18:36.839678 | 
2026-04-18 16:18:36.839805 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-04-18 16:18:36.873206 | localhost | ok
2026-04-18 16:18:36.883972 | 
2026-04-18 16:18:36.884291 | TASK [upload-logs : Create log directories]
2026-04-18 16:18:37.311894 | localhost | changed
2026-04-18 16:18:37.317506 | 
2026-04-18 16:18:37.317579 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-04-18 16:18:37.734637 | localhost -> localhost | ok: Runtime: 0:00:00.005473
2026-04-18 16:18:37.741109 | 
2026-04-18 16:18:37.741174 | TASK [upload-logs : Upload logs to log server]
2026-04-18 16:18:38.199761 | localhost | Output suppressed because no_log was given
2026-04-18 16:18:38.205223 | 
2026-04-18 16:18:38.205709 | LOOP [upload-logs : Compress console log and json output]
2026-04-18 16:18:38.263150 | localhost | skipping: Conditional result was False
2026-04-18 16:18:38.270949 | localhost | skipping: Conditional result was False
2026-04-18 16:18:38.281498 | 
2026-04-18 16:18:38.281661 | LOOP [upload-logs : Upload compressed console log and json output]
2026-04-18 16:18:38.323619 | localhost | skipping: Conditional result was False
2026-04-18 16:18:38.324027 | 
2026-04-18 16:18:38.327343 | localhost | skipping: Conditional result was False
2026-04-18 16:18:38.344323 | 
2026-04-18 16:18:38.344488 | LOOP [upload-logs : Upload console log and json output]