2026-08-18 14:40:30.123243 | Job console starting
2026-08-18 14:40:30.132919 | Updating git repos
2026-08-18 14:40:30.158339 | Cloning repos into workspace
2026-08-18 14:40:30.196446 | Restoring repo states
2026-08-18 14:40:30.205270 | Merging changes
2026-08-18 14:40:30.765602 | Checking out repos
2026-08-18 14:40:30.821760 | Preparing playbooks
2026-08-18 14:40:31.764634 | Running Ansible setup
2026-08-18 14:40:35.425516 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 14:40:36.033017 | 
2026-08-18 14:40:36.033188 | PLAY [localhost]
2026-08-18 14:40:36.041341 | 
2026-08-18 14:40:36.041414 | TASK [Gathering Facts]
2026-08-18 14:40:36.905238 | localhost | ok
2026-08-18 14:40:36.916199 | 
2026-08-18 14:40:36.916279 | TASK [Setup log path fact]
2026-08-18 14:40:36.936603 | localhost | ok
2026-08-18 14:40:36.948542 | 
2026-08-18 14:40:36.948610 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 14:40:36.978312 | localhost | ok
2026-08-18 14:40:36.985517 | 
2026-08-18 14:40:36.985580 | TASK [emit-job-header : Print job information]
2026-08-18 14:40:37.042348 | # Job Information
2026-08-18 14:40:37.042617 | Ansible Version: 2.16.18
2026-08-18 14:40:37.042691 | Job: ansible-collection-ceph-molecule-aio-ubuntu-noble
2026-08-18 14:40:37.042743 | Pipeline: check
2026-08-18 14:40:37.042790 | Executor: 2d72f0692154
2026-08-18 14:40:37.042836 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/123
2026-08-18 14:40:37.042888 | Event ID: 5876e6e0-9b12-11f1-83bd-8c5895bbc7af
2026-08-18 14:40:37.046790 | 
2026-08-18 14:40:37.046861 | LOOP [emit-job-header : Print node information]
2026-08-18 14:40:37.134281 | localhost | ok:
2026-08-18 14:40:37.134423 | localhost | # Node Information
2026-08-18 14:40:37.134453 | localhost | Inventory Hostname: aio
2026-08-18 14:40:37.134475 | localhost | Hostname: np0000190019
2026-08-18 14:40:37.134494 | localhost | Username: zuul
2026-08-18 14:40:37.134519 | localhost | Distro: Ubuntu 24.04
2026-08-18 14:40:37.134540 | localhost | Provider: yul1
2026-08-18 14:40:37.134560 | localhost | Region: ca-ymq-1
2026-08-18 14:40:37.134579 | localhost | Label: ubuntu-noble
2026-08-18 14:40:37.134598 | localhost | Product Name: OpenStack Nova
2026-08-18 14:40:37.134617 | localhost | Interface IP: 199.204.45.156
2026-08-18 14:40:37.152734 | 
2026-08-18 14:40:37.152879 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-18 14:40:37.605655 | localhost -> localhost | changed
2026-08-18 14:40:37.613926 | 
2026-08-18 14:40:37.613997 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-18 14:40:38.579786 | localhost -> localhost | changed
2026-08-18 14:40:38.588012 | 
2026-08-18 14:40:38.588068 | PLAY [all]
2026-08-18 14:40:38.596232 | 
2026-08-18 14:40:38.596298 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-18 14:40:38.833093 | aio -> localhost | ok
2026-08-18 14:40:38.839525 | 
2026-08-18 14:40:38.839591 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-18 14:40:38.873383 | aio | ok
2026-08-18 14:40:38.889942 | aio | included: /var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-18 14:40:38.895850 | 
2026-08-18 14:40:38.895918 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-18 14:40:39.685297 | aio -> localhost | Generating public/private rsa key pair.
2026-08-18 14:40:39.685516 | aio -> localhost | Your identification has been saved in /var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/work/7e64062ea7284c6eb2158f7aef2ba71f_id_rsa
2026-08-18 14:40:39.685558 | aio -> localhost | Your public key has been saved in /var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/work/7e64062ea7284c6eb2158f7aef2ba71f_id_rsa.pub
2026-08-18 14:40:39.685590 | aio -> localhost | The key fingerprint is:
2026-08-18 14:40:39.685619 | aio -> localhost | SHA256:HhTUBTIjXzpF4G4s0vhh6lu33Np1jznODyTqyT/gu7s zuul-build-sshkey
2026-08-18 14:40:39.685662 | aio -> localhost | The key's randomart image is:
2026-08-18 14:40:39.685691 | aio -> localhost | +---[RSA 3072]----+
2026-08-18 14:40:39.685725 | aio -> localhost | |      ..B+=o.    |
2026-08-18 14:40:39.685754 | aio -> localhost | |       + O.      |
2026-08-18 14:40:39.685782 | aio -> localhost | |        *        |
2026-08-18 14:40:39.685810 | aio -> localhost | |     o + .       |
2026-08-18 14:40:39.685836 | aio -> localhost | |    o = S   . .  |
2026-08-18 14:40:39.685863 | aio -> localhost | |     = = ... o   |
2026-08-18 14:40:39.685889 | aio -> localhost | |    . o o.... o  |
2026-08-18 14:40:39.685916 | aio -> localhost | |   . . o *.o.o.= |
2026-08-18 14:40:39.685947 | aio -> localhost | |    o.  +.E*.o=oo|
2026-08-18 14:40:39.685997 | aio -> localhost | +----[SHA256]-----+
2026-08-18 14:40:39.686078 | aio -> localhost | ok: Runtime: 0:00:00.350947
2026-08-18 14:40:39.693858 | 
2026-08-18 14:40:39.693949 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-18 14:40:39.729241 | aio | ok
2026-08-18 14:40:39.741989 | aio | included: /var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-18 14:40:39.754192 | 
2026-08-18 14:40:39.754271 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-18 14:40:39.779655 | aio | skipping: Conditional result was False
2026-08-18 14:40:39.788501 | 
2026-08-18 14:40:39.788586 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-18 14:40:40.311873 | aio | changed
2026-08-18 14:40:40.318536 | 
2026-08-18 14:40:40.318605 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-18 14:40:40.540912 | aio | ok
2026-08-18 14:40:40.546555 | 
2026-08-18 14:40:40.547285 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-18 14:40:41.104974 | aio | changed
2026-08-18 14:40:41.110616 | 
2026-08-18 14:40:41.110683 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-18 14:40:41.632773 | aio | changed
2026-08-18 14:40:41.676123 | 
2026-08-18 14:40:41.676256 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-18 14:40:41.701174 | aio | skipping: Conditional result was False
2026-08-18 14:40:41.710798 | 
2026-08-18 14:40:41.710897 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-18 14:40:42.029873 | aio -> localhost | changed
2026-08-18 14:40:42.046581 | 
2026-08-18 14:40:42.046665 | TASK [add-build-sshkey : Add back temp key]
2026-08-18 14:40:42.365565 | aio -> localhost | Identity added: /var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/work/7e64062ea7284c6eb2158f7aef2ba71f_id_rsa (zuul-build-sshkey)
2026-08-18 14:40:42.365806 | aio -> localhost | ok: Runtime: 0:00:00.013861
2026-08-18 14:40:42.374387 | 
2026-08-18 14:40:42.374449 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-18 14:40:42.671938 | aio | ok
2026-08-18 14:40:42.679167 | 
2026-08-18 14:40:42.679257 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-18 14:40:42.704719 | aio | skipping: Conditional result was False
2026-08-18 14:40:42.718899 | 
2026-08-18 14:40:42.718965 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-18 14:40:43.038626 | aio | ok
2026-08-18 14:40:43.045646 | 
2026-08-18 14:40:43.249125 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-18 14:40:43.966134 | aio | Output suppressed because no_log was given
2026-08-18 14:40:43.975573 | 
2026-08-18 14:40:43.975634 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-18 14:40:44.193880 | aio | ok: "logs"
2026-08-18 14:40:44.194140 | aio | ok: All items complete
2026-08-18 14:40:44.194179 | 
2026-08-18 14:40:44.384650 | aio | ok: "artifacts"
2026-08-18 14:40:44.594046 | aio | ok: "docs"
2026-08-18 14:40:44.615233 | 
2026-08-18 14:40:44.615380 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-18 14:40:44.846965 | aio | changed: "logs"
2026-08-18 14:40:45.051726 | aio | changed: "artifacts"
2026-08-18 14:40:45.239314 | aio | changed: "docs"
2026-08-18 14:40:45.253673 | 
2026-08-18 14:40:45.253771 | PLAY RECAP
2026-08-18 14:40:45.253821 | aio | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-18 14:40:45.253850 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:40:45.253873 | 
2026-08-18 14:40:45.543396 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-18 14:40:45.555743 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 14:40:46.132426 | 
2026-08-18 14:40:46.132545 | PLAY [all]
2026-08-18 14:40:46.143309 | 
2026-08-18 14:40:46.143382 | TASK [setup-uv : Extract archive]
2026-08-18 14:40:48.550575 | aio | changed
2026-08-18 14:40:48.559187 | 
2026-08-18 14:40:48.559295 | TASK [setup-uv : Print version]
2026-08-18 14:40:48.963047 | aio | uv 0.8.13
2026-08-18 14:40:49.110603 | aio | ok: Runtime: 0:00:00.016002
2026-08-18 14:40:49.124312 | 
2026-08-18 14:40:49.124400 | TASK [Install Ansible collection siblings]
2026-08-18 14:40:49.514698 | aio | ok:
2026-08-18 14:40:49.514887 | aio | Skipping community.crypto: no checked-out sibling
2026-08-18 14:40:49.514927 | aio | Skipping community.docker: no checked-out sibling
2026-08-18 14:40:49.514957 | aio | Skipping community.general: no checked-out sibling
2026-08-18 14:40:49.514985 | aio | Skipping ansible.utils: no checked-out sibling
2026-08-18 14:40:49.515012 | aio | Skipping vexxhost.containers: no checked-out sibling
2026-08-18 14:40:49.518791 | 
2026-08-18 14:40:49.518841 | PLAY RECAP
2026-08-18 14:40:49.518887 | aio | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:40:49.518909 | 
2026-08-18 14:40:49.635802 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-18 14:40:49.640474 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 14:40:50.215408 | 
2026-08-18 14:40:50.215523 | PLAY [all]
2026-08-18 14:40:50.226983 | 
2026-08-18 14:40:50.227056 | LOOP [Check inventory directories]
2026-08-18 14:40:50.592820 | aio | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 14:40:50.764088 | aio | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-18 14:40:50.942830 | aio | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-18 14:40:50.976270 | 
2026-08-18 14:40:50.976452 | LOOP [Copy inventory file for Zuul]
2026-08-18 14:40:51.864640 | aio | changed:
2026-08-18 14:40:51.864826 | aio | {
2026-08-18 14:40:51.864855 | aio |   "ansible_loop_var": "item",
2026-08-18 14:40:51.864878 | aio |   "changed": false,
2026-08-18 14:40:51.864897 | aio |   "failed": false,
2026-08-18 14:40:51.864919 | aio |   "invocation": {
2026-08-18 14:40:51.864938 | aio |     "module_args": {
2026-08-18 14:40:51.864973 | aio |       "checksum_algorithm": "sha1",
2026-08-18 14:40:51.864993 | aio |       "follow": true,
2026-08-18 14:40:51.865011 | aio |       "get_attributes": true,
2026-08-18 14:40:51.865030 | aio |       "get_checksum": true,
2026-08-18 14:40:51.865047 | aio |       "get_mime": true,
2026-08-18 14:40:51.865064 | aio |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-18 14:40:51.865082 | aio |     }
2026-08-18 14:40:51.865099 | aio |   },
2026-08-18 14:40:51.865115 | aio |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 14:40:51.865132 | aio |   "stat": {
2026-08-18 14:40:51.865149 | aio |     "atime": 1787064043.8702896,
2026-08-18 14:40:51.865166 | aio |     "attr_flags": "e",
2026-08-18 14:40:51.865183 | aio |     "attributes": [
2026-08-18 14:40:51.865200 | aio |       "extents"
2026-08-18 14:40:51.865217 | aio |     ],
2026-08-18 14:40:51.865234 | aio |     "block_size": 4096,
2026-08-18 14:40:51.865251 | aio |     "blocks": 8,
2026-08-18 14:40:51.865281 | aio |     "charset": "unknown",
2026-08-18 14:40:51.865300 | aio |     "ctime": 1787064043.88329,
2026-08-18 14:40:51.865318 | aio |     "dev": 64769,
2026-08-18 14:40:51.865335 | aio |     "device_type": 0,
2026-08-18 14:40:51.865352 | aio |     "executable": true,
2026-08-18 14:40:51.865370 | aio |     "exists": true,
2026-08-18 14:40:51.865387 | aio |     "gid": 1000,
2026-08-18 14:40:51.865404 | aio |     "gr_name": "zuul",
2026-08-18 14:40:51.865420 | aio |     "inode": 1034272,
2026-08-18 14:40:51.865437 | aio |     "isblk": false,
2026-08-18 14:40:51.865454 | aio |     "ischr": false,
2026-08-18 14:40:51.865471 | aio |     "isdir": true,
2026-08-18 14:40:51.865488 | aio |     "isfifo": false,
2026-08-18 14:40:51.865504 | aio |     "isgid": false,
2026-08-18 14:40:51.865520 | aio |     "islnk": false,
2026-08-18 14:40:51.865537 | aio |     "isreg": false,
2026-08-18 14:40:51.865553 | aio |     "issock": false,
2026-08-18 14:40:51.865570 | aio |     "isuid": false,
2026-08-18 14:40:51.865587 | aio |     "mimetype": "unknown",
2026-08-18 14:40:51.865604 | aio |     "mode": "0755",
2026-08-18 14:40:51.865620 | aio |     "mtime": 1787064030.666244,
2026-08-18 14:40:51.865637 | aio |     "nlink": 10,
2026-08-18 14:40:51.865654 | aio |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-18 14:40:51.865672 | aio |     "pw_name": "zuul",
2026-08-18 14:40:51.865690 | aio |     "readable": true,
2026-08-18 14:40:51.865708 | aio |     "rgrp": true,
2026-08-18 14:40:51.865725 | aio |     "roth": true,
2026-08-18 14:40:51.865742 | aio |     "rusr": true,
2026-08-18 14:40:51.865759 | aio |     "size": 4096,
2026-08-18 14:40:51.865776 | aio |     "uid": 1000,
2026-08-18 14:40:51.865793 | aio |     "version": "770470676",
2026-08-18 14:40:51.865811 | aio |     "wgrp": false,
2026-08-18 14:40:51.865832 | aio |     "woth": false,
2026-08-18 14:40:51.865852 | aio |     "writeable": true,
2026-08-18 14:40:51.865869 | aio |     "wusr": true,
2026-08-18 14:40:51.865886 | aio |     "xgrp": true,
2026-08-18 14:40:51.865903 | aio |     "xoth": true,
2026-08-18 14:40:51.865920 | aio |     "xusr": true
2026-08-18 14:40:51.865937 | aio |   }
2026-08-18 14:40:51.865955 | aio | }
2026-08-18 14:40:51.865993 | aio | ok: All items complete
2026-08-18 14:40:51.866015 | 
2026-08-18 14:40:51.867547 | aio | skipping: Conditional result was False
2026-08-18 14:40:51.868128 | aio | skipping: Conditional result was False
2026-08-18 14:40:51.884407 | 
2026-08-18 14:40:51.884563 | LOOP [Switch "ansible_host" to private IP]
2026-08-18 14:40:52.268318 | aio | changed: 1 replacements made
2026-08-18 14:40:52.270195 | aio | skipping: Conditional result was False
2026-08-18 14:40:52.271191 | aio | skipping: Conditional result was False
2026-08-18 14:40:52.294447 | 
2026-08-18 14:40:52.294625 | TASK [Run Molecule scenario]
2026-08-18 14:40:52.774830 | aio | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-08-18 14:40:52.775074 | aio | Creating virtual environment at: .venv
2026-08-18 14:40:52.827948 | aio | Downloading netaddr (2.2MiB)
2026-08-18 14:40:52.828488 | aio | Downloading pygments (1.2MiB)
2026-08-18 14:40:52.828872 | aio | Downloading ansible-core (2.1MiB)
2026-08-18 14:40:52.832717 | aio | Downloading cryptography (4.3MiB)
2026-08-18 14:40:53.036714 | aio |  Downloading netaddr
2026-08-18 14:40:53.047487 | aio |  Downloading cryptography
2026-08-18 14:40:53.112787 | aio |  Downloading pygments
2026-08-18 14:40:53.255047 | aio |  Downloading ansible-core
2026-08-18 14:40:53.299292 | aio | Installed 43 packages in 43ms
2026-08-18 14:40:54.050438 | aio | INFO     Collection 'vexxhost.ceph' detected.
2026-08-18 14:40:54.050580 | aio | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-18 14:40:54.662993 | aio | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-18 14:40:54.663100 | aio | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-18 14:41:25.934639 | aio | INFO     [default > dependency] Executing
2026-08-18 14:41:25.934752 | aio | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-18 14:41:25.934943 | aio | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-18 14:41:25.935083 | aio | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-18 14:41:25.941068 | aio | INFO     [default > cleanup] Executing
2026-08-18 14:41:25.941373 | aio | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 14:41:25.947015 | aio | INFO     [default > destroy] Executing
2026-08-18 14:41:25.947071 | aio | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-18 14:41:25.947146 | aio | INFO     [default > destroy] Executed: Successful
2026-08-18 14:41:25.953060 | aio | INFO     [default > syntax] Executing
2026-08-18 14:41:27.277869 | aio |
2026-08-18 14:41:27.278033 | aio | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 14:41:27.341732 | aio | INFO     [default > syntax] Executed: Successful
2026-08-18 14:41:27.351649 | aio | INFO     [default > create] Executing
2026-08-18 14:41:27.353155 | aio | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-18 14:41:27.359228 | aio | INFO     [default > prepare] Executing
2026-08-18 14:41:28.137539 | aio |
2026-08-18 14:41:28.137786 | aio | PLAY [Prepare] *****************************************************************
2026-08-18 14:41:28.138193 | aio |
2026-08-18 14:41:28.138560 | aio | TASK [Gathering Facts] *********************************************************
2026-08-18 14:41:28.138979 | aio | Tuesday 18 August 2026  14:41:28 +0000 (0:00:00.032)       0:00:00.032 ********
2026-08-18 14:41:29.393465 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-08-18 14:41:29.393596 | aio | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 14:41:29.393756 | aio | interpreter could change the meaning of that path. See
2026-08-18 14:41:29.394961 | aio | https://docs.ansible.com/ansible-
2026-08-18 14:41:29.395013 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:41:29.406027 | aio | ok: [aio]
2026-08-18 14:41:29.406108 | aio |
2026-08-18 14:41:29.406132 | aio | TASK [Configure short hostname] ************************************************
2026-08-18 14:41:29.406265 | aio | Tuesday 18 August 2026  14:41:29 +0000 (0:00:01.269)       0:00:01.301 ********
2026-08-18 14:41:30.187710 | aio | changed: [aio]
2026-08-18 14:41:30.187993 | aio |
2026-08-18 14:41:30.188322 | aio | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-18 14:41:30.188577 | aio | Tuesday 18 August 2026  14:41:30 +0000 (0:00:00.781)       0:00:02.082 ********
2026-08-18 14:41:30.500250 | aio | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-18 14:41:30.500483 | aio | with a mode of 0700, this may cause issues when running as another user. To
2026-08-18 14:41:30.500731 | aio | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-18 14:41:30.510144 | aio | changed: [aio]
2026-08-18 14:41:30.510267 | aio |
2026-08-18 14:41:30.510433 | aio | TASK [Update apt cache] ********************************************************
2026-08-18 14:41:30.510592 | aio | Tuesday 18 August 2026  14:41:30 +0000 (0:00:00.322)       0:00:02.405 ********
2026-08-18 14:41:36.824539 | aio | changed: [aio]
2026-08-18 14:41:36.824786 | aio |
2026-08-18 14:41:36.825140 | aio | PLAY [Create devices for Ceph] *************************************************
2026-08-18 14:41:36.825394 | aio |
2026-08-18 14:41:36.825763 | aio | TASK [Gathering Facts] *********************************************************
2026-08-18 14:41:36.826179 | aio | Tuesday 18 August 2026  14:41:36 +0000 (0:00:06.313)       0:00:08.719 ********
2026-08-18 14:41:37.629087 | aio | ok: [aio]
2026-08-18 14:41:37.629316 | aio |
2026-08-18 14:41:37.629622 | aio | TASK [Install depedencies] *****************************************************
2026-08-18 14:41:37.629987 | aio | Tuesday 18 August 2026  14:41:37 +0000 (0:00:00.804)       0:00:09.524 ********
2026-08-18 14:41:56.393799 | aio | changed: [aio]
2026-08-18 14:41:56.393937 | aio |
2026-08-18 14:41:56.394140 | aio | TASK [Start up service] ********************************************************
2026-08-18 14:41:56.394310 | aio | Tuesday 18 August 2026  14:41:56 +0000 (0:00:18.764)       0:00:28.289 ********
2026-08-18 14:41:57.117793 | aio | ok: [aio]
2026-08-18 14:41:57.117865 | aio |
2026-08-18 14:41:57.118033 | aio | TASK [Generate lvm.conf] *******************************************************
2026-08-18 14:41:57.118219 | aio | Tuesday 18 August 2026  14:41:57 +0000 (0:00:00.723)       0:00:29.013 ********
2026-08-18 14:41:57.460066 | aio | ok: [aio]
2026-08-18 14:41:57.460147 | aio |
2026-08-18 14:41:57.460292 | aio | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-18 14:41:57.460564 | aio | Tuesday 18 August 2026  14:41:57 +0000 (0:00:00.342)       0:00:29.355 ********
2026-08-18 14:41:58.273938 | aio | changed: [aio]
2026-08-18 14:41:58.274155 | aio |
2026-08-18 14:41:58.274414 | aio | TASK [Get list of all loopback devices] ****************************************
2026-08-18 14:41:58.274690 | aio | Tuesday 18 August 2026  14:41:58 +0000 (0:00:00.814)       0:00:30.169 ********
2026-08-18 14:41:58.527966 | aio | ok: [aio]
2026-08-18 14:41:58.528189 | aio |
2026-08-18 14:41:58.528511 | aio | TASK [Fail if there is any existing loopback devices] **************************
2026-08-18 14:41:58.528827 | aio | Tuesday 18 August 2026  14:41:58 +0000 (0:00:00.253)       0:00:30.423 ********
2026-08-18 14:41:58.558024 | aio | skipping: [aio]
2026-08-18 14:41:58.558261 | aio |
2026-08-18 14:41:58.558590 | aio | TASK [Create devices for Ceph] *************************************************
2026-08-18 14:41:58.558963 | aio | Tuesday 18 August 2026  14:41:58 +0000 (0:00:00.030)       0:00:30.453 ********
2026-08-18 14:41:59.248927 | aio | changed: [aio] => (item=osd0)
2026-08-18 14:41:59.248963 | aio | changed: [aio] => (item=osd1)
2026-08-18 14:41:59.248969 | aio | changed: [aio] => (item=osd2)
2026-08-18 14:41:59.249085 | aio |
2026-08-18 14:41:59.249339 | aio | TASK [Set permissions on loopback devices] *************************************
2026-08-18 14:41:59.249673 | aio | Tuesday 18 August 2026  14:41:59 +0000 (0:00:00.689)       0:00:31.143 ********
2026-08-18 14:42:00.031675 | aio | changed: [aio] => (item=osd0)
2026-08-18 14:42:00.031916 | aio | changed: [aio] => (item=osd1)
2026-08-18 14:42:00.032206 | aio | changed: [aio] => (item=osd2)
2026-08-18 14:42:00.032455 | aio |
2026-08-18 14:42:00.032747 | aio | TASK [Start loop devices] ******************************************************
2026-08-18 14:42:00.033089 | aio | Tuesday 18 August 2026  14:42:00 +0000 (0:00:00.783)       0:00:31.926 ********
2026-08-18 14:42:00.830827 | aio | changed: [aio] => (item=osd0)
2026-08-18 14:42:00.830872 | aio | changed: [aio] => (item=osd1)
2026-08-18 14:42:00.830882 | aio | changed: [aio] => (item=osd2)
2026-08-18 14:42:00.830945 | aio |
2026-08-18 14:42:00.830951 | aio | TASK [Create a volume group for each loop device] ******************************
2026-08-18 14:42:00.830969 | aio | Tuesday 18 August 2026  14:42:00 +0000 (0:00:00.797)       0:00:32.724 ********
2026-08-18 14:42:02.246335 | aio | changed: [aio] => (item=osd0)
2026-08-18 14:42:02.246575 | aio | changed: [aio] => (item=osd1)
2026-08-18 14:42:02.246820 | aio | changed: [aio] => (item=osd2)
2026-08-18 14:42:02.247078 | aio |
2026-08-18 14:42:02.247328 | aio | TASK [Create a logical volume for each loop device] ****************************
2026-08-18 14:42:02.247571 | aio | Tuesday 18 August 2026  14:42:02 +0000 (0:00:01.416)       0:00:34.140 ********
2026-08-18 14:42:03.580954 | aio | changed: [aio] => (item=ceph-aio-osd0)
2026-08-18 14:42:03.580999 | aio | changed: [aio] => (item=ceph-aio-osd1)
2026-08-18 14:42:03.581005 | aio | changed: [aio] => (item=ceph-aio-osd2)
2026-08-18 14:42:03.581015 | aio |
2026-08-18 14:42:03.581976 | aio | PLAY RECAP *********************************************************************
2026-08-18 14:42:03.582013 | aio | aio                        : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-18 14:42:03.582025 | aio |
2026-08-18 14:42:03.582036 | aio |
2026-08-18 14:42:03.582249 | aio | TASKS RECAP ********************************************************************
2026-08-18 14:42:03.584962 | aio | Tuesday 18 August 2026  14:42:03 +0000 (0:00:01.335)       0:00:35.475 ********
2026-08-18 14:42:03.585005 | aio | ===============================================================================
2026-08-18 14:42:03.585011 | aio | Install depedencies ---------------------------------------------------- 18.76s
2026-08-18 14:42:03.585015 | aio | Update apt cache -------------------------------------------------------- 6.31s
2026-08-18 14:42:03.585019 | aio | Create a volume group for each loop device ------------------------------ 1.42s
2026-08-18 14:42:03.585023 | aio | Create a logical volume for each loop device ---------------------------- 1.34s
2026-08-18 14:42:03.585027 | aio | Gathering Facts --------------------------------------------------------- 1.27s
2026-08-18 14:42:03.585031 | aio | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.81s
2026-08-18 14:42:03.585035 | aio | Gathering Facts --------------------------------------------------------- 0.80s
2026-08-18 14:42:03.585043 | aio | Start loop devices ------------------------------------------------------ 0.80s
2026-08-18 14:42:03.585318 | aio | Set permissions on loopback devices ------------------------------------- 0.78s
2026-08-18 14:42:03.586640 | aio | Configure short hostname ------------------------------------------------ 0.78s
2026-08-18 14:42:03.586670 | aio | Start up service -------------------------------------------------------- 0.72s
2026-08-18 14:42:03.586677 | aio | Create devices for Ceph ------------------------------------------------- 0.69s
2026-08-18 14:42:03.586683 | aio | Generate lvm.conf ------------------------------------------------------- 0.34s
2026-08-18 14:42:03.586689 | aio | Ensure hostname inside hosts file --------------------------------------- 0.32s
2026-08-18 14:42:03.586694 | aio | Get list of all loopback devices ---------------------------------------- 0.25s
2026-08-18 14:42:03.586699 | aio | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-08-18 14:42:03.671933 | aio | INFO     [default > prepare] Executed: Successful
2026-08-18 14:42:03.683185 | aio | INFO     [default > converge] Executing
2026-08-18 14:42:04.847275 | aio |
2026-08-18 14:42:04.847655 | aio | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-18 14:42:04.847992 | aio |
2026-08-18 14:42:04.848310 | aio | TASK [Gathering Facts] *********************************************************
2026-08-18 14:42:04.848615 | aio | Tuesday 18 August 2026  14:42:04 +0000 (0:00:00.057)       0:00:00.057 ********
2026-08-18 14:42:06.132719 | aio | [WARNING]: Platform linux on host aio is using the discovered Python
2026-08-18 14:42:06.133126 | aio | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-08-18 14:42:06.133477 | aio | interpreter could change the meaning of that path. See
2026-08-18 14:42:06.133797 | aio | https://docs.ansible.com/ansible-
2026-08-18 14:42:06.134154 | aio | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-18 14:42:06.163224 | aio | ok: [aio]
2026-08-18 14:42:06.163547 | aio |
2026-08-18 14:42:06.163868 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:42:06.164214 | aio | Tuesday 18 August 2026  14:42:06 +0000 (0:00:01.315)       0:00:01.373 ********
2026-08-18 14:42:06.507179 | aio | ok: [aio]
2026-08-18 14:42:06.508108 | aio |
2026-08-18 14:42:06.508185 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:42:06.508197 | aio | Tuesday 18 August 2026  14:42:06 +0000 (0:00:00.343)       0:00:01.717 ********
2026-08-18 14:42:06.555433 | aio | skipping: [aio]
2026-08-18 14:42:06.555555 | aio |
2026-08-18 14:42:06.555804 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:42:06.556196 | aio | Tuesday 18 August 2026  14:42:06 +0000 (0:00:00.048)       0:00:01.765 ********
2026-08-18 14:42:06.968026 | aio | changed: [aio]
2026-08-18 14:42:06.968358 | aio |
2026-08-18 14:42:06.968737 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:42:06.969153 | aio | Tuesday 18 August 2026  14:42:06 +0000 (0:00:00.412)       0:00:02.178 ********
2026-08-18 14:42:07.122980 | aio | ok: [aio] => {
2026-08-18 14:42:07.123368 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:42:07.123601 | aio | }
2026-08-18 14:42:07.123822 | aio |
2026-08-18 14:42:07.124110 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:42:07.124346 | aio | Tuesday 18 August 2026  14:42:07 +0000 (0:00:00.155)       0:00:02.333 ********
2026-08-18 14:42:07.942662 | aio | changed: [aio]
2026-08-18 14:42:07.942814 | aio |
2026-08-18 14:42:07.943151 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:42:07.943375 | aio | Tuesday 18 August 2026  14:42:07 +0000 (0:00:00.819)       0:00:03.152 ********
2026-08-18 14:42:07.993944 | aio | skipping: [aio]
2026-08-18 14:42:07.994072 | aio |
2026-08-18 14:42:07.994430 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:42:07.994720 | aio | Tuesday 18 August 2026  14:42:07 +0000 (0:00:00.051)       0:00:03.204 ********
2026-08-18 14:42:08.046965 | aio | skipping: [aio]
2026-08-18 14:42:08.047356 | aio |
2026-08-18 14:42:08.047675 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:42:08.047959 | aio | Tuesday 18 August 2026  14:42:08 +0000 (0:00:00.053)       0:00:03.257 ********
2026-08-18 14:42:08.347639 | aio | ok: [aio]
2026-08-18 14:42:08.347742 | aio |
2026-08-18 14:42:08.348143 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:42:08.348311 | aio | Tuesday 18 August 2026  14:42:08 +0000 (0:00:00.299)       0:00:03.557 ********
2026-08-18 14:42:09.451077 | aio | ok: [aio]
2026-08-18 14:42:09.451257 | aio |
2026-08-18 14:42:09.451519 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:42:09.451808 | aio | Tuesday 18 August 2026  14:42:09 +0000 (0:00:01.103)       0:00:04.661 ********
2026-08-18 14:42:09.649370 | aio | ok: [aio] => {
2026-08-18 14:42:09.649575 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:42:09.649858 | aio | }
2026-08-18 14:42:09.650158 | aio |
2026-08-18 14:42:09.650403 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:42:09.650707 | aio | Tuesday 18 August 2026  14:42:09 +0000 (0:00:00.198)       0:00:04.859 ********
2026-08-18 14:42:10.925742 | aio | changed: [aio]
2026-08-18 14:42:10.926022 | aio |
2026-08-18 14:42:10.926333 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:42:10.926614 | aio | Tuesday 18 August 2026  14:42:10 +0000 (0:00:01.276)       0:00:06.135 ********
2026-08-18 14:42:14.113480 | aio | changed: [aio]
2026-08-18 14:42:14.113514 | aio |
2026-08-18 14:42:14.113519 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:42:14.113533 | aio | Tuesday 18 August 2026  14:42:14 +0000 (0:00:03.187)       0:00:09.323 ********
2026-08-18 14:42:14.150994 | aio | skipping: [aio]
2026-08-18 14:42:14.151072 | aio |
2026-08-18 14:42:14.151083 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:42:14.151099 | aio | Tuesday 18 August 2026  14:42:14 +0000 (0:00:00.036)       0:00:09.360 ********
2026-08-18 14:42:14.188016 | aio | skipping: [aio]
2026-08-18 14:42:14.188076 | aio |
2026-08-18 14:42:14.188093 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:42:14.188289 | aio | Tuesday 18 August 2026  14:42:14 +0000 (0:00:00.036)       0:00:09.397 ********
2026-08-18 14:42:14.224407 | aio | skipping: [aio]
2026-08-18 14:42:14.224486 | aio |
2026-08-18 14:42:14.224662 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:42:14.224777 | aio | Tuesday 18 August 2026  14:42:14 +0000 (0:00:00.037)       0:00:09.434 ********
2026-08-18 14:42:21.584532 | aio | changed: [aio]
2026-08-18 14:42:21.584598 | aio |
2026-08-18 14:42:21.584691 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:42:21.584797 | aio | Tuesday 18 August 2026  14:42:21 +0000 (0:00:07.359)       0:00:16.794 ********
2026-08-18 14:42:22.313547 | aio | changed: [aio]
2026-08-18 14:42:22.313619 | aio |
2026-08-18 14:42:22.313623 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:42:22.313628 | aio | Tuesday 18 August 2026  14:42:22 +0000 (0:00:00.719)       0:00:17.513 ********
2026-08-18 14:42:23.487525 | aio | changed: [aio] => (item={'path': '/etc/containerd'})
2026-08-18 14:42:23.487615 | aio | changed: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:42:23.487692 | aio | changed: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:42:23.487832 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:42:23.487981 | aio | changed: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:42:23.488099 | aio |
2026-08-18 14:42:23.488211 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:42:23.488359 | aio | Tuesday 18 August 2026  14:42:23 +0000 (0:00:01.183)       0:00:18.697 ********
2026-08-18 14:42:24.253370 | aio | changed: [aio]
2026-08-18 14:42:24.253433 | aio |
2026-08-18 14:42:24.253444 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:42:24.253454 | aio | Tuesday 18 August 2026  14:42:24 +0000 (0:00:00.754)       0:00:19.451 ********
2026-08-18 14:42:24.253462 | aio |
2026-08-18 14:42:24.253471 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 14:42:24.253479 | aio | Tuesday 18 August 2026  14:42:24 +0000 (0:00:00.008)       0:00:19.460 ********
2026-08-18 14:42:25.365410 | aio | ok: [aio]
2026-08-18 14:42:25.365493 | aio |
2026-08-18 14:42:25.365548 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-18 14:42:25.365658 | aio | Tuesday 18 August 2026  14:42:25 +0000 (0:00:01.113)       0:00:20.574 ********
2026-08-18 14:42:25.965859 | aio | changed: [aio]
2026-08-18 14:42:25.965971 | aio |
2026-08-18 14:42:25.965976 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:42:25.965981 | aio | Tuesday 18 August 2026  14:42:25 +0000 (0:00:00.601)       0:00:21.175 ********
2026-08-18 14:42:26.704597 | aio | changed: [aio]
2026-08-18 14:42:26.704657 | aio |
2026-08-18 14:42:26.704667 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:42:26.704677 | aio | Tuesday 18 August 2026  14:42:26 +0000 (0:00:00.738)       0:00:21.913 ********
2026-08-18 14:42:26.969690 | aio | ok: [aio]
2026-08-18 14:42:26.969779 | aio |
2026-08-18 14:42:26.969791 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:42:26.969802 | aio | Tuesday 18 August 2026  14:42:26 +0000 (0:00:00.264)       0:00:22.178 ********
2026-08-18 14:42:27.053056 | aio | ok: [aio] => {
2026-08-18 14:42:27.054468 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:42:27.054526 | aio | }
2026-08-18 14:42:27.054536 | aio |
2026-08-18 14:42:27.054546 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:42:27.054555 | aio | Tuesday 18 August 2026  14:42:27 +0000 (0:00:00.083)       0:00:22.262 ********
2026-08-18 14:42:28.826520 | aio | changed: [aio]
2026-08-18 14:42:28.826582 | aio |
2026-08-18 14:42:28.826596 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:42:28.826608 | aio | Tuesday 18 August 2026  14:42:28 +0000 (0:00:01.772)       0:00:24.035 ********
2026-08-18 14:42:33.476965 | aio | changed: [aio]
2026-08-18 14:42:33.477835 | aio |
2026-08-18 14:42:33.477861 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:42:33.477874 | aio | Tuesday 18 August 2026  14:42:33 +0000 (0:00:04.650)       0:00:28.686 ********
2026-08-18 14:42:34.399055 | aio | ok: [aio]
2026-08-18 14:42:34.399128 | aio |
2026-08-18 14:42:34.399216 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:42:34.399530 | aio | Tuesday 18 August 2026  14:42:34 +0000 (0:00:00.922)       0:00:29.608 ********
2026-08-18 14:42:34.787844 | aio | changed: [aio]
2026-08-18 14:42:34.788075 | aio |
2026-08-18 14:42:34.788336 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:42:34.788589 | aio | Tuesday 18 August 2026  14:42:34 +0000 (0:00:00.388)       0:00:29.997 ********
2026-08-18 14:42:35.376757 | aio | changed: [aio]
2026-08-18 14:42:35.377012 | aio |
2026-08-18 14:42:35.377264 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:42:35.377513 | aio | Tuesday 18 August 2026  14:42:35 +0000 (0:00:00.589)       0:00:30.587 ********
2026-08-18 14:42:36.094030 | aio | changed: [aio] => (item={'path': '/etc/docker'})
2026-08-18 14:42:36.094098 | aio | changed: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:42:36.095065 | aio | changed: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:42:36.095132 | aio |
2026-08-18 14:42:36.095144 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:42:36.095161 | aio | Tuesday 18 August 2026  14:42:36 +0000 (0:00:00.716)       0:00:31.303 ********
2026-08-18 14:42:36.672657 | aio | changed: [aio]
2026-08-18 14:42:36.672708 | aio |
2026-08-18 14:42:36.672723 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:42:36.672737 | aio | Tuesday 18 August 2026  14:42:36 +0000 (0:00:00.577)       0:00:31.881 ********
2026-08-18 14:42:37.261197 | aio | changed: [aio]
2026-08-18 14:42:37.261251 | aio |
2026-08-18 14:42:37.261265 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:42:37.261279 | aio | Tuesday 18 August 2026  14:42:37 +0000 (0:00:00.580)       0:00:32.461 ********
2026-08-18 14:42:37.261291 | aio |
2026-08-18 14:42:37.261302 | aio | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-18 14:42:37.261314 | aio | Tuesday 18 August 2026  14:42:37 +0000 (0:00:00.008)       0:00:32.469 ********
2026-08-18 14:42:38.168963 | aio | ok: [aio]
2026-08-18 14:42:38.169038 | aio |
2026-08-18 14:42:38.169309 | aio | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-18 14:42:38.169355 | aio | Tuesday 18 August 2026  14:42:38 +0000 (0:00:00.909)       0:00:33.379 ********
2026-08-18 14:42:39.401713 | aio | changed: [aio]
2026-08-18 14:42:39.401793 | aio |
2026-08-18 14:42:39.401808 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:42:39.401822 | aio | Tuesday 18 August 2026  14:42:39 +0000 (0:00:01.231)       0:00:34.610 ********
2026-08-18 14:42:40.103968 | aio | changed: [aio]
2026-08-18 14:42:40.104017 | aio |
2026-08-18 14:42:40.104024 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:42:40.104030 | aio | Tuesday 18 August 2026  14:42:40 +0000 (0:00:00.702)       0:00:35.313 ********
2026-08-18 14:42:40.150921 | aio | ok: [aio] => {
2026-08-18 14:42:40.150956 | aio |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:42:40.150960 | aio | }
2026-08-18 14:42:40.150964 | aio |
2026-08-18 14:42:40.150968 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:42:40.150972 | aio | Tuesday 18 August 2026  14:42:40 +0000 (0:00:00.047)       0:00:35.360 ********
2026-08-18 14:42:41.152732 | aio | changed: [aio]
2026-08-18 14:42:41.152792 | aio |
2026-08-18 14:42:41.152803 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:42:41.152812 | aio | Tuesday 18 August 2026  14:42:41 +0000 (0:00:01.000)       0:00:36.361 ********
2026-08-18 14:42:41.207955 | aio | skipping: [aio]
2026-08-18 14:42:41.207988 | aio |
2026-08-18 14:42:41.208129 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:42:41.208488 | aio | Tuesday 18 August 2026  14:42:41 +0000 (0:00:00.056)       0:00:36.418 ********
2026-08-18 14:42:41.266852 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 14:42:41.267280 | aio |
2026-08-18 14:42:41.267654 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:42:41.268009 | aio | Tuesday 18 August 2026  14:42:41 +0000 (0:00:00.059)       0:00:36.477 ********
2026-08-18 14:42:42.176432 | aio | ok: [aio]
2026-08-18 14:42:42.176612 | aio |
2026-08-18 14:42:42.176765 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:42:42.176948 | aio | Tuesday 18 August 2026  14:42:42 +0000 (0:00:00.909)       0:00:37.386 ********
2026-08-18 14:42:42.967994 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-08-18 14:42:42.968197 | aio | ok: [aio] => (item=ssh)
2026-08-18 14:42:42.968430 | aio |
2026-08-18 14:42:42.968694 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:42:42.968985 | aio | Tuesday 18 August 2026  14:42:42 +0000 (0:00:00.791)       0:00:38.178 ********
2026-08-18 14:42:43.207932 | aio | ok: [aio]
2026-08-18 14:42:43.209032 | aio |
2026-08-18 14:42:43.209078 | aio | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:42:43.209085 | aio | Tuesday 18 August 2026  14:42:43 +0000 (0:00:00.239)       0:00:38.418 ********
2026-08-18 14:42:43.709457 | aio | changed: [aio]
2026-08-18 14:42:43.709516 | aio |
2026-08-18 14:42:43.709629 | aio | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:42:43.709739 | aio | Tuesday 18 August 2026  14:42:43 +0000 (0:00:00.500)       0:00:38.918 ********
2026-08-18 14:42:44.289026 | aio | changed: [aio]
2026-08-18 14:42:44.289103 | aio |
2026-08-18 14:42:44.289236 | aio | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:42:44.289493 | aio | Tuesday 18 August 2026  14:42:44 +0000 (0:00:00.579)       0:00:39.498 ********
2026-08-18 14:42:44.326600 | aio | skipping: [aio]
2026-08-18 14:42:44.326808 | aio |
2026-08-18 14:42:44.327133 | aio | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:42:44.327375 | aio | Tuesday 18 August 2026  14:42:44 +0000 (0:00:00.038)       0:00:39.537 ********
2026-08-18 14:43:26.102697 | aio | changed: [aio]
2026-08-18 14:43:26.102776 | aio |
2026-08-18 14:43:26.102958 | aio | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:43:26.103098 | aio | Tuesday 18 August 2026  14:43:26 +0000 (0:00:41.774)       0:01:21.312 ********
2026-08-18 14:43:26.682492 | aio | changed: [aio]
2026-08-18 14:43:26.682725 | aio |
2026-08-18 14:43:26.683020 | aio | TASK [vexxhost.ceph.mon : Find this monitor's addresses on the public network] ***
2026-08-18 14:43:26.683275 | aio | Tuesday 18 August 2026  14:43:26 +0000 (0:00:00.580)       0:01:21.892 ********
2026-08-18 14:43:26.808761 | aio | ok: [aio]
2026-08-18 14:43:26.809102 | aio |
2026-08-18 14:43:26.809269 | aio | TASK [vexxhost.ceph.mon : Assert exactly one address matches the public network] ***
2026-08-18 14:43:26.809517 | aio | Tuesday 18 August 2026  14:43:26 +0000 (0:00:00.126)       0:01:22.019 ********
2026-08-18 14:43:26.845206 | aio | ok: [aio] => {
2026-08-18 14:43:26.845411 | aio |     "changed": false,
2026-08-18 14:43:26.845663 | aio |     "msg": "All assertions passed"
2026-08-18 14:43:26.845929 | aio | }
2026-08-18 14:43:26.846147 | aio |
2026-08-18 14:43:26.846584 | aio | TASK [vexxhost.ceph.mon : Set this monitor's Ceph public IP] *******************
2026-08-18 14:43:26.846839 | aio | Tuesday 18 August 2026  14:43:26 +0000 (0:00:00.036)       0:01:22.056 ********
2026-08-18 14:43:26.890390 | aio | ok: [aio]
2026-08-18 14:43:26.890560 | aio |
2026-08-18 14:43:26.890813 | aio | TASK [vexxhost.ceph.mon : Check whether any monitor is already bootstrapped] ***
2026-08-18 14:43:26.891118 | aio | Tuesday 18 August 2026  14:43:26 +0000 (0:00:00.045)       0:01:22.101 ********
2026-08-18 14:43:27.151059 | aio | ok: [aio] => (item=aio)
2026-08-18 14:43:27.151126 | aio |
2026-08-18 14:43:27.151623 | aio | TASK [vexxhost.ceph.mon : Select the bootstrap node (existing one, else the first monitor)] ***
2026-08-18 14:43:27.151692 | aio | Tuesday 18 August 2026  14:43:27 +0000 (0:00:00.259)       0:01:22.360 ********
2026-08-18 14:43:27.208538 | aio | ok: [aio]
2026-08-18 14:43:27.208649 | aio |
2026-08-18 14:43:27.208730 | aio | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 14:43:27.208852 | aio | Tuesday 18 August 2026  14:43:27 +0000 (0:00:00.057)       0:01:22.418 ********
2026-08-18 14:43:27.299050 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap.yml for aio
2026-08-18 14:43:27.299094 | aio |
2026-08-18 14:43:27.299099 | aio | TASK [vexxhost.ceph.mon : Ensure /etc/ceph exists] *****************************
2026-08-18 14:43:27.299105 | aio | Tuesday 18 August 2026  14:43:27 +0000 (0:00:00.090)       0:01:22.508 ********
2026-08-18 14:43:27.560420 | aio | changed: [aio]
2026-08-18 14:43:27.560475 | aio |
2026-08-18 14:43:27.560596 | aio | TASK [vexxhost.ceph.mon : Write the caller-provided SSH private key] ***********
2026-08-18 14:43:27.560707 | aio | Tuesday 18 August 2026  14:43:27 +0000 (0:00:00.261)       0:01:22.770 ********
2026-08-18 14:43:27.601007 | aio | skipping: [aio]
2026-08-18 14:43:27.601937 | aio |
2026-08-18 14:43:27.601970 | aio | TASK [vexxhost.ceph.mon : Write the caller-provided SSH public key] ************
2026-08-18 14:43:27.602167 | aio | Tuesday 18 August 2026  14:43:27 +0000 (0:00:00.040)       0:01:22.810 ********
2026-08-18 14:43:27.640076 | aio | skipping: [aio]
2026-08-18 14:43:27.640116 | aio |
2026-08-18 14:43:27.640122 | aio | TASK [vexxhost.ceph.mon : Generate a cephadm SSH keypair when none was provided] ***
2026-08-18 14:43:27.640128 | aio | Tuesday 18 August 2026  14:43:27 +0000 (0:00:00.038)       0:01:22.849 ********
2026-08-18 14:43:29.473065 | aio | changed: [aio]
2026-08-18 14:43:29.473112 | aio |
2026-08-18 14:43:29.473720 | aio | TASK [vexxhost.ceph.mon : Create a temporary ceph.conf for bootstrap overrides] ***
2026-08-18 14:43:29.473782 | aio | Tuesday 18 August 2026  14:43:29 +0000 (0:00:01.833)       0:01:24.682 ********
2026-08-18 14:43:29.804780 | aio | changed: [aio]
2026-08-18 14:43:29.804821 | aio |
2026-08-18 14:43:29.804826 | aio | TASK [vexxhost.ceph.mon : Populate bootstrap ceph.conf overrides] **************
2026-08-18 14:43:29.804831 | aio | Tuesday 18 August 2026  14:43:29 +0000 (0:00:00.331)       0:01:25.014 ********
2026-08-18 14:43:29.835927 | aio | skipping: [aio]
2026-08-18 14:43:29.835965 | aio |
2026-08-18 14:43:29.835971 | aio | TASK [vexxhost.ceph.mon : Bootstrap the cluster] *******************************
2026-08-18 14:43:29.835976 | aio | Tuesday 18 August 2026  14:43:29 +0000 (0:00:00.031)       0:01:25.045 ********
2026-08-18 14:44:12.255040 | aio | changed: [aio]
2026-08-18 14:44:12.255853 | aio |
2026-08-18 14:44:12.255957 | aio | TASK [vexxhost.ceph.mon : Remove the temporary ceph.conf] **********************
2026-08-18 14:44:12.255987 | aio | Tuesday 18 August 2026  14:44:12 +0000 (0:00:42.419)       0:02:07.465 ********
2026-08-18 14:44:12.524466 | aio | changed: [aio]
2026-08-18 14:44:12.524542 | aio |
2026-08-18 14:44:12.524634 | aio | TASK [Register this monitor host] **********************************************
2026-08-18 14:44:12.524735 | aio | Tuesday 18 August 2026  14:44:12 +0000 (0:00:00.268)       0:02:07.733 ********
2026-08-18 14:44:12.605794 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-08-18 14:44:12.605880 | aio |
2026-08-18 14:44:12.606025 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:44:12.606160 | aio | Tuesday 18 August 2026  14:44:12 +0000 (0:00:00.083)       0:02:07.816 ********
2026-08-18 14:44:14.417947 | aio | ok: [aio]
2026-08-18 14:44:14.418003 | aio |
2026-08-18 14:44:14.418011 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:44:14.418019 | aio | Tuesday 18 August 2026  14:44:14 +0000 (0:00:01.809)       0:02:09.626 ********
2026-08-18 14:44:14.472942 | aio | ok: [aio]
2026-08-18 14:44:14.473125 | aio |
2026-08-18 14:44:14.473275 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:44:14.473419 | aio | Tuesday 18 August 2026  14:44:14 +0000 (0:00:00.057)       0:02:09.683 ********
2026-08-18 14:44:14.526972 | aio | ok: [aio] => {
2026-08-18 14:44:14.527362 | aio |     "changed": false,
2026-08-18 14:44:14.528701 | aio |     "msg": "All assertions passed"
2026-08-18 14:44:14.528730 | aio | }
2026-08-18 14:44:14.528743 | aio |
2026-08-18 14:44:14.528755 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:44:14.528767 | aio | Tuesday 18 August 2026  14:44:14 +0000 (0:00:00.053)       0:02:09.736 ********
2026-08-18 14:44:14.985476 | aio | ok: [aio]
2026-08-18 14:44:14.985557 | aio |
2026-08-18 14:44:14.985636 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:44:14.985751 | aio | Tuesday 18 August 2026  14:44:14 +0000 (0:00:00.456)       0:02:10.193 ********
2026-08-18 14:44:15.045615 | aio | ok: [aio]
2026-08-18 14:44:15.045692 | aio |
2026-08-18 14:44:15.045873 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:44:15.046073 | aio | Tuesday 18 August 2026  14:44:15 +0000 (0:00:00.062)       0:02:10.255 ********
2026-08-18 14:44:15.142453 | aio | ok: [aio]
2026-08-18 14:44:15.142587 | aio |
2026-08-18 14:44:15.142834 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:44:15.142931 | aio | Tuesday 18 August 2026  14:44:15 +0000 (0:00:00.093)       0:02:10.349 ********
2026-08-18 14:44:15.203686 | aio | ok: [aio] => {
2026-08-18 14:44:15.203755 | aio |     "changed": false,
2026-08-18 14:44:15.203872 | aio |     "msg": "All assertions passed"
2026-08-18 14:44:15.204009 | aio | }
2026-08-18 14:44:15.204117 | aio |
2026-08-18 14:44:15.204232 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:44:15.204337 | aio | Tuesday 18 August 2026  14:44:15 +0000 (0:00:00.064)       0:02:10.414 ********
2026-08-18 14:44:23.223881 | aio | changed: [aio]
2026-08-18 14:44:23.223997 | aio |
2026-08-18 14:44:23.224096 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:44:23.224221 | aio | Tuesday 18 August 2026  14:44:23 +0000 (0:00:08.020)       0:02:18.434 ********
2026-08-18 14:44:23.288678 | aio | skipping: [aio]
2026-08-18 14:44:23.288766 | aio |
2026-08-18 14:44:23.288775 | aio | TASK [vexxhost.ceph.mon : Apply the monitor service spec] **********************
2026-08-18 14:44:23.288783 | aio | Tuesday 18 August 2026  14:44:23 +0000 (0:00:00.061)       0:02:18.495 ********
2026-08-18 14:44:26.712141 | aio | changed: [aio]
2026-08-18 14:44:26.712339 | aio |
2026-08-18 14:44:26.712492 | aio | TASK [vexxhost.ceph.mon : Wait for this monitor's daemon to be present] ********
2026-08-18 14:44:26.712682 | aio | Tuesday 18 August 2026  14:44:26 +0000 (0:00:03.417)       0:02:21.913 ********
2026-08-18 14:44:28.554511 | aio | ok: [aio]
2026-08-18 14:44:28.554621 | aio |
2026-08-18 14:44:28.554682 | aio | TASK [vexxhost.ceph.mgr : Locate the cluster admin host] ***********************
2026-08-18 14:44:28.554795 | aio | Tuesday 18 August 2026  14:44:28 +0000 (0:00:01.850)       0:02:23.764 ********
2026-08-18 14:44:28.865303 | aio | ok: [aio] => (item=aio)
2026-08-18 14:44:28.865370 | aio |
2026-08-18 14:44:28.865485 | aio | TASK [vexxhost.ceph.mgr : Select the admin host] *******************************
2026-08-18 14:44:28.865618 | aio | Tuesday 18 August 2026  14:44:28 +0000 (0:00:00.311)       0:02:24.075 ********
2026-08-18 14:44:28.934329 | aio | ok: [aio]
2026-08-18 14:44:28.934390 | aio |
2026-08-18 14:44:28.934397 | aio | TASK [Register this manager host] **********************************************
2026-08-18 14:44:28.934403 | aio | Tuesday 18 August 2026  14:44:28 +0000 (0:00:00.068)       0:02:24.144 ********
2026-08-18 14:44:29.029284 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-08-18 14:44:29.029353 | aio |
2026-08-18 14:44:29.029367 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:44:29.029381 | aio | Tuesday 18 August 2026  14:44:29 +0000 (0:00:00.091)       0:02:24.235 ********
2026-08-18 14:44:30.887055 | aio | ok: [aio]
2026-08-18 14:44:30.887121 | aio |
2026-08-18 14:44:30.887135 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:44:30.887147 | aio | Tuesday 18 August 2026  14:44:30 +0000 (0:00:01.861)       0:02:26.096 ********
2026-08-18 14:44:30.935650 | aio | ok: [aio]
2026-08-18 14:44:30.935822 | aio |
2026-08-18 14:44:30.936138 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:44:30.936397 | aio | Tuesday 18 August 2026  14:44:30 +0000 (0:00:00.049)       0:02:26.146 ********
2026-08-18 14:44:30.994159 | aio | ok: [aio] => {
2026-08-18 14:44:30.994386 | aio |     "changed": false,
2026-08-18 14:44:30.994671 | aio |     "msg": "All assertions passed"
2026-08-18 14:44:30.994945 | aio | }
2026-08-18 14:44:30.995160 | aio |
2026-08-18 14:44:30.995439 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:44:30.995701 | aio | Tuesday 18 August 2026  14:44:30 +0000 (0:00:00.058)       0:02:26.204 ********
2026-08-18 14:44:31.326767 | aio | ok: [aio]
2026-08-18 14:44:31.326996 | aio |
2026-08-18 14:44:31.327268 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:44:31.327517 | aio | Tuesday 18 August 2026  14:44:31 +0000 (0:00:00.332)       0:02:26.537 ********
2026-08-18 14:44:31.381320 | aio | ok: [aio]
2026-08-18 14:44:31.381525 | aio |
2026-08-18 14:44:31.381826 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:44:31.382143 | aio | Tuesday 18 August 2026  14:44:31 +0000 (0:00:00.054)       0:02:26.591 ********
2026-08-18 14:44:31.481458 | aio | ok: [aio]
2026-08-18 14:44:31.481664 | aio |
2026-08-18 14:44:31.481991 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:44:31.482251 | aio | Tuesday 18 August 2026  14:44:31 +0000 (0:00:00.100)       0:02:26.691 ********
2026-08-18 14:44:31.537440 | aio | ok: [aio] => {
2026-08-18 14:44:31.537642 | aio |     "changed": false,
2026-08-18 14:44:31.537959 | aio |     "msg": "All assertions passed"
2026-08-18 14:44:31.538199 | aio | }
2026-08-18 14:44:31.538426 | aio |
2026-08-18 14:44:31.538682 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:44:31.538965 | aio | Tuesday 18 August 2026  14:44:31 +0000 (0:00:00.056)       0:02:26.748 ********
2026-08-18 14:44:33.294446 | aio | ok: [aio]
2026-08-18 14:44:33.294658 | aio |
2026-08-18 14:44:33.294949 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:44:33.295210 | aio | Tuesday 18 August 2026  14:44:33 +0000 (0:00:01.756)       0:02:28.504 ********
2026-08-18 14:44:33.360093 | aio | skipping: [aio]
2026-08-18 14:44:33.360319 | aio |
2026-08-18 14:44:33.360581 | aio | TASK [vexxhost.ceph.mgr : Apply the manager service spec] **********************
2026-08-18 14:44:33.360835 | aio | Tuesday 18 August 2026  14:44:33 +0000 (0:00:00.066)       0:02:28.570 ********
2026-08-18 14:44:36.697758 | aio | changed: [aio]
2026-08-18 14:44:36.697844 | aio |
2026-08-18 14:44:36.697858 | aio | TASK [vexxhost.ceph.mgr : Wait for this manager's daemon to be present] ********
2026-08-18 14:44:36.697871 | aio | Tuesday 18 August 2026  14:44:36 +0000 (0:00:03.336)       0:02:31.906 ********
2026-08-18 14:44:38.643954 | aio | ok: [aio]
2026-08-18 14:44:38.644013 | aio |
2026-08-18 14:44:38.644295 | aio | TASK [vexxhost.ceph.mgr : Configure ceph-mgr modules] **************************
2026-08-18 14:44:38.644394 | aio | Tuesday 18 August 2026  14:44:38 +0000 (0:00:01.946)       0:02:33.853 ********
2026-08-18 14:44:48.996713 | aio | changed: [aio] => (item={'name': 'diskprediction_local'})
2026-08-18 14:44:48.996832 | aio | changed: [aio] => (item={'name': 'dashboard'})
2026-08-18 14:44:48.996847 | aio | ok: [aio] => (item={'name': 'iostat'})
2026-08-18 14:44:48.996962 | aio | changed: [aio] => (item={'name': 'prometheus'})
2026-08-18 14:44:48.997090 | aio | changed: [aio] => (item={'name': 'rgw'})
2026-08-18 14:44:48.997196 | aio |
2026-08-18 14:44:48.997325 | aio | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-18 14:44:48.997431 | aio |
2026-08-18 14:44:48.997545 | aio | TASK [Gathering Facts] *********************************************************
2026-08-18 14:44:48.997656 | aio | Tuesday 18 August 2026  14:44:48 +0000 (0:00:10.351)       0:02:44.204 ********
2026-08-18 14:44:50.086422 | aio | ok: [aio]
2026-08-18 14:44:50.086469 | aio |
2026-08-18 14:44:50.086476 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:44:50.086482 | aio | Tuesday 18 August 2026  14:44:50 +0000 (0:00:01.092)       0:02:45.296 ********
2026-08-18 14:44:50.359600 | aio | ok: [aio]
2026-08-18 14:44:50.359664 | aio |
2026-08-18 14:44:50.359677 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:44:50.359690 | aio | Tuesday 18 August 2026  14:44:50 +0000 (0:00:00.271)       0:02:45.568 ********
2026-08-18 14:44:50.403766 | aio | skipping: [aio]
2026-08-18 14:44:50.403851 | aio |
2026-08-18 14:44:50.403869 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:44:50.403933 | aio | Tuesday 18 August 2026  14:44:50 +0000 (0:00:00.044)       0:02:45.612 ********
2026-08-18 14:44:50.679407 | aio | ok: [aio]
2026-08-18 14:44:50.679512 | aio |
2026-08-18 14:44:50.679527 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:44:50.679630 | aio | Tuesday 18 August 2026  14:44:50 +0000 (0:00:00.274)       0:02:45.887 ********
2026-08-18 14:44:50.752816 | aio | ok: [aio] => {
2026-08-18 14:44:50.752946 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:44:50.752970 | aio | }
2026-08-18 14:44:50.753069 | aio |
2026-08-18 14:44:50.753170 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:44:50.753288 | aio | Tuesday 18 August 2026  14:44:50 +0000 (0:00:00.076)       0:02:45.963 ********
2026-08-18 14:44:51.158963 | aio | ok: [aio]
2026-08-18 14:44:51.159009 | aio |
2026-08-18 14:44:51.159015 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:44:51.159022 | aio | Tuesday 18 August 2026  14:44:51 +0000 (0:00:00.404)       0:02:46.367 ********
2026-08-18 14:44:51.209664 | aio | skipping: [aio]
2026-08-18 14:44:51.209752 | aio |
2026-08-18 14:44:51.210041 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:44:51.210069 | aio | Tuesday 18 August 2026  14:44:51 +0000 (0:00:00.051)       0:02:46.419 ********
2026-08-18 14:44:51.268537 | aio | skipping: [aio]
2026-08-18 14:44:51.268595 | aio |
2026-08-18 14:44:51.268643 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:44:51.268659 | aio | Tuesday 18 August 2026  14:44:51 +0000 (0:00:00.057)       0:02:46.477 ********
2026-08-18 14:44:51.519806 | aio | ok: [aio]
2026-08-18 14:44:51.519853 | aio |
2026-08-18 14:44:51.519861 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:44:51.519868 | aio | Tuesday 18 August 2026  14:44:51 +0000 (0:00:00.250)       0:02:46.727 ********
2026-08-18 14:44:52.777211 | aio | ok: [aio]
2026-08-18 14:44:52.777302 | aio |
2026-08-18 14:44:52.777316 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:44:52.777416 | aio | Tuesday 18 August 2026  14:44:52 +0000 (0:00:01.259)       0:02:47.987 ********
2026-08-18 14:44:52.862436 | aio | ok: [aio] => {
2026-08-18 14:44:52.862652 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:44:52.862759 | aio | }
2026-08-18 14:44:52.862862 | aio |
2026-08-18 14:44:52.863001 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:44:52.863104 | aio | Tuesday 18 August 2026  14:44:52 +0000 (0:00:00.081)       0:02:48.069 ********
2026-08-18 14:44:53.281806 | aio | ok: [aio]
2026-08-18 14:44:53.281913 | aio |
2026-08-18 14:44:53.281967 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:44:53.282135 | aio | Tuesday 18 August 2026  14:44:53 +0000 (0:00:00.422)       0:02:48.492 ********
2026-08-18 14:44:55.480496 | aio | ok: [aio]
2026-08-18 14:44:55.480625 | aio |
2026-08-18 14:44:55.480640 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:44:55.480750 | aio | Tuesday 18 August 2026  14:44:55 +0000 (0:00:02.197)       0:02:50.689 ********
2026-08-18 14:44:55.519254 | aio | skipping: [aio]
2026-08-18 14:44:55.519367 | aio |
2026-08-18 14:44:55.519529 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:44:55.519685 | aio | Tuesday 18 August 2026  14:44:55 +0000 (0:00:00.039)       0:02:50.729 ********
2026-08-18 14:44:55.562280 | aio | skipping: [aio]
2026-08-18 14:44:55.562338 | aio |
2026-08-18 14:44:55.562445 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:44:55.562556 | aio | Tuesday 18 August 2026  14:44:55 +0000 (0:00:00.042)       0:02:50.772 ********
2026-08-18 14:44:55.602760 | aio | skipping: [aio]
2026-08-18 14:44:55.602839 | aio |
2026-08-18 14:44:55.602853 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:44:55.602867 | aio | Tuesday 18 August 2026  14:44:55 +0000 (0:00:00.038)       0:02:50.811 ********
2026-08-18 14:44:56.840533 | aio | ok: [aio]
2026-08-18 14:44:56.840592 | aio |
2026-08-18 14:44:56.840606 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:44:56.840618 | aio | Tuesday 18 August 2026  14:44:56 +0000 (0:00:01.237)       0:02:52.049 ********
2026-08-18 14:44:57.383668 | aio | ok: [aio]
2026-08-18 14:44:57.383722 | aio |
2026-08-18 14:44:57.383728 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:44:57.383734 | aio | Tuesday 18 August 2026  14:44:57 +0000 (0:00:00.542)       0:02:52.591 ********
2026-08-18 14:44:58.571595 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-08-18 14:44:58.571684 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:44:58.571776 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:44:58.571919 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:44:58.572039 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:44:58.572144 | aio |
2026-08-18 14:44:58.572254 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:44:58.572367 | aio | Tuesday 18 August 2026  14:44:58 +0000 (0:00:01.190)       0:02:53.782 ********
2026-08-18 14:44:59.283344 | aio | ok: [aio]
2026-08-18 14:44:59.283426 | aio |
2026-08-18 14:44:59.283522 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:44:59.283654 | aio | Tuesday 18 August 2026  14:44:59 +0000 (0:00:00.703)       0:02:54.485 ********
2026-08-18 14:44:59.283758 | aio |
2026-08-18 14:44:59.283879 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:44:59.284051 | aio | Tuesday 18 August 2026  14:44:59 +0000 (0:00:00.006)       0:02:54.492 ********
2026-08-18 14:44:59.751512 | aio | ok: [aio]
2026-08-18 14:44:59.751582 | aio |
2026-08-18 14:44:59.751879 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:44:59.751943 | aio | Tuesday 18 August 2026  14:44:59 +0000 (0:00:00.469)       0:02:54.961 ********
2026-08-18 14:45:00.032659 | aio | ok: [aio]
2026-08-18 14:45:00.032725 | aio |
2026-08-18 14:45:00.032738 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:45:00.032776 | aio | Tuesday 18 August 2026  14:45:00 +0000 (0:00:00.280)       0:02:55.242 ********
2026-08-18 14:45:00.099043 | aio | ok: [aio] => {
2026-08-18 14:45:00.100344 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:45:00.100419 | aio | }
2026-08-18 14:45:00.100430 | aio |
2026-08-18 14:45:00.100440 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:45:00.100450 | aio | Tuesday 18 August 2026  14:45:00 +0000 (0:00:00.066)       0:02:55.308 ********
2026-08-18 14:45:00.546625 | aio | ok: [aio]
2026-08-18 14:45:00.546683 | aio |
2026-08-18 14:45:00.546697 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:45:00.546710 | aio | Tuesday 18 August 2026  14:45:00 +0000 (0:00:00.446)       0:02:55.755 ********
2026-08-18 14:45:03.884041 | aio | ok: [aio]
2026-08-18 14:45:03.884674 | aio |
2026-08-18 14:45:03.884705 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:45:03.885081 | aio | Tuesday 18 August 2026  14:45:03 +0000 (0:00:03.339)       0:02:59.094 ********
2026-08-18 14:45:04.790379 | aio | ok: [aio]
2026-08-18 14:45:04.790453 | aio |
2026-08-18 14:45:04.790519 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:45:04.790649 | aio | Tuesday 18 August 2026  14:45:04 +0000 (0:00:00.906)       0:03:00.000 ********
2026-08-18 14:45:05.035516 | aio | ok: [aio]
2026-08-18 14:45:05.035579 | aio |
2026-08-18 14:45:05.035594 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:45:05.035608 | aio | Tuesday 18 August 2026  14:45:05 +0000 (0:00:00.244)       0:03:00.244 ********
2026-08-18 14:45:05.589612 | aio | ok: [aio]
2026-08-18 14:45:05.589669 | aio |
2026-08-18 14:45:05.589683 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:45:05.589695 | aio | Tuesday 18 August 2026  14:45:05 +0000 (0:00:00.552)       0:03:00.797 ********
2026-08-18 14:45:06.290137 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-08-18 14:45:06.290235 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:45:06.291081 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:45:06.291160 | aio |
2026-08-18 14:45:06.291182 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:45:06.291414 | aio | Tuesday 18 August 2026  14:45:06 +0000 (0:00:00.701)       0:03:01.499 ********
2026-08-18 14:45:06.847778 | aio | ok: [aio]
2026-08-18 14:45:06.847852 | aio |
2026-08-18 14:45:06.847865 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:45:06.847879 | aio | Tuesday 18 August 2026  14:45:06 +0000 (0:00:00.557)       0:03:02.057 ********
2026-08-18 14:45:07.404080 | aio | ok: [aio]
2026-08-18 14:45:07.404151 | aio |
2026-08-18 14:45:07.405391 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:45:07.405460 | aio | Tuesday 18 August 2026  14:45:07 +0000 (0:00:00.549)       0:03:02.606 ********
2026-08-18 14:45:07.405474 | aio |
2026-08-18 14:45:07.405487 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:45:07.405499 | aio | Tuesday 18 August 2026  14:45:07 +0000 (0:00:00.006)       0:03:02.613 ********
2026-08-18 14:45:07.868217 | aio | ok: [aio]
2026-08-18 14:45:07.868273 | aio |
2026-08-18 14:45:07.868280 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:45:07.868288 | aio | Tuesday 18 August 2026  14:45:07 +0000 (0:00:00.464)       0:03:03.077 ********
2026-08-18 14:45:07.912062 | aio | ok: [aio] => {
2026-08-18 14:45:07.912138 | aio |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:45:07.912153 | aio | }
2026-08-18 14:45:07.912166 | aio |
2026-08-18 14:45:07.912180 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:45:07.912309 | aio | Tuesday 18 August 2026  14:45:07 +0000 (0:00:00.043)       0:03:03.120 ********
2026-08-18 14:45:08.257586 | aio | ok: [aio]
2026-08-18 14:45:08.257693 | aio |
2026-08-18 14:45:08.257704 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:45:08.257715 | aio | Tuesday 18 August 2026  14:45:08 +0000 (0:00:00.345)       0:03:03.466 ********
2026-08-18 14:45:08.300229 | aio | skipping: [aio]
2026-08-18 14:45:08.300260 | aio |
2026-08-18 14:45:08.300270 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:45:08.300279 | aio | Tuesday 18 August 2026  14:45:08 +0000 (0:00:00.043)       0:03:03.509 ********
2026-08-18 14:45:08.358759 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 14:45:08.358807 | aio |
2026-08-18 14:45:08.358812 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:45:08.358817 | aio | Tuesday 18 August 2026  14:45:08 +0000 (0:00:00.059)       0:03:03.569 ********
2026-08-18 14:45:09.347752 | aio | ok: [aio]
2026-08-18 14:45:09.347832 | aio |
2026-08-18 14:45:09.347843 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:45:09.347854 | aio | Tuesday 18 August 2026  14:45:09 +0000 (0:00:00.987)       0:03:04.556 ********
2026-08-18 14:45:10.166989 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-08-18 14:45:10.167046 | aio | ok: [aio] => (item=ssh)
2026-08-18 14:45:10.167056 | aio |
2026-08-18 14:45:10.167066 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:45:10.167124 | aio | Tuesday 18 August 2026  14:45:10 +0000 (0:00:00.818)       0:03:05.375 ********
2026-08-18 14:45:10.415494 | aio | ok: [aio]
2026-08-18 14:45:10.415566 | aio |
2026-08-18 14:45:10.415577 | aio | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:45:10.415587 | aio | Tuesday 18 August 2026  14:45:10 +0000 (0:00:00.249)       0:03:05.624 ********
2026-08-18 14:45:10.735639 | aio | ok: [aio]
2026-08-18 14:45:10.735845 | aio |
2026-08-18 14:45:10.736149 | aio | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:45:10.736397 | aio | Tuesday 18 August 2026  14:45:10 +0000 (0:00:00.320)       0:03:05.945 ********
2026-08-18 14:45:11.308329 | aio | ok: [aio]
2026-08-18 14:45:11.308502 | aio |
2026-08-18 14:45:11.308776 | aio | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:45:11.309087 | aio | Tuesday 18 August 2026  14:45:11 +0000 (0:00:00.573)       0:03:06.518 ********
2026-08-18 14:45:11.346790 | aio | skipping: [aio]
2026-08-18 14:45:11.346981 | aio |
2026-08-18 14:45:11.347276 | aio | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:45:11.347538 | aio | Tuesday 18 August 2026  14:45:11 +0000 (0:00:00.038)       0:03:06.557 ********
2026-08-18 14:45:11.799452 | aio | ok: [aio]
2026-08-18 14:45:11.799644 | aio |
2026-08-18 14:45:11.799957 | aio | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:45:11.800203 | aio | Tuesday 18 August 2026  14:45:11 +0000 (0:00:00.452)       0:03:07.009 ********
2026-08-18 14:45:12.347412 | aio | ok: [aio]
2026-08-18 14:45:12.347613 | aio |
2026-08-18 14:45:12.347982 | aio | TASK [vexxhost.ceph.osd : Locate the cluster admin host] ***********************
2026-08-18 14:45:12.348236 | aio | Tuesday 18 August 2026  14:45:12 +0000 (0:00:00.548)       0:03:07.557 ********
2026-08-18 14:45:12.634727 | aio | ok: [aio] => (item=aio)
2026-08-18 14:45:12.634794 | aio |
2026-08-18 14:45:12.634957 | aio | TASK [vexxhost.ceph.osd : Select the admin host and its mon config path] *******
2026-08-18 14:45:12.635069 | aio | Tuesday 18 August 2026  14:45:12 +0000 (0:00:00.287)       0:03:07.845 ********
2026-08-18 14:45:12.689062 | aio | ok: [aio]
2026-08-18 14:45:12.689103 | aio |
2026-08-18 14:45:12.689230 | aio | TASK [vexxhost.ceph.osd : Set the admin mon config path] ***********************
2026-08-18 14:45:12.689340 | aio | Tuesday 18 August 2026  14:45:12 +0000 (0:00:00.054)       0:03:07.899 ********
2026-08-18 14:45:12.749332 | aio | ok: [aio]
2026-08-18 14:45:12.749384 | aio |
2026-08-18 14:45:12.749493 | aio | TASK [Register this OSD host] **************************************************
2026-08-18 14:45:12.749602 | aio | Tuesday 18 August 2026  14:45:12 +0000 (0:00:00.060)       0:03:07.960 ********
2026-08-18 14:45:12.816974 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-08-18 14:45:12.817157 | aio |
2026-08-18 14:45:12.817408 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:45:12.817657 | aio | Tuesday 18 August 2026  14:45:12 +0000 (0:00:00.067)       0:03:08.027 ********
2026-08-18 14:45:14.580281 | aio | ok: [aio]
2026-08-18 14:45:14.580491 | aio |
2026-08-18 14:45:14.580784 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:45:14.581135 | aio | Tuesday 18 August 2026  14:45:14 +0000 (0:00:01.762)       0:03:09.790 ********
2026-08-18 14:45:14.628345 | aio | ok: [aio]
2026-08-18 14:45:14.628625 | aio |
2026-08-18 14:45:14.628972 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:45:14.629372 | aio | Tuesday 18 August 2026  14:45:14 +0000 (0:00:00.048)       0:03:09.838 ********
2026-08-18 14:45:14.675518 | aio | ok: [aio] => {
2026-08-18 14:45:14.675723 | aio |     "changed": false,
2026-08-18 14:45:14.676021 | aio |     "msg": "All assertions passed"
2026-08-18 14:45:14.676253 | aio | }
2026-08-18 14:45:14.676464 | aio |
2026-08-18 14:45:14.676729 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:45:14.677047 | aio | Tuesday 18 August 2026  14:45:14 +0000 (0:00:00.047)       0:03:09.886 ********
2026-08-18 14:45:15.020153 | aio | ok: [aio]
2026-08-18 14:45:15.020332 | aio |
2026-08-18 14:45:15.020614 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:45:15.020864 | aio | Tuesday 18 August 2026  14:45:15 +0000 (0:00:00.344)       0:03:10.230 ********
2026-08-18 14:45:15.072374 | aio | ok: [aio]
2026-08-18 14:45:15.072508 | aio |
2026-08-18 14:45:15.072691 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:45:15.072919 | aio | Tuesday 18 August 2026  14:45:15 +0000 (0:00:00.052)       0:03:10.282 ********
2026-08-18 14:45:15.165405 | aio | ok: [aio]
2026-08-18 14:45:15.165599 | aio |
2026-08-18 14:45:15.165855 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:45:15.166144 | aio | Tuesday 18 August 2026  14:45:15 +0000 (0:00:00.093)       0:03:10.375 ********
2026-08-18 14:45:15.220612 | aio | ok: [aio] => {
2026-08-18 14:45:15.220845 | aio |     "changed": false,
2026-08-18 14:45:15.221122 | aio |     "msg": "All assertions passed"
2026-08-18 14:45:15.221350 | aio | }
2026-08-18 14:45:15.221585 | aio |
2026-08-18 14:45:15.221835 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:45:15.222107 | aio | Tuesday 18 August 2026  14:45:15 +0000 (0:00:00.054)       0:03:10.430 ********
2026-08-18 14:45:17.088978 | aio | ok: [aio]
2026-08-18 14:45:17.089131 | aio |
2026-08-18 14:45:17.089396 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:45:17.089648 | aio | Tuesday 18 August 2026  14:45:17 +0000 (0:00:01.868)       0:03:12.299 ********
2026-08-18 14:45:17.145020 | aio | skipping: [aio]
2026-08-18 14:45:17.145120 | aio |
2026-08-18 14:45:17.145310 | aio | TASK [vexxhost.ceph.osd : Apply OSD service specs (drive groups)] **************
2026-08-18 14:45:17.145554 | aio | Tuesday 18 August 2026  14:45:17 +0000 (0:00:00.056)       0:03:12.355 ********
2026-08-18 14:45:17.184434 | aio | skipping: [aio]
2026-08-18 14:45:17.184523 | aio |
2026-08-18 14:45:17.184773 | aio | TASK [vexxhost.ceph.osd : List existing ceph-volume OSDs on this host] *********
2026-08-18 14:45:17.185057 | aio | Tuesday 18 August 2026  14:45:17 +0000 (0:00:00.038)       0:03:12.394 ********
2026-08-18 14:45:18.709381 | aio | ok: [aio]
2026-08-18 14:45:18.709476 | aio |
2026-08-18 14:45:18.709495 | aio | TASK [vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices] ********
2026-08-18 14:45:18.709659 | aio | Tuesday 18 August 2026  14:45:18 +0000 (0:00:01.524)       0:03:13.919 ********
2026-08-18 14:48:04.082986 | aio | changed: [aio] => (item=/dev/ceph-aio-osd0/data)
2026-08-18 14:48:04.083061 | aio | changed: [aio] => (item=/dev/ceph-aio-osd1/data)
2026-08-18 14:48:04.083223 | aio | changed: [aio] => (item=/dev/ceph-aio-osd2/data)
2026-08-18 14:48:04.083304 | aio |
2026-08-18 14:48:04.083528 | aio | TASK [vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host] ***
2026-08-18 14:48:04.083540 | aio | Tuesday 18 August 2026  14:48:04 +0000 (0:02:45.373)       0:05:59.292 ********
2026-08-18 14:48:12.652981 | aio | FAILED - RETRYING: [aio]: Wait for explicitly requested OSD daemons to be running on this host (120 retries left).
2026-08-18 14:48:12.653034 | aio | ok: [aio]
2026-08-18 14:48:12.653040 | aio |
2026-08-18 14:48:12.653046 | aio | TASK [vexxhost.ceph.osd : Wait for OSD drive-group services to deploy at least one daemon] ***
2026-08-18 14:48:12.653052 | aio | Tuesday 18 August 2026  14:48:12 +0000 (0:00:08.569)       0:06:07.862 ********
2026-08-18 14:48:12.720707 | aio | skipping: [aio]
2026-08-18 14:48:12.720732 | aio |
2026-08-18 14:48:12.720738 | aio | PLAY [Apply Ceph configuration] ************************************************
2026-08-18 14:48:12.720744 | aio |
2026-08-18 14:48:12.720749 | aio | TASK [Gathering Facts] *********************************************************
2026-08-18 14:48:12.720754 | aio | Tuesday 18 August 2026  14:48:12 +0000 (0:00:00.067)       0:06:07.929 ********
2026-08-18 14:48:14.733721 | aio | ok: [aio]
2026-08-18 14:48:14.733785 | aio |
2026-08-18 14:48:14.733929 | aio | TASK [vexxhost.ceph.configure : Locate the cluster admin host] *****************
2026-08-18 14:48:14.734053 | aio | Tuesday 18 August 2026  14:48:14 +0000 (0:00:02.014)       0:06:09.944 ********
2026-08-18 14:48:15.024577 | aio | ok: [aio] => (item=aio)
2026-08-18 14:48:15.024671 | aio |
2026-08-18 14:48:15.024850 | aio | TASK [vexxhost.ceph.configure : Select the admin host] *************************
2026-08-18 14:48:15.025047 | aio | Tuesday 18 August 2026  14:48:15 +0000 (0:00:00.289)       0:06:10.233 ********
2026-08-18 14:48:15.080411 | aio | ok: [aio]
2026-08-18 14:48:15.080502 | aio |
2026-08-18 14:48:15.080636 | aio | TASK [vexxhost.ceph.configure : Set the admin mon config path] *****************
2026-08-18 14:48:15.080748 | aio | Tuesday 18 August 2026  14:48:15 +0000 (0:00:00.055)       0:06:10.288 ********
2026-08-18 14:48:15.126723 | aio | ok: [aio]
2026-08-18 14:48:15.126847 | aio |
2026-08-18 14:48:15.127054 | aio | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 14:48:15.127202 | aio | Tuesday 18 August 2026  14:48:15 +0000 (0:00:00.048)       0:06:10.336 ********
2026-08-18 14:48:15.171538 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/config.yml for aio
2026-08-18 14:48:15.171635 | aio |
2026-08-18 14:48:15.171648 | aio | TASK [vexxhost.ceph.configure : Apply central Ceph configuration] **************
2026-08-18 14:48:15.171760 | aio | Tuesday 18 August 2026  14:48:15 +0000 (0:00:00.043)       0:06:10.380 ********
2026-08-18 14:48:34.971164 | aio | changed: [aio] => (item=mgr/mgr/dashboard/standby_behaviour)
2026-08-18 14:48:34.971241 | aio | changed: [aio] => (item=mgr/mgr/dashboard/RGW_API_SSL_VERIFY)
2026-08-18 14:48:34.971415 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_CEPHFS)
2026-08-18 14:48:34.971705 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_ISCSI)
2026-08-18 14:48:34.972991 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_MIRRORING)
2026-08-18 14:48:34.973067 | aio | changed: [aio] => (item=mgr/mgr/dashboard/FEATURE_TOGGLE_NFS)
2026-08-18 14:48:34.973075 | aio |
2026-08-18 14:48:34.973081 | aio | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 14:48:34.973093 | aio | Tuesday 18 August 2026  14:48:34 +0000 (0:00:19.795)       0:06:30.175 ********
2026-08-18 14:48:35.014588 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/ec_profiles.yml for aio
2026-08-18 14:48:35.014656 | aio |
2026-08-18 14:48:35.014783 | aio | TASK [vexxhost.ceph.configure : Configure erasure-code profiles] ***************
2026-08-18 14:48:35.014934 | aio | Tuesday 18 August 2026  14:48:35 +0000 (0:00:00.048)       0:06:30.224 ********
2026-08-18 14:48:39.018264 | aio | changed: [aio] => (item=ec_hdd_s3)
2026-08-18 14:48:39.018385 | aio |
2026-08-18 14:48:39.018529 | aio | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 14:48:39.018712 | aio | Tuesday 18 August 2026  14:48:39 +0000 (0:00:04.003)       0:06:34.228 ********
2026-08-18 14:48:39.070789 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/crush_rules.yml for aio
2026-08-18 14:48:39.071047 | aio |
2026-08-18 14:48:39.071303 | aio | TASK [vexxhost.ceph.configure : Configure CRUSH rules] *************************
2026-08-18 14:48:39.071560 | aio | Tuesday 18 August 2026  14:48:39 +0000 (0:00:00.051)       0:06:34.280 ********
2026-08-18 14:48:51.246118 | aio | changed: [aio] => (item=rep_hdd)
2026-08-18 14:48:51.246216 | aio | changed: [aio] => (item=rep_lab)
2026-08-18 14:48:51.246230 | aio | changed: [aio] => (item=ec_hdd_s3)
2026-08-18 14:48:51.246242 | aio |
2026-08-18 14:48:51.246255 | aio | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 14:48:51.246276 | aio | Tuesday 18 August 2026  14:48:51 +0000 (0:00:12.175)       0:06:46.455 ********
2026-08-18 14:48:51.284408 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/pools.yml for aio
2026-08-18 14:48:51.284453 | aio |
2026-08-18 14:48:51.284596 | aio | TASK [vexxhost.ceph.configure : Configure pools] *******************************
2026-08-18 14:48:51.284709 | aio | Tuesday 18 August 2026  14:48:51 +0000 (0:00:00.039)       0:06:46.494 ********
2026-08-18 14:49:27.910993 | aio | changed: [aio] => (item=molecule-1.rgw.buckets.data)
2026-08-18 14:49:27.911051 | aio | changed: [aio] => (item=molecule-1.rgw.buckets.index)
2026-08-18 14:49:27.911060 | aio | changed: [aio] => (item=molecule-1.rgw.buckets.non-ec)
2026-08-18 14:49:27.911069 | aio | changed: [aio] => (item=molecule-1.rgw.control)
2026-08-18 14:49:27.911081 | aio | changed: [aio] => (item=molecule-1.rgw.log)
2026-08-18 14:49:27.911971 | aio | changed: [aio] => (item=molecule-1.rgw.meta)
2026-08-18 14:49:27.912050 | aio |
2026-08-18 14:49:27.912065 | aio | TASK [vexxhost.ceph.configure : Configure CephX keys] **************************
2026-08-18 14:49:27.912256 | aio | Tuesday 18 August 2026  14:49:27 +0000 (0:00:36.622)       0:07:23.117 ********
2026-08-18 14:49:27.946438 | aio | skipping: [aio]
2026-08-18 14:49:27.946777 | aio |
2026-08-18 14:49:27.947175 | aio | TASK [vexxhost.ceph.configure : Enroll the dashboard TLS certificate] **********
2026-08-18 14:49:27.947511 | aio | Tuesday 18 August 2026  14:49:27 +0000 (0:00:00.038)       0:07:23.156 ********
2026-08-18 14:49:27.992483 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard.yml for aio
2026-08-18 14:49:27.992526 | aio |
2026-08-18 14:49:27.992659 | aio | TASK [vexxhost.ceph.configure : Check whether the dashboard mgr module is enabled] ***
2026-08-18 14:49:27.992778 | aio | Tuesday 18 August 2026  14:49:27 +0000 (0:00:00.047)       0:07:23.203 ********
2026-08-18 14:49:29.816075 | aio | ok: [aio]
2026-08-18 14:49:29.816151 | aio |
2026-08-18 14:49:29.816166 | aio | TASK [vexxhost.ceph.configure : Get the current dashboard certificate] *********
2026-08-18 14:49:29.816478 | aio | Tuesday 18 August 2026  14:49:29 +0000 (0:00:01.822)       0:07:25.025 ********
2026-08-18 14:49:31.746274 | aio | ok: [aio]
2026-08-18 14:49:31.746336 | aio |
2026-08-18 14:49:31.746448 | aio | TASK [vexxhost.ceph.configure : Set the dashboard certificate] *****************
2026-08-18 14:49:31.746568 | aio | Tuesday 18 August 2026  14:49:31 +0000 (0:00:01.928)       0:07:26.954 ********
2026-08-18 14:49:31.790748 | aio | skipping: [aio]
2026-08-18 14:49:31.791030 | aio |
2026-08-18 14:49:31.791284 | aio | TASK [vexxhost.ceph.configure : Set the dashboard certificate key] *************
2026-08-18 14:49:31.791532 | aio | Tuesday 18 August 2026  14:49:31 +0000 (0:00:00.046)       0:07:27.001 ********
2026-08-18 14:49:31.834854 | aio | skipping: [aio]
2026-08-18 14:49:31.835117 | aio |
2026-08-18 14:49:31.835404 | aio | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 14:49:31.835649 | aio | Tuesday 18 August 2026  14:49:31 +0000 (0:00:00.044)       0:07:27.045 ********
2026-08-18 14:49:31.879309 | aio | skipping: [aio]
2026-08-18 14:49:31.879485 | aio |
2026-08-18 14:49:31.879735 | aio | TASK [vexxhost.ceph.configure : Create a self-signed certificate] **************
2026-08-18 14:49:31.880020 | aio | Tuesday 18 August 2026  14:49:31 +0000 (0:00:00.044)       0:07:27.089 ********
2026-08-18 14:49:33.973655 | aio | changed: [aio]
2026-08-18 14:49:33.973835 | aio |
2026-08-18 14:49:33.974162 | aio | TASK [vexxhost.ceph.configure : Flag the dashboard for reload] *****************
2026-08-18 14:49:33.974405 | aio | Tuesday 18 August 2026  14:49:33 +0000 (0:00:02.094)       0:07:29.183 ********
2026-08-18 14:49:34.021491 | aio | ok: [aio]
2026-08-18 14:49:34.021639 | aio |
2026-08-18 14:49:34.021931 | aio | TASK [vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate] ***
2026-08-18 14:49:34.022184 | aio | Tuesday 18 August 2026  14:49:34 +0000 (0:00:00.048)       0:07:29.232 ********
2026-08-18 14:49:41.195525 | aio | changed: [aio] => (item=ceph mgr module disable dashboard)
2026-08-18 14:49:41.195612 | aio | changed: [aio] => (item=ceph mgr module enable dashboard)
2026-08-18 14:49:41.195908 | aio | changed: [aio] => (item=ceph orch reconfig mgr)
2026-08-18 14:49:41.195924 | aio |
2026-08-18 14:49:41.195931 | aio | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 14:49:41.196036 | aio | Tuesday 18 August 2026  14:49:41 +0000 (0:00:07.173)       0:07:36.405 ********
2026-08-18 14:49:41.263107 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/configure/tasks/dashboard_users.yml for aio
2026-08-18 14:49:41.263201 | aio |
2026-08-18 14:49:41.264425 | aio | TASK [vexxhost.ceph.configure : Configure dashboard users] *********************
2026-08-18 14:49:41.264438 | aio | Tuesday 18 August 2026  14:49:41 +0000 (0:00:00.061)       0:07:36.466 ********
2026-08-18 14:49:51.939963 | aio | changed: [aio] => (item=None)
2026-08-18 14:49:51.940057 | aio | changed: [aio] => (item=None)
2026-08-18 14:49:51.940071 | aio | changed: [aio -> {{ ceph_configure_admin_host }}]
2026-08-18 14:49:51.940471 | aio |
2026-08-18 14:49:51.940835 | aio | PLAY [Deploy Ceph RADOS Gateways] **********************************************
2026-08-18 14:49:51.941193 | aio |
2026-08-18 14:49:51.941544 | aio | TASK [Gathering Facts] *********************************************************
2026-08-18 14:49:51.941944 | aio | Tuesday 18 August 2026  14:49:51 +0000 (0:00:10.681)       0:07:47.148 ********
2026-08-18 14:49:52.960392 | aio | ok: [aio]
2026-08-18 14:49:52.960506 | aio |
2026-08-18 14:49:52.960553 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:49:52.960671 | aio | Tuesday 18 August 2026  14:49:52 +0000 (0:00:01.022)       0:07:48.170 ********
2026-08-18 14:49:53.243952 | aio | ok: [aio]
2026-08-18 14:49:53.244018 | aio |
2026-08-18 14:49:53.244135 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:49:53.244252 | aio | Tuesday 18 August 2026  14:49:53 +0000 (0:00:00.284)       0:07:48.454 ********
2026-08-18 14:49:53.291616 | aio | skipping: [aio]
2026-08-18 14:49:53.291689 | aio |
2026-08-18 14:49:53.291703 | aio | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-18 14:49:53.291716 | aio | Tuesday 18 August 2026  14:49:53 +0000 (0:00:00.045)       0:07:48.500 ********
2026-08-18 14:49:53.562731 | aio | ok: [aio]
2026-08-18 14:49:53.562819 | aio |
2026-08-18 14:49:53.562833 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:49:53.562846 | aio | Tuesday 18 August 2026  14:49:53 +0000 (0:00:00.271)       0:07:48.771 ********
2026-08-18 14:49:53.634487 | aio | ok: [aio] => {
2026-08-18 14:49:53.634569 | aio |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-18 14:49:53.634760 | aio | }
2026-08-18 14:49:53.634785 | aio |
2026-08-18 14:49:53.634928 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:49:53.635031 | aio | Tuesday 18 August 2026  14:49:53 +0000 (0:00:00.069)       0:07:48.841 ********
2026-08-18 14:49:54.037517 | aio | ok: [aio]
2026-08-18 14:49:54.037639 | aio |
2026-08-18 14:49:54.037656 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:49:54.037920 | aio | Tuesday 18 August 2026  14:49:54 +0000 (0:00:00.406)       0:07:49.247 ********
2026-08-18 14:49:54.085755 | aio | skipping: [aio]
2026-08-18 14:49:54.085827 | aio |
2026-08-18 14:49:54.086445 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:49:54.086498 | aio | Tuesday 18 August 2026  14:49:54 +0000 (0:00:00.048)       0:07:49.296 ********
2026-08-18 14:49:54.147121 | aio | skipping: [aio]
2026-08-18 14:49:54.147167 | aio |
2026-08-18 14:49:54.147174 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:49:54.147180 | aio | Tuesday 18 August 2026  14:49:54 +0000 (0:00:00.060)       0:07:49.356 ********
2026-08-18 14:49:54.428474 | aio | ok: [aio]
2026-08-18 14:49:54.428573 | aio |
2026-08-18 14:49:54.428591 | aio | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-18 14:49:54.428717 | aio | Tuesday 18 August 2026  14:49:54 +0000 (0:00:00.280)       0:07:49.636 ********
2026-08-18 14:49:55.586758 | aio | ok: [aio]
2026-08-18 14:49:55.586820 | aio |
2026-08-18 14:49:55.586826 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:49:55.586832 | aio | Tuesday 18 August 2026  14:49:55 +0000 (0:00:01.160)       0:07:50.797 ********
2026-08-18 14:49:55.671989 | aio | ok: [aio] => {
2026-08-18 14:49:55.672031 | aio |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-18 14:49:55.672039 | aio | }
2026-08-18 14:49:55.672045 | aio |
2026-08-18 14:49:55.672050 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:49:55.672057 | aio | Tuesday 18 August 2026  14:49:55 +0000 (0:00:00.085)       0:07:50.882 ********
2026-08-18 14:49:56.155363 | aio | ok: [aio]
2026-08-18 14:49:56.155578 | aio |
2026-08-18 14:49:56.156322 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:49:56.156353 | aio | Tuesday 18 August 2026  14:49:56 +0000 (0:00:00.483)       0:07:51.365 ********
2026-08-18 14:49:58.355850 | aio | ok: [aio]
2026-08-18 14:49:58.356232 | aio |
2026-08-18 14:49:58.356550 | aio | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-18 14:49:58.356849 | aio | Tuesday 18 August 2026  14:49:58 +0000 (0:00:02.201)       0:07:53.566 ********
2026-08-18 14:49:58.388763 | aio | skipping: [aio]
2026-08-18 14:49:58.389009 | aio |
2026-08-18 14:49:58.389274 | aio | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-18 14:49:58.389533 | aio | Tuesday 18 August 2026  14:49:58 +0000 (0:00:00.032)       0:07:53.599 ********
2026-08-18 14:49:58.417628 | aio | skipping: [aio]
2026-08-18 14:49:58.417839 | aio |
2026-08-18 14:49:58.418192 | aio | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-18 14:49:58.418477 | aio | Tuesday 18 August 2026  14:49:58 +0000 (0:00:00.029)       0:07:53.628 ********
2026-08-18 14:49:58.457211 | aio | skipping: [aio]
2026-08-18 14:49:58.457408 | aio |
2026-08-18 14:49:58.457697 | aio | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-18 14:49:58.458022 | aio | Tuesday 18 August 2026  14:49:58 +0000 (0:00:00.039)       0:07:53.667 ********
2026-08-18 14:49:59.598246 | aio | ok: [aio]
2026-08-18 14:49:59.598317 | aio |
2026-08-18 14:49:59.598331 | aio | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-18 14:49:59.598344 | aio | Tuesday 18 August 2026  14:49:59 +0000 (0:00:01.140)       0:07:54.807 ********
2026-08-18 14:50:00.197791 | aio | ok: [aio]
2026-08-18 14:50:00.197839 | aio |
2026-08-18 14:50:00.197845 | aio | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-18 14:50:00.197852 | aio | Tuesday 18 August 2026  14:50:00 +0000 (0:00:00.598)       0:07:55.406 ********
2026-08-18 14:50:01.387474 | aio | ok: [aio] => (item={'path': '/etc/containerd'})
2026-08-18 14:50:01.387562 | aio | ok: [aio] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-18 14:50:01.387581 | aio | ok: [aio] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-18 14:50:01.387725 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-18 14:50:01.387833 | aio | ok: [aio] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-18 14:50:01.387962 | aio |
2026-08-18 14:50:01.388093 | aio | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-18 14:50:01.388183 | aio | Tuesday 18 August 2026  14:50:01 +0000 (0:00:01.191)       0:07:56.597 ********
2026-08-18 14:50:02.086151 | aio | ok: [aio]
2026-08-18 14:50:02.086207 | aio |
2026-08-18 14:50:02.086218 | aio | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-18 14:50:02.086227 | aio | Tuesday 18 August 2026  14:50:02 +0000 (0:00:00.682)       0:07:57.279 ********
2026-08-18 14:50:02.086236 | aio |
2026-08-18 14:50:02.086245 | aio | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-18 14:50:02.086253 | aio | Tuesday 18 August 2026  14:50:02 +0000 (0:00:00.014)       0:07:57.294 ********
2026-08-18 14:50:02.539404 | aio | ok: [aio]
2026-08-18 14:50:02.539471 | aio |
2026-08-18 14:50:02.539482 | aio | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-18 14:50:02.539492 | aio | Tuesday 18 August 2026  14:50:02 +0000 (0:00:00.453)       0:07:57.748 ********
2026-08-18 14:50:02.794347 | aio | ok: [aio]
2026-08-18 14:50:02.794418 | aio |
2026-08-18 14:50:02.794527 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:50:02.794650 | aio | Tuesday 18 August 2026  14:50:02 +0000 (0:00:00.255)       0:07:58.004 ********
2026-08-18 14:50:02.865273 | aio | ok: [aio] => {
2026-08-18 14:50:02.865418 | aio |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-18 14:50:02.865564 | aio | }
2026-08-18 14:50:02.865697 | aio |
2026-08-18 14:50:02.865812 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:50:02.865939 | aio | Tuesday 18 August 2026  14:50:02 +0000 (0:00:00.070)       0:07:58.074 ********
2026-08-18 14:50:03.311879 | aio | ok: [aio]
2026-08-18 14:50:03.311957 | aio |
2026-08-18 14:50:03.311964 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:50:03.311977 | aio | Tuesday 18 August 2026  14:50:03 +0000 (0:00:00.445)       0:07:58.519 ********
2026-08-18 14:50:06.637520 | aio | ok: [aio]
2026-08-18 14:50:06.637588 | aio |
2026-08-18 14:50:06.637599 | aio | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-18 14:50:06.637608 | aio | Tuesday 18 August 2026  14:50:06 +0000 (0:00:03.327)       0:08:01.846 ********
2026-08-18 14:50:07.629026 | aio | ok: [aio]
2026-08-18 14:50:07.629102 | aio |
2026-08-18 14:50:07.629574 | aio | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-18 14:50:07.629627 | aio | Tuesday 18 August 2026  14:50:07 +0000 (0:00:00.991)       0:08:02.838 ********
2026-08-18 14:50:07.875809 | aio | ok: [aio]
2026-08-18 14:50:07.875920 | aio |
2026-08-18 14:50:07.876009 | aio | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-18 14:50:07.876118 | aio | Tuesday 18 August 2026  14:50:07 +0000 (0:00:00.247)       0:08:03.085 ********
2026-08-18 14:50:08.421124 | aio | ok: [aio]
2026-08-18 14:50:08.421210 | aio |
2026-08-18 14:50:08.421370 | aio | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-18 14:50:08.421541 | aio | Tuesday 18 August 2026  14:50:08 +0000 (0:00:00.546)       0:08:03.631 ********
2026-08-18 14:50:09.117692 | aio | ok: [aio] => (item={'path': '/etc/docker'})
2026-08-18 14:50:09.117953 | aio | ok: [aio] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-18 14:50:09.118208 | aio | ok: [aio] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-18 14:50:09.118425 | aio |
2026-08-18 14:50:09.118675 | aio | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-18 14:50:09.118947 | aio | Tuesday 18 August 2026  14:50:09 +0000 (0:00:00.696)       0:08:04.327 ********
2026-08-18 14:50:09.638061 | aio | ok: [aio]
2026-08-18 14:50:09.638231 | aio |
2026-08-18 14:50:09.638501 | aio | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-18 14:50:09.639954 | aio | Tuesday 18 August 2026  14:50:09 +0000 (0:00:00.520)       0:08:04.848 ********
2026-08-18 14:50:10.192140 | aio | ok: [aio]
2026-08-18 14:50:10.192433 | aio |
2026-08-18 14:50:10.192858 | aio | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-18 14:50:10.193419 | aio | Tuesday 18 August 2026  14:50:10 +0000 (0:00:00.537)       0:08:05.386 ********
2026-08-18 14:50:10.193721 | aio |
2026-08-18 14:50:10.194106 | aio | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-18 14:50:10.194231 | aio | Tuesday 18 August 2026  14:50:10 +0000 (0:00:00.015)       0:08:05.401 ********
2026-08-18 14:50:10.681748 | aio | ok: [aio]
2026-08-18 14:50:10.682977 | aio |
2026-08-18 14:50:10.683049 | aio | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-18 14:50:10.683060 | aio | Tuesday 18 August 2026  14:50:10 +0000 (0:00:00.490)       0:08:05.892 ********
2026-08-18 14:50:10.723703 | aio | ok: [aio] => {
2026-08-18 14:50:10.723990 | aio |     "msg": "https://download.ceph.com/rpm-20.2.3/el9/noarch/cephadm"
2026-08-18 14:50:10.724233 | aio | }
2026-08-18 14:50:10.724461 | aio |
2026-08-18 14:50:10.724769 | aio | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-18 14:50:10.725065 | aio | Tuesday 18 August 2026  14:50:10 +0000 (0:00:00.042)       0:08:05.934 ********
2026-08-18 14:50:11.073995 | aio | ok: [aio]
2026-08-18 14:50:11.074171 | aio |
2026-08-18 14:50:11.074438 | aio | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-18 14:50:11.074699 | aio | Tuesday 18 August 2026  14:50:11 +0000 (0:00:00.348)       0:08:06.283 ********
2026-08-18 14:50:11.119791 | aio | skipping: [aio]
2026-08-18 14:50:11.120062 | aio |
2026-08-18 14:50:11.120346 | aio | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-18 14:50:11.120599 | aio | Tuesday 18 August 2026  14:50:11 +0000 (0:00:00.047)       0:08:06.330 ********
2026-08-18 14:50:11.168616 | aio | ok: [aio] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-08-18 14:50:11.168916 | aio |
2026-08-18 14:50:11.169258 | aio | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-18 14:50:11.169516 | aio | Tuesday 18 August 2026  14:50:11 +0000 (0:00:00.048)       0:08:06.379 ********
2026-08-18 14:50:13.324092 | aio | ok: [aio]
2026-08-18 14:50:13.324180 | aio |
2026-08-18 14:50:13.324547 | aio | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-18 14:50:13.324604 | aio | Tuesday 18 August 2026  14:50:13 +0000 (0:00:02.154)       0:08:08.533 ********
2026-08-18 14:50:14.202069 | aio | ok: [aio] => (item=systemd-timesyncd)
2026-08-18 14:50:14.202278 | aio | ok: [aio] => (item=ssh)
2026-08-18 14:50:14.202506 | aio |
2026-08-18 14:50:14.202760 | aio | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-18 14:50:14.203104 | aio | Tuesday 18 August 2026  14:50:14 +0000 (0:00:00.877)       0:08:09.411 ********
2026-08-18 14:50:14.453050 | aio | ok: [aio]
2026-08-18 14:50:14.453275 | aio |
2026-08-18 14:50:14.453535 | aio | TASK [vexxhost.ceph.cephadm : Ensure the cephadm SSH user exists] **************
2026-08-18 14:50:14.453786 | aio | Tuesday 18 August 2026  14:50:14 +0000 (0:00:00.251)       0:08:09.663 ********
2026-08-18 14:50:14.769936 | aio | ok: [aio]
2026-08-18 14:50:14.770009 | aio |
2026-08-18 14:50:14.770291 | aio | TASK [vexxhost.ceph.cephadm : Grant passwordless sudo to the cephadm SSH user] ***
2026-08-18 14:50:14.770541 | aio | Tuesday 18 August 2026  14:50:14 +0000 (0:00:00.316)       0:08:09.980 ********
2026-08-18 14:50:15.323370 | aio | ok: [aio]
2026-08-18 14:50:15.323573 | aio |
2026-08-18 14:50:15.323834 | aio | TASK [vexxhost.ceph.cephadm : Log in to the container registry] ****************
2026-08-18 14:50:15.324121 | aio | Tuesday 18 August 2026  14:50:15 +0000 (0:00:00.553)       0:08:10.533 ********
2026-08-18 14:50:15.363259 | aio | skipping: [aio]
2026-08-18 14:50:15.363479 | aio |
2026-08-18 14:50:15.363733 | aio | TASK [vexxhost.ceph.cephadm : Pre-pull the Ceph image] *************************
2026-08-18 14:50:15.364013 | aio | Tuesday 18 August 2026  14:50:15 +0000 (0:00:00.039)       0:08:10.573 ********
2026-08-18 14:50:15.821052 | aio | ok: [aio]
2026-08-18 14:50:15.821109 | aio |
2026-08-18 14:50:15.821120 | aio | TASK [vexxhost.ceph.cephadm : Pin CEPHADM_IMAGE for interactive login shells] ***
2026-08-18 14:50:15.821131 | aio | Tuesday 18 August 2026  14:50:15 +0000 (0:00:00.456)       0:08:11.030 ********
2026-08-18 14:50:16.368450 | aio | ok: [aio]
2026-08-18 14:50:16.368502 | aio |
2026-08-18 14:50:16.368512 | aio | TASK [vexxhost.ceph.rgw : Locate the cluster admin host] ***********************
2026-08-18 14:50:16.368523 | aio | Tuesday 18 August 2026  14:50:16 +0000 (0:00:00.547)       0:08:11.577 ********
2026-08-18 14:50:16.655077 | aio | ok: [aio] => (item=aio)
2026-08-18 14:50:16.655162 | aio |
2026-08-18 14:50:16.655180 | aio | TASK [vexxhost.ceph.rgw : Select the admin host] *******************************
2026-08-18 14:50:16.655413 | aio | Tuesday 18 August 2026  14:50:16 +0000 (0:00:00.286)       0:08:11.864 ********
2026-08-18 14:50:16.716452 | aio | ok: [aio]
2026-08-18 14:50:16.716513 | aio |
2026-08-18 14:50:16.716624 | aio | TASK [vexxhost.ceph.rgw : Set the admin mon config path] ***********************
2026-08-18 14:50:16.716743 | aio | Tuesday 18 August 2026  14:50:16 +0000 (0:00:00.062)       0:08:11.926 ********
2026-08-18 14:50:16.787407 | aio | ok: [aio]
2026-08-18 14:50:16.787977 | aio |
2026-08-18 14:50:16.787990 | aio | TASK [Register this RGW host] **************************************************
2026-08-18 14:50:16.788000 | aio | Tuesday 18 August 2026  14:50:16 +0000 (0:00:00.063)       0:08:11.990 ********
2026-08-18 14:50:16.852411 | aio | included: vexxhost.ceph.cephadm_host for aio
2026-08-18 14:50:16.852493 | aio |
2026-08-18 14:50:16.852507 | aio | TASK [vexxhost.ceph.cephadm_host : Get the cephadm public key] *****************
2026-08-18 14:50:16.852642 | aio | Tuesday 18 August 2026  14:50:16 +0000 (0:00:00.071)       0:08:12.062 ********
2026-08-18 14:50:18.638016 | aio | ok: [aio]
2026-08-18 14:50:18.638092 | aio |
2026-08-18 14:50:18.638106 | aio | TASK [vexxhost.ceph.cephadm_host : Resolve the cluster SSH public key to authorise] ***
2026-08-18 14:50:18.638134 | aio | Tuesday 18 August 2026  14:50:18 +0000 (0:00:01.784)       0:08:13.846 ********
2026-08-18 14:50:18.689970 | aio | ok: [aio]
2026-08-18 14:50:18.690060 | aio |
2026-08-18 14:50:18.690074 | aio | TASK [vexxhost.ceph.cephadm_host : Assert a cluster SSH key was resolved] ******
2026-08-18 14:50:18.690088 | aio | Tuesday 18 August 2026  14:50:18 +0000 (0:00:00.051)       0:08:13.898 ********
2026-08-18 14:50:18.744706 | aio | ok: [aio] => {
2026-08-18 14:50:18.744787 | aio |     "changed": false,
2026-08-18 14:50:18.744802 | aio |     "msg": "All assertions passed"
2026-08-18 14:50:18.744816 | aio | }
2026-08-18 14:50:18.744830 | aio |
2026-08-18 14:50:18.744843 | aio | TASK [vexxhost.ceph.cephadm_host : Authorise the cluster SSH key for the cephadm user] ***
2026-08-18 14:50:18.744857 | aio | Tuesday 18 August 2026  14:50:18 +0000 (0:00:00.054)       0:08:13.952 ********
2026-08-18 14:50:19.097954 | aio | ok: [aio]
2026-08-18 14:50:19.098008 | aio |
2026-08-18 14:50:19.098014 | aio | TASK [vexxhost.ceph.cephadm_host : Derive this host's cephadm labels from inventory membership] ***
2026-08-18 14:50:19.098020 | aio | Tuesday 18 August 2026  14:50:19 +0000 (0:00:00.353)       0:08:14.305 ********
2026-08-18 14:50:19.148740 | aio | ok: [aio]
2026-08-18 14:50:19.148764 | aio |
2026-08-18 14:50:19.148770 | aio | TASK [vexxhost.ceph.cephadm_host : Find this host's addresses on the public network] ***
2026-08-18 14:50:19.148777 | aio | Tuesday 18 August 2026  14:50:19 +0000 (0:00:00.053)       0:08:14.358 ********
2026-08-18 14:50:19.230684 | aio | ok: [aio]
2026-08-18 14:50:19.230762 | aio |
2026-08-18 14:50:19.230950 | aio | TASK [vexxhost.ceph.cephadm_host : Assert exactly one address matches the public network] ***
2026-08-18 14:50:19.231096 | aio | Tuesday 18 August 2026  14:50:19 +0000 (0:00:00.081)       0:08:14.440 ********
2026-08-18 14:50:19.285064 | aio | ok: [aio] => {
2026-08-18 14:50:19.285118 | aio |     "changed": false,
2026-08-18 14:50:19.285137 | aio |     "msg": "All assertions passed"
2026-08-18 14:50:19.286090 | aio | }
2026-08-18 14:50:19.286193 | aio |
2026-08-18 14:50:19.286206 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host (labels)] *****************
2026-08-18 14:50:19.286277 | aio | Tuesday 18 August 2026  14:50:19 +0000 (0:00:00.054)       0:08:14.494 ********
2026-08-18 14:50:21.075494 | aio | ok: [aio]
2026-08-18 14:50:21.075603 | aio |
2026-08-18 14:50:21.075725 | aio | TASK [vexxhost.ceph.cephadm_host : Register the host with a CRUSH location] ****
2026-08-18 14:50:21.075881 | aio | Tuesday 18 August 2026  14:50:21 +0000 (0:00:01.790)       0:08:16.284 ********
2026-08-18 14:50:21.142154 | aio | skipping: [aio]
2026-08-18 14:50:21.142236 | aio |
2026-08-18 14:50:21.142250 | aio | TASK [vexxhost.ceph.rgw : Configure RGW multisite (realm, zonegroup, zone)] ****
2026-08-18 14:50:21.142263 | aio | Tuesday 18 August 2026  14:50:21 +0000 (0:00:00.065)       0:08:16.350 ********
2026-08-18 14:50:21.212781 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/multisite.yml for aio
2026-08-18 14:50:21.212856 | aio |
2026-08-18 14:50:21.212871 | aio | TASK [vexxhost.ceph.rgw : Configure RGW realms] ********************************
2026-08-18 14:50:21.212884 | aio | Tuesday 18 August 2026  14:50:21 +0000 (0:00:00.070)       0:08:16.421 ********
2026-08-18 14:50:25.390431 | aio | changed: [aio] => (item=molecule)
2026-08-18 14:50:25.390487 | aio |
2026-08-18 14:50:25.390501 | aio | TASK [vexxhost.ceph.rgw : Configure RGW zonegroups] ****************************
2026-08-18 14:50:25.390513 | aio | Tuesday 18 August 2026  14:50:25 +0000 (0:00:04.178)       0:08:20.599 ********
2026-08-18 14:50:27.987069 | aio | changed: [aio] => (item=molecule)
2026-08-18 14:50:27.987155 | aio |
2026-08-18 14:50:27.987219 | aio | TASK [vexxhost.ceph.rgw : Configure RGW zones] *********************************
2026-08-18 14:50:27.987517 | aio | Tuesday 18 August 2026  14:50:27 +0000 (0:00:02.594)       0:08:23.194 ********
2026-08-18 14:50:30.496679 | aio | changed: [aio] => (item=None)
2026-08-18 14:50:30.496756 | aio | changed: [aio -> {{ ceph_rgw_admin_host }}]
2026-08-18 14:50:30.496770 | aio |
2026-08-18 14:50:30.496783 | aio | TASK [vexxhost.ceph.rgw : Commit the RGW period] *******************************
2026-08-18 14:50:30.496795 | aio | Tuesday 18 August 2026  14:50:30 +0000 (0:00:02.510)       0:08:25.705 ********
2026-08-18 14:50:32.185489 | aio | changed: [aio]
2026-08-18 14:50:32.185588 | aio |
2026-08-18 14:50:32.185603 | aio | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 14:50:32.185615 | aio | Tuesday 18 August 2026  14:50:32 +0000 (0:00:01.689)       0:08:27.394 ********
2026-08-18 14:50:32.251579 | aio | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/rgw/tasks/services.yml for aio
2026-08-18 14:50:32.251655 | aio |
2026-08-18 14:50:32.251670 | aio | TASK [vexxhost.ceph.rgw : Snapshot current RGW service specs] ******************
2026-08-18 14:50:32.251685 | aio | Tuesday 18 August 2026  14:50:32 +0000 (0:00:00.065)       0:08:27.460 ********
2026-08-18 14:50:33.991378 | aio | ok: [aio]
2026-08-18 14:50:33.991462 | aio |
2026-08-18 14:50:33.991476 | aio | TASK [vexxhost.ceph.rgw : Index current RGW specs by service name] *************
2026-08-18 14:50:33.991489 | aio | Tuesday 18 August 2026  14:50:33 +0000 (0:00:01.739)       0:08:29.200 ********
2026-08-18 14:50:34.045000 | aio | ok: [aio]
2026-08-18 14:50:34.045048 | aio |
2026-08-18 14:50:34.045508 | aio | TASK [vexxhost.ceph.rgw : Apply the RGW service specs] *************************
2026-08-18 14:50:34.045556 | aio | Tuesday 18 August 2026  14:50:34 +0000 (0:00:00.054)       0:08:29.254 ********
2026-08-18 14:50:37.375324 | aio | changed: [aio] => (item=molecule)
2026-08-18 14:50:37.375386 | aio |
2026-08-18 14:50:37.375508 | aio | TASK [vexxhost.ceph.rgw : Redeploy RGW services whose redeploy-triggering keys changed] ***
2026-08-18 14:50:37.375616 | aio | Tuesday 18 August 2026  14:50:37 +0000 (0:00:03.330)       0:08:32.584 ********
2026-08-18 14:50:39.163704 | aio | failed: [aio] (item=rgw.molecule) => {"ansible_loop_var": "item", "changed": true, "cmd": ["cephadm", "shell", "--fsid", "1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", "--config", "/var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.aio/config", "--", "ceph", "orch", "redeploy", "rgw.molecule"], "delta": "0:00:01.530609", "end": "2026-08-18 14:50:39.127848", "item": {"count_per_host": 1, "id": "molecule", "networks": ["0.0.0.0/0"], "spec": {"generate_cert": true, "rgw_frontend_port": 8080, "rgw_realm": "molecule", "rgw_zone": "molecule-1", "rgw_zonegroup": "molecule", "ssl": true}}, "msg": "non-zero return code", "rc": 22, "start": "2026-08-18 14:50:37.597239", "stderr": "Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\"", "stderr_lines": ["Error EINVAL: No daemons exist under service name \"rgw.molecule\". View currently running services using \"ceph orch ls\""], "stdout": "", "stdout_lines": []}
2026-08-18 14:50:39.173628 | aio |
2026-08-18 14:50:39.173925 | aio | PLAY RECAP *********************************************************************
2026-08-18 14:50:39.174231 | aio | aio                        : ok=204  changed=46   unreachable=0    failed=1    skipped=37   rescued=0    ignored=0
2026-08-18 14:50:39.174467 | aio |
2026-08-18 14:50:39.174757 | aio |
2026-08-18 14:50:39.175052 | aio | TASKS RECAP ********************************************************************
2026-08-18 14:50:39.175317 | aio | Tuesday 18 August 2026  14:50:39 +0000 (0:00:01.797)       0:08:34.382 ********
2026-08-18 14:50:39.175560 | aio | ===============================================================================
2026-08-18 14:50:39.175844 | aio | vexxhost.ceph.osd : Deploy OSDs on the explicitly listed devices ------ 165.37s
2026-08-18 14:50:39.179178 | aio | vexxhost.ceph.mon : Bootstrap the cluster ------------------------------ 42.42s
2026-08-18 14:50:39.179455 | aio | vexxhost.ceph.cephadm : Pre-pull the Ceph image ------------------------ 41.77s
2026-08-18 14:50:39.179717 | aio | vexxhost.ceph.configure : Configure pools ------------------------------ 36.62s
2026-08-18 14:50:39.180027 | aio | vexxhost.ceph.configure : Apply central Ceph configuration ------------- 19.80s
2026-08-18 14:50:39.180305 | aio | vexxhost.ceph.configure : Configure CRUSH rules ------------------------ 12.18s
2026-08-18 14:50:39.180567 | aio | vexxhost.ceph.configure : Configure dashboard users -------------------- 10.68s
2026-08-18 14:50:39.180832 | aio | vexxhost.ceph.mgr : Configure ceph-mgr modules ------------------------- 10.35s
2026-08-18 14:50:39.181156 | aio | vexxhost.ceph.osd : Wait for explicitly requested OSD daemons to be running on this host --- 8.57s
2026-08-18 14:50:39.181407 | aio | vexxhost.ceph.cephadm_host : Register the host (labels) ----------------- 8.02s
2026-08-18 14:50:39.181744 | aio | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.36s
2026-08-18 14:50:39.181876 | aio | vexxhost.ceph.configure : Reload the dashboard so it picks up the certificate --- 7.17s
2026-08-18 14:50:39.185105 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 4.65s
2026-08-18 14:50:39.185201 | aio | vexxhost.ceph.rgw : Configure RGW realms -------------------------------- 4.18s
2026-08-18 14:50:39.185379 | aio | vexxhost.ceph.configure : Configure erasure-code profiles --------------- 4.00s
2026-08-18 14:50:39.185509 | aio | vexxhost.ceph.mon : Apply the monitor service spec ---------------------- 3.42s
2026-08-18 14:50:39.185618 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s
2026-08-18 14:50:39.185721 | aio | vexxhost.ceph.mgr : Apply the manager service spec ---------------------- 3.34s
2026-08-18 14:50:39.185829 | aio | vexxhost.ceph.rgw : Apply the RGW service specs ------------------------- 3.33s
2026-08-18 14:50:39.185962 | aio | vexxhost.containers.download_artifact : Extract archive ----------------- 3.33s
2026-08-18 14:50:39.319785 | aio | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 14:50:39.319827 | aio | ERROR    [default > converge] Executed: Failed
2026-08-18 14:50:39.319843 | aio | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-18 14:50:39.705950 | aio | ERROR
2026-08-18 14:50:39.706126 | aio | {
2026-08-18 14:50:39.706155 | aio |   "delta": "0:09:46.688443",
2026-08-18 14:50:39.706177 | aio |   "end": "2026-08-18 14:50:39.386410",
2026-08-18 14:50:39.706196 | aio |   "msg": "non-zero return code",
2026-08-18 14:50:39.706216 | aio |   "rc": 2,
2026-08-18 14:50:39.706235 | aio |   "start": "2026-08-18 14:40:52.697967"
2026-08-18 14:50:39.706254 | aio | }
failure
2026-08-18 14:50:39.717286 | 
2026-08-18 14:50:39.717343 | PLAY RECAP
2026-08-18 14:50:39.717388 | aio | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-18 14:50:39.717410 | 
2026-08-18 14:50:39.833864 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-18 14:50:39.843399 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 14:50:40.562342 | 
2026-08-18 14:50:40.562470 | PLAY [all]
2026-08-18 14:50:40.574203 | 
2026-08-18 14:50:40.574284 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-18 14:50:40.609709 | aio | skipping: Conditional result was False
2026-08-18 14:50:40.619810 | 
2026-08-18 14:50:40.619888 | TASK [fetch-output : Set log path for single node]
2026-08-18 14:50:40.661988 | aio | ok
2026-08-18 14:50:40.669064 | 
2026-08-18 14:50:40.669144 | LOOP [fetch-output : Ensure local output dirs]
2026-08-18 14:50:41.057548 | aio -> localhost | ok: "/var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/work/logs"
2026-08-18 14:50:41.262356 | aio -> localhost | changed: "/var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/work/artifacts"
2026-08-18 14:50:41.468458 | aio -> localhost | changed: "/var/lib/zuul/builds/7e64062ea7284c6eb2158f7aef2ba71f/work/docs"
2026-08-18 14:50:41.486653 | 
2026-08-18 14:50:41.486823 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-18 14:50:42.143459 | aio | changed: .d..t...... ./
2026-08-18 14:50:42.143694 | aio | changed: All items complete
2026-08-18 14:50:42.143733 | 
2026-08-18 14:50:42.612746 | aio | changed: .d..t...... ./
2026-08-18 14:50:43.082865 | aio | changed: .d..t...... ./
2026-08-18 14:50:43.110307 | 
2026-08-18 14:50:43.110485 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-18 14:50:43.493518 | aio -> localhost | ok: Item: artifacts Runtime: 0:00:00.006649
2026-08-18 14:50:43.718194 | aio -> localhost | ok: Item: docs Runtime: 0:00:00.005842
2026-08-18 14:50:43.740064 | 
2026-08-18 14:50:43.740200 | PLAY [all]
2026-08-18 14:50:43.748058 | 
2026-08-18 14:50:43.748124 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-18 14:50:44.188227 | aio | changed
2026-08-18 14:50:44.194046 | 
2026-08-18 14:50:44.194097 | PLAY RECAP
2026-08-18 14:50:44.194142 | aio | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-18 14:50:44.194164 | 
2026-08-18 14:50:44.303406 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-18 14:50:44.313648 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-18 14:50:44.870227 | 
2026-08-18 14:50:44.870362 | PLAY [localhost]
2026-08-18 14:50:44.883976 | 
2026-08-18 14:50:44.884058 | TASK [Generate Zuul manifest]
2026-08-18 14:50:44.904413 | localhost | ok
2026-08-18 14:50:44.927653 | 
2026-08-18 14:50:44.927761 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-18 14:50:45.353063 | localhost | changed
2026-08-18 14:50:45.368556 | 
2026-08-18 14:50:45.368832 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-18 14:50:45.442156 | localhost | ok
2026-08-18 14:50:45.449714 | 
2026-08-18 14:50:45.449777 | TASK [Upload logs]
2026-08-18 14:50:45.470017 | localhost | ok
2026-08-18 14:50:45.831654 | 
2026-08-18 14:50:45.839402 | TASK [Set zuul-log-path fact]
2026-08-18 14:50:45.859840 | localhost | ok
2026-08-18 14:50:45.870756 | 
2026-08-18 14:50:45.870821 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-18 14:50:45.900255 | localhost | ok
2026-08-18 14:50:45.908944 | 
2026-08-18 14:50:45.909027 | TASK [upload-logs : Create log directories]
2026-08-18 14:50:46.254488 | localhost | changed
2026-08-18 14:50:46.262521 | 
2026-08-18 14:50:46.262620 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-18 14:50:46.598393 | localhost -> localhost | ok: Runtime: 0:00:00.004176
2026-08-18 14:50:46.605011 | 
2026-08-18 14:50:46.605085 | TASK [upload-logs : Upload logs to log server]
2026-08-18 14:50:47.013663 | localhost | Output suppressed because no_log was given
2026-08-18 14:50:47.228741 | 
2026-08-18 14:50:47.228938 | LOOP [upload-logs : Compress console log and json output]
2026-08-18 14:50:47.273583 | localhost | skipping: Conditional result was False
2026-08-18 14:50:47.282564 | localhost | skipping: Conditional result was False
2026-08-18 14:50:47.294100 | 
2026-08-18 14:50:47.294247 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-18 14:50:47.339379 | localhost | skipping: Conditional result was False
2026-08-18 14:50:47.339843 | 
2026-08-18 14:50:47.343460 | localhost | skipping: Conditional result was False
2026-08-18 14:50:47.359682 | 
2026-08-18 14:50:47.359924 | LOOP [upload-logs : Upload console log and json output]