2026-08-06 15:24:21.643491 | Job console starting
2026-08-06 15:24:21.663147 | Updating git repos
2026-08-06 15:24:21.709088 | Cloning repos into workspace
2026-08-06 15:24:21.754083 | Restoring repo states
2026-08-06 15:24:21.763186 | Merging changes
2026-08-06 15:24:22.071632 | Checking out repos
2026-08-06 15:24:22.106225 | Preparing playbooks
2026-08-06 15:24:23.479593 | Running Ansible setup
2026-08-06 15:24:27.619111 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-06 15:24:28.193629 | 
2026-08-06 15:24:28.193751 | PLAY [localhost]
2026-08-06 15:24:28.201046 | 
2026-08-06 15:24:28.201117 | TASK [Gathering Facts]
2026-08-06 15:24:29.055546 | localhost | ok
2026-08-06 15:24:29.067149 | 
2026-08-06 15:24:29.067239 | TASK [Setup log path fact]
2026-08-06 15:24:29.097817 | localhost | ok
2026-08-06 15:24:29.110695 | 
2026-08-06 15:24:29.110783 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-06 15:24:29.142606 | localhost | ok
2026-08-06 15:24:29.151095 | 
2026-08-06 15:24:29.151169 | TASK [emit-job-header : Print job information]
2026-08-06 15:24:29.182960 | # Job Information
2026-08-06 15:24:29.183127 | Ansible Version: 2.16.18
2026-08-06 15:24:29.183173 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-08-06 15:24:29.183205 | Pipeline: check
2026-08-06 15:24:29.183235 | Executor: 2d72f0692154
2026-08-06 15:24:29.183263 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/119
2026-08-06 15:24:29.183297 | Event ID: b17d6910-91aa-11f1-9901-9bf91cfd9257
2026-08-06 15:24:29.187249 | 
2026-08-06 15:24:29.187343 | LOOP [emit-job-header : Print node information]
2026-08-06 15:24:29.269594 | localhost | ok:
2026-08-06 15:24:29.269844 | localhost | # Node Information
2026-08-06 15:24:29.269872 | localhost | Inventory Hostname: mon1
2026-08-06 15:24:29.269894 | localhost | Hostname: np0000188144
2026-08-06 15:24:29.269913 | localhost | Username: zuul
2026-08-06 15:24:29.269935 | localhost | Distro: Ubuntu 22.04
2026-08-06 15:24:29.269955 | localhost | Provider: yul1
2026-08-06 15:24:29.269991 | localhost | Region: ca-ymq-1
2026-08-06 15:24:29.270011 | localhost | Label: ubuntu-jammy
2026-08-06 15:24:29.270029 | localhost | Product Name: OpenStack Nova
2026-08-06 15:24:29.270047 | localhost | Interface IP: 199.19.213.162
2026-08-06 15:24:29.311439 | localhost | ok:
2026-08-06 15:24:29.311486 | localhost | # Node Information
2026-08-06 15:24:29.311512 | localhost | Inventory Hostname: osd1
2026-08-06 15:24:29.311533 | localhost | Hostname: np0000188145
2026-08-06 15:24:29.311552 | localhost | Username: zuul
2026-08-06 15:24:29.311572 | localhost | Distro: Ubuntu 22.04
2026-08-06 15:24:29.311590 | localhost | Provider: yul1
2026-08-06 15:24:29.311608 | localhost | Region: ca-ymq-1
2026-08-06 15:24:29.311626 | localhost | Label: ubuntu-jammy
2026-08-06 15:24:29.311644 | localhost | Product Name: OpenStack Nova
2026-08-06 15:24:29.311663 | localhost | Interface IP: 199.19.213.124
2026-08-06 15:24:29.324356 | 
2026-08-06 15:24:29.324460 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-06 15:24:29.685743 | localhost -> localhost | changed
2026-08-06 15:24:29.692419 | 
2026-08-06 15:24:29.692768 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-06 15:24:30.501783 | localhost -> localhost | changed
2026-08-06 15:24:30.511944 | 
2026-08-06 15:24:30.512025 | PLAY [all]
2026-08-06 15:24:30.521931 | 
2026-08-06 15:24:30.522000 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-06 15:24:30.749258 | mon1 -> localhost | ok
2026-08-06 15:24:30.759804 | 
2026-08-06 15:24:30.759904 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-06 15:24:30.797027 | mon1 | ok
2026-08-06 15:24:30.800953 | osd1 | ok
2026-08-06 15:24:30.818156 | mon1 | included: /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-06 15:24:30.818208 | osd1 | included: /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-06 15:24:30.823990 | 
2026-08-06 15:24:30.824055 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-06 15:24:32.436463 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-06 15:24:32.436664 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/a2e55cad247a429c9d03134659ef6903_id_rsa
2026-08-06 15:24:32.436708 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/a2e55cad247a429c9d03134659ef6903_id_rsa.pub
2026-08-06 15:24:32.436742 | mon1 -> localhost | The key fingerprint is:
2026-08-06 15:24:32.436773 | mon1 -> localhost | SHA256:KSWeTlmfM84kCEts9bps/XDo2HA1IGstxT/c5BlYyG4 zuul-build-sshkey
2026-08-06 15:24:32.436803 | mon1 -> localhost | The key's randomart image is:
2026-08-06 15:24:32.436831 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-06 15:24:32.436859 | mon1 -> localhost | |      .  . ..    |
2026-08-06 15:24:32.436888 | mon1 -> localhost | |   . . o  oo     |
2026-08-06 15:24:32.436916 | mon1 -> localhost | |    = o B.. o    |
2026-08-06 15:24:32.436944 | mon1 -> localhost | |   o + & *E= o   |
2026-08-06 15:24:32.437032 | mon1 -> localhost | |    . % S.% +    |
2026-08-06 15:24:32.437067 | mon1 -> localhost | |     = = B =     |
2026-08-06 15:24:32.437096 | mon1 -> localhost | |      * = +      |
2026-08-06 15:24:32.437125 | mon1 -> localhost | |     . * +       |
2026-08-06 15:24:32.437154 | mon1 -> localhost | |      . o .      |
2026-08-06 15:24:32.437182 | mon1 -> localhost | +----[SHA256]-----+
2026-08-06 15:24:32.437244 | mon1 -> localhost | ok: Runtime: 0:00:01.238828
2026-08-06 15:24:32.443772 | 
2026-08-06 15:24:32.443847 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-06 15:24:32.477336 | mon1 | ok
2026-08-06 15:24:32.483842 | osd1 | ok
2026-08-06 15:24:32.496112 | mon1 | included: /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-06 15:24:32.496159 | osd1 | included: /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-06 15:24:32.505847 | 
2026-08-06 15:24:32.505910 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-06 15:24:32.529554 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:32.541005 | osd1 | skipping: Conditional result was False
2026-08-06 15:24:32.550654 | 
2026-08-06 15:24:32.550717 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-06 15:24:33.030535 | mon1 | changed
2026-08-06 15:24:33.112362 | osd1 | changed
2026-08-06 15:24:33.119785 | 
2026-08-06 15:24:33.119894 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-06 15:24:33.298868 | mon1 | ok
2026-08-06 15:24:33.315046 | osd1 | ok
2026-08-06 15:24:33.321885 | 
2026-08-06 15:24:33.321953 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-06 15:24:33.764712 | osd1 | changed
2026-08-06 15:24:33.771906 | mon1 | changed
2026-08-06 15:24:33.776580 | 
2026-08-06 15:24:33.776644 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-06 15:24:34.280193 | mon1 | changed
2026-08-06 15:24:34.286375 | osd1 | changed
2026-08-06 15:24:34.292786 | 
2026-08-06 15:24:34.292885 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-06 15:24:34.322404 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:34.323009 | osd1 | skipping: Conditional result was False
2026-08-06 15:24:34.334349 | 
2026-08-06 15:24:34.334521 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-06 15:24:34.662989 | mon1 -> localhost | changed
2026-08-06 15:24:34.682830 | 
2026-08-06 15:24:34.682942 | TASK [add-build-sshkey : Add back temp key]
2026-08-06 15:24:34.960350 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/a2e55cad247a429c9d03134659ef6903_id_rsa (zuul-build-sshkey)
2026-08-06 15:24:34.960596 | mon1 -> localhost | ok: Runtime: 0:00:00.012826
2026-08-06 15:24:34.967046 | 
2026-08-06 15:24:34.967112 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-06 15:24:35.224466 | mon1 | ok
2026-08-06 15:24:35.231014 | osd1 | ok
2026-08-06 15:24:35.235343 | 
2026-08-06 15:24:35.235405 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-06 15:24:35.259367 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:35.270454 | osd1 | skipping: Conditional result was False
2026-08-06 15:24:35.289567 | 
2026-08-06 15:24:35.289632 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-06 15:24:35.567974 | mon1 | ok
2026-08-06 15:24:35.572728 | osd1 | ok
2026-08-06 15:24:35.578465 | 
2026-08-06 15:24:35.578536 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-06 15:24:36.270396 | osd1 | Output suppressed because no_log was given
2026-08-06 15:24:36.300833 | mon1 | Output suppressed because no_log was given
2026-08-06 15:24:36.318166 | 
2026-08-06 15:24:36.318319 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-06 15:24:36.502658 | mon1 | ok: "logs"
2026-08-06 15:24:36.502904 | mon1 | ok: All items complete
2026-08-06 15:24:36.502932 | 
2026-08-06 15:24:36.528876 | osd1 | ok: "logs"
2026-08-06 15:24:36.652831 | mon1 | ok: "artifacts"
2026-08-06 15:24:36.680416 | osd1 | ok: "artifacts"
2026-08-06 15:24:36.810194 | mon1 | ok: "docs"
2026-08-06 15:24:36.840707 | osd1 | ok: "docs"
2026-08-06 15:24:36.851849 | 
2026-08-06 15:24:36.852049 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-06 15:24:37.044118 | mon1 | changed: "logs"
2026-08-06 15:24:37.044413 | mon1 | ok: All items complete
2026-08-06 15:24:37.044452 | 
2026-08-06 15:24:37.067851 | osd1 | changed: "logs"
2026-08-06 15:24:37.200907 | mon1 | changed: "artifacts"
2026-08-06 15:24:37.231180 | osd1 | changed: "artifacts"
2026-08-06 15:24:37.363602 | mon1 | changed: "docs"
2026-08-06 15:24:37.415448 | osd1 | changed: "docs"
2026-08-06 15:24:37.440338 | 
2026-08-06 15:24:37.440466 | PLAY RECAP
2026-08-06 15:24:37.440518 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:24:37.440549 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-06 15:24:37.440574 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-06 15:24:37.440593 | 
2026-08-06 15:24:37.601776 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-06 15:24:37.604234 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-06 15:24:38.210014 | 
2026-08-06 15:24:38.210143 | PLAY [all]
2026-08-06 15:24:38.220912 | 
2026-08-06 15:24:38.221004 | TASK [setup-uv : Extract archive]
2026-08-06 15:24:40.597403 | osd1 | changed
2026-08-06 15:24:40.697246 | mon1 | changed
2026-08-06 15:24:40.704239 | 
2026-08-06 15:24:40.704326 | TASK [setup-uv : Print version]
2026-08-06 15:24:41.073929 | osd1 | uv 0.8.13
2026-08-06 15:24:41.074313 | mon1 | uv 0.8.13
2026-08-06 15:24:41.275694 | osd1 | ok: Runtime: 0:00:00.012683
2026-08-06 15:24:41.284150 | mon1 | ok: Runtime: 0:00:00.014738
2026-08-06 15:24:41.296986 | 
2026-08-06 15:24:41.297073 | TASK [Install Ansible collection siblings]
2026-08-06 15:24:41.658754 | mon1 | ok:
2026-08-06 15:24:41.659044 | mon1 | Skipping community.general: no checked-out sibling
2026-08-06 15:24:41.659127 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-08-06 15:24:41.659178 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-06 15:24:41.661033 | 
2026-08-06 15:24:41.661081 | PLAY RECAP
2026-08-06 15:24:41.661124 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:24:41.661163 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:24:41.661183 | 
2026-08-06 15:24:41.777143 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-06 15:24:41.781555 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-06 15:24:42.333620 | 
2026-08-06 15:24:42.333741 | PLAY [all]
2026-08-06 15:24:42.344561 | 
2026-08-06 15:24:42.344640 | LOOP [Check inventory directories]
2026-08-06 15:24:42.675725 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-06 15:24:42.821610 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory"
2026-08-06 15:24:42.991283 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory"
2026-08-06 15:24:42.997988 | 
2026-08-06 15:24:42.998082 | LOOP [Copy inventory file for Zuul]
2026-08-06 15:24:43.769302 | mon1 | changed:
2026-08-06 15:24:43.769493 | mon1 | {
2026-08-06 15:24:43.769521 | mon1 |   "ansible_loop_var": "item",
2026-08-06 15:24:43.769544 | mon1 |   "changed": false,
2026-08-06 15:24:43.769564 | mon1 |   "failed": false,
2026-08-06 15:24:43.769589 | mon1 |   "invocation": {
2026-08-06 15:24:43.769610 | mon1 |     "module_args": {
2026-08-06 15:24:43.769629 | mon1 |       "checksum_algorithm": "sha1",
2026-08-06 15:24:43.769648 | mon1 |       "follow": true,
2026-08-06 15:24:43.769666 | mon1 |       "get_attributes": true,
2026-08-06 15:24:43.769685 | mon1 |       "get_checksum": true,
2026-08-06 15:24:43.769703 | mon1 |       "get_mime": true,
2026-08-06 15:24:43.769721 | mon1 |       "path": "src/github.com/vexxhost/ansible-collection-ceph"
2026-08-06 15:24:43.769739 | mon1 |     }
2026-08-06 15:24:43.769757 | mon1 |   },
2026-08-06 15:24:43.769775 | mon1 |   "item": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-06 15:24:43.769793 | mon1 |   "stat": {
2026-08-06 15:24:43.769811 | mon1 |     "atime": 1786029876.1803277,
2026-08-06 15:24:43.769829 | mon1 |     "attr_flags": "e",
2026-08-06 15:24:43.769847 | mon1 |     "attributes": [
2026-08-06 15:24:43.769865 | mon1 |       "extents"
2026-08-06 15:24:43.769883 | mon1 |     ],
2026-08-06 15:24:43.769901 | mon1 |     "block_size": 4096,
2026-08-06 15:24:43.769918 | mon1 |     "blocks": 8,
2026-08-06 15:24:43.769936 | mon1 |     "charset": "unknown",
2026-08-06 15:24:43.769954 | mon1 |     "ctime": 1786029876.192328,
2026-08-06 15:24:43.769973 | mon1 |     "dev": 64513,
2026-08-06 15:24:43.769990 | mon1 |     "device_type": 0,
2026-08-06 15:24:43.770008 | mon1 |     "executable": true,
2026-08-06 15:24:43.770025 | mon1 |     "exists": true,
2026-08-06 15:24:43.770042 | mon1 |     "gid": 1000,
2026-08-06 15:24:43.770060 | mon1 |     "gr_name": "zuul",
2026-08-06 15:24:43.770077 | mon1 |     "inode": 1042461,
2026-08-06 15:24:43.770094 | mon1 |     "isblk": false,
2026-08-06 15:24:43.770112 | mon1 |     "ischr": false,
2026-08-06 15:24:43.770129 | mon1 |     "isdir": true,
2026-08-06 15:24:43.770146 | mon1 |     "isfifo": false,
2026-08-06 15:24:43.770163 | mon1 |     "isgid": false,
2026-08-06 15:24:43.770180 | mon1 |     "islnk": false,
2026-08-06 15:24:43.770197 | mon1 |     "isreg": false,
2026-08-06 15:24:43.770214 | mon1 |     "issock": false,
2026-08-06 15:24:43.770230 | mon1 |     "isuid": false,
2026-08-06 15:24:43.770247 | mon1 |     "mimetype": "unknown",
2026-08-06 15:24:43.770264 | mon1 |     "mode": "0755",
2026-08-06 15:24:43.770281 | mon1 |     "mtime": 1786029862.0362015,
2026-08-06 15:24:43.770298 | mon1 |     "nlink": 10,
2026-08-06 15:24:43.770315 | mon1 |     "path": "src/github.com/vexxhost/ansible-collection-ceph",
2026-08-06 15:24:43.770332 | mon1 |     "pw_name": "zuul",
2026-08-06 15:24:43.770349 | mon1 |     "readable": true,
2026-08-06 15:24:43.770366 | mon1 |     "rgrp": true,
2026-08-06 15:24:43.770384 | mon1 |     "roth": true,
2026-08-06 15:24:43.770401 | mon1 |     "rusr": true,
2026-08-06 15:24:43.770418 | mon1 |     "size": 4096,
2026-08-06 15:24:43.770450 | mon1 |     "uid": 1000,
2026-08-06 15:24:43.770468 | mon1 |     "version": "778503149",
2026-08-06 15:24:43.770485 | mon1 |     "wgrp": false,
2026-08-06 15:24:43.770505 | mon1 |     "woth": false,
2026-08-06 15:24:43.770522 | mon1 |     "writeable": true,
2026-08-06 15:24:43.770540 | mon1 |     "wusr": true,
2026-08-06 15:24:43.770558 | mon1 |     "xgrp": true,
2026-08-06 15:24:43.770575 | mon1 |     "xoth": true,
2026-08-06 15:24:43.770592 | mon1 |     "xusr": true
2026-08-06 15:24:43.770609 | mon1 |   }
2026-08-06 15:24:43.770627 | mon1 | }
2026-08-06 15:24:43.770662 | mon1 | ok: All items complete
2026-08-06 15:24:43.770683 | 
2026-08-06 15:24:43.771866 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:43.774470 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:43.789762 | 
2026-08-06 15:24:43.789916 | LOOP [Switch "ansible_host" to private IP]
2026-08-06 15:24:44.123263 | mon1 | changed: 2 replacements made
2026-08-06 15:24:44.124956 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:44.126856 | mon1 | skipping: Conditional result was False
2026-08-06 15:24:44.143720 | 
2026-08-06 15:24:44.143870 | TASK [Run Molecule scenario]
2026-08-06 15:24:44.721071 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-08-06 15:24:45.511854 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-08-06 15:24:45.693169 | mon1 | Using CPython 3.13.7
2026-08-06 15:24:45.693211 | mon1 | Creating virtual environment at: .venv
2026-08-06 15:24:45.939322 | mon1 | Downloading pygments (1.2MiB)
2026-08-06 15:24:45.939686 | mon1 | Downloading netaddr (2.2MiB)
2026-08-06 15:24:45.939957 | mon1 | Downloading cryptography (4.3MiB)
2026-08-06 15:24:45.940576 | mon1 | Downloading ansible-core (2.1MiB)
2026-08-06 15:24:46.112684 | mon1 |  Downloading netaddr
2026-08-06 15:24:46.121300 | mon1 |  Downloading cryptography
2026-08-06 15:24:46.163579 | mon1 |  Downloading pygments
2026-08-06 15:24:46.289370 | mon1 |  Downloading ansible-core
2026-08-06 15:24:46.321111 | mon1 | Installed 36 packages in 31ms
2026-08-06 15:24:47.386090 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-08-06 15:24:47.386169 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-08-06 15:24:48.018532 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-08-06 15:24:48.018621 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-08-06 15:25:31.444567 | mon1 | INFO     [default > dependency] Executing
2026-08-06 15:25:31.444825 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-08-06 15:25:31.445061 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-08-06 15:25:31.445227 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-08-06 15:25:31.450732 | mon1 | INFO     [default > cleanup] Executing
2026-08-06 15:25:31.450990 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-06 15:25:31.456156 | mon1 | INFO     [default > destroy] Executing
2026-08-06 15:25:31.456190 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-08-06 15:25:31.456243 | mon1 | INFO     [default > destroy] Executed: Successful
2026-08-06 15:25:31.461298 | mon1 | INFO     [default > syntax] Executing
2026-08-06 15:25:32.512496 | mon1 |
2026-08-06 15:25:32.512823 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-08-06 15:25:32.597232 | mon1 | INFO     [default > syntax] Executed: Successful
2026-08-06 15:25:32.607999 | mon1 | INFO     [default > create] Executing
2026-08-06 15:25:32.609623 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-06 15:25:32.614661 | mon1 | INFO     [default > prepare] Executing
2026-08-06 15:25:33.298434 | mon1 |
2026-08-06 15:25:33.298593 | mon1 | PLAY [Prepare] *****************************************************************
2026-08-06 15:25:33.298804 | mon1 |
2026-08-06 15:25:33.299008 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:25:33.299220 | mon1 | Thursday 06 August 2026  15:25:33 +0000 (0:00:00.030)       0:00:00.030 *******
2026-08-06 15:25:34.431853 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:25:34.431953 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:25:34.431995 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:25:34.432085 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:25:34.432206 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:25:34.436044 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-06 15:25:34.436129 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:25:34.436254 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:25:34.436341 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:25:34.436429 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:25:34.441924 | mon1 | ok: [mon1]
2026-08-06 15:25:34.442004 | mon1 | ok: [osd1]
2026-08-06 15:25:34.442085 | mon1 |
2026-08-06 15:25:34.442174 | mon1 | TASK [Configure short hostname] ************************************************
2026-08-06 15:25:34.442262 | mon1 | Thursday 06 August 2026  15:25:34 +0000 (0:00:01.144)       0:00:01.175 *******
2026-08-06 15:25:35.159290 | mon1 | changed: [mon1]
2026-08-06 15:25:35.159547 | mon1 | changed: [osd1]
2026-08-06 15:25:35.159751 | mon1 |
2026-08-06 15:25:35.159967 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-08-06 15:25:35.160192 | mon1 | Thursday 06 August 2026  15:25:35 +0000 (0:00:00.716)       0:00:01.891 *******
2026-08-06 15:25:35.432132 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-08-06 15:25:35.432324 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-08-06 15:25:35.432560 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-08-06 15:25:35.445939 | mon1 | changed: [osd1]
2026-08-06 15:25:35.446101 | mon1 | changed: [mon1]
2026-08-06 15:25:35.446225 | mon1 |
2026-08-06 15:25:35.446356 | mon1 | TASK [Update apt cache] ********************************************************
2026-08-06 15:25:35.446485 | mon1 | Thursday 06 August 2026  15:25:35 +0000 (0:00:00.287)       0:00:02.178 *******
2026-08-06 15:25:59.764154 | mon1 | changed: [mon1]
2026-08-06 15:25:59.764365 | mon1 | changed: [osd1]
2026-08-06 15:25:59.764378 | mon1 |
2026-08-06 15:25:59.764459 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-08-06 15:25:59.764627 | mon1 |
2026-08-06 15:25:59.764703 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:25:59.764849 | mon1 | Thursday 06 August 2026  15:25:59 +0000 (0:00:24.305)       0:00:26.483 *******
2026-08-06 15:26:00.452439 | mon1 | ok: [osd1]
2026-08-06 15:26:00.452505 | mon1 |
2026-08-06 15:26:00.452783 | mon1 | TASK [Install depedencies] *****************************************************
2026-08-06 15:26:00.452996 | mon1 | Thursday 06 August 2026  15:26:00 +0000 (0:00:00.701)       0:00:27.184 *******
2026-08-06 15:26:21.542715 | mon1 | changed: [osd1]
2026-08-06 15:26:21.542840 | mon1 |
2026-08-06 15:26:21.543012 | mon1 | TASK [Start up service] ********************************************************
2026-08-06 15:26:21.543215 | mon1 | Thursday 06 August 2026  15:26:21 +0000 (0:00:21.089)       0:00:48.274 *******
2026-08-06 15:26:22.093554 | mon1 | ok: [osd1]
2026-08-06 15:26:22.093689 | mon1 |
2026-08-06 15:26:22.093946 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-08-06 15:26:22.094117 | mon1 | Thursday 06 August 2026  15:26:22 +0000 (0:00:00.551)       0:00:48.826 *******
2026-08-06 15:26:22.393202 | mon1 | ok: [osd1]
2026-08-06 15:26:22.393346 | mon1 |
2026-08-06 15:26:22.393565 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-08-06 15:26:22.393785 | mon1 | Thursday 06 August 2026  15:26:22 +0000 (0:00:00.299)       0:00:49.125 *******
2026-08-06 15:26:23.032807 | mon1 | changed: [osd1]
2026-08-06 15:26:23.032849 | mon1 |
2026-08-06 15:26:23.032918 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-08-06 15:26:23.033010 | mon1 | Thursday 06 August 2026  15:26:23 +0000 (0:00:00.639)       0:00:49.765 *******
2026-08-06 15:26:23.220174 | mon1 | ok: [osd1]
2026-08-06 15:26:23.220375 | mon1 |
2026-08-06 15:26:23.220594 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-08-06 15:26:23.220802 | mon1 | Thursday 06 August 2026  15:26:23 +0000 (0:00:00.187)       0:00:49.952 *******
2026-08-06 15:26:23.242304 | mon1 | skipping: [osd1]
2026-08-06 15:26:23.242504 | mon1 |
2026-08-06 15:26:23.242716 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-08-06 15:26:23.242927 | mon1 | Thursday 06 August 2026  15:26:23 +0000 (0:00:00.022)       0:00:49.974 *******
2026-08-06 15:26:23.753003 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:23.753208 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:23.753412 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:23.753596 | mon1 |
2026-08-06 15:26:23.753804 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-08-06 15:26:23.754010 | mon1 | Thursday 06 August 2026  15:26:23 +0000 (0:00:00.510)       0:00:50.485 *******
2026-08-06 15:26:24.365481 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:24.365708 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:24.365913 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:24.366101 | mon1 |
2026-08-06 15:26:24.366307 | mon1 | TASK [Start loop devices] ******************************************************
2026-08-06 15:26:24.366511 | mon1 | Thursday 06 August 2026  15:26:24 +0000 (0:00:00.612)       0:00:51.097 *******
2026-08-06 15:26:25.018306 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:25.018527 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:25.018731 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:25.018920 | mon1 |
2026-08-06 15:26:25.019130 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-08-06 15:26:25.019333 | mon1 | Thursday 06 August 2026  15:26:25 +0000 (0:00:00.652)       0:00:51.750 *******
2026-08-06 15:26:28.208383 | mon1 | changed: [osd1] => (item=osd0)
2026-08-06 15:26:28.208663 | mon1 | changed: [osd1] => (item=osd1)
2026-08-06 15:26:28.208837 | mon1 | changed: [osd1] => (item=osd2)
2026-08-06 15:26:28.208999 | mon1 |
2026-08-06 15:26:28.209190 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-08-06 15:26:28.209368 | mon1 | Thursday 06 August 2026  15:26:28 +0000 (0:00:03.189)       0:00:54.940 *******
2026-08-06 15:26:30.051467 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-08-06 15:26:30.051544 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-08-06 15:26:30.051552 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-08-06 15:26:30.051558 | mon1 |
2026-08-06 15:26:30.051565 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:26:30.051572 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-08-06 15:26:30.051580 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-08-06 15:26:30.051585 | mon1 |
2026-08-06 15:26:30.051591 | mon1 |
2026-08-06 15:26:30.051597 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:26:30.051603 | mon1 | Thursday 06 August 2026  15:26:30 +0000 (0:00:01.841)       0:00:56.782 *******
2026-08-06 15:26:30.051609 | mon1 | ===============================================================================
2026-08-06 15:26:30.051615 | mon1 | Update apt cache ------------------------------------------------------- 24.30s
2026-08-06 15:26:30.051620 | mon1 | Install depedencies ---------------------------------------------------- 21.09s
2026-08-06 15:26:30.051626 | mon1 | Create a volume group for each loop device ------------------------------ 3.19s
2026-08-06 15:26:30.051639 | mon1 | Create a logical volume for each loop device ---------------------------- 1.84s
2026-08-06 15:26:30.051671 | mon1 | Gathering Facts --------------------------------------------------------- 1.14s
2026-08-06 15:26:30.051811 | mon1 | Configure short hostname ------------------------------------------------ 0.72s
2026-08-06 15:26:30.051944 | mon1 | Gathering Facts --------------------------------------------------------- 0.70s
2026-08-06 15:26:30.052092 | mon1 | Start loop devices ------------------------------------------------------ 0.65s
2026-08-06 15:26:30.052256 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.64s
2026-08-06 15:26:30.052386 | mon1 | Set permissions on loopback devices ------------------------------------- 0.61s
2026-08-06 15:26:30.052509 | mon1 | Start up service -------------------------------------------------------- 0.55s
2026-08-06 15:26:30.052639 | mon1 | Create devices for Ceph ------------------------------------------------- 0.51s
2026-08-06 15:26:30.052769 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.30s
2026-08-06 15:26:30.052901 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-08-06 15:26:30.053036 | mon1 | Get list of all loopback devices ---------------------------------------- 0.19s
2026-08-06 15:26:30.053170 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-08-06 15:26:30.139456 | mon1 | INFO     [default > prepare] Executed: Successful
2026-08-06 15:26:30.149372 | mon1 | INFO     [default > converge] Executing
2026-08-06 15:26:30.990933 | mon1 |
2026-08-06 15:26:30.991043 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-06 15:26:30.991284 | mon1 |
2026-08-06 15:26:30.991533 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:26:30.991749 | mon1 | Thursday 06 August 2026  15:26:30 +0000 (0:00:00.045)       0:00:00.045 *******
2026-08-06 15:26:31.968251 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:26:31.968428 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:26:31.968631 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:26:31.968828 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:26:31.969033 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:26:31.981468 | mon1 | ok: [mon1]
2026-08-06 15:26:31.981631 | mon1 |
2026-08-06 15:26:31.981834 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:26:31.982040 | mon1 | Thursday 06 August 2026  15:26:31 +0000 (0:00:00.990)       0:00:01.036 *******
2026-08-06 15:26:32.261683 | mon1 | ok: [mon1]
2026-08-06 15:26:32.261823 | mon1 |
2026-08-06 15:26:32.262038 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:26:32.262263 | mon1 | Thursday 06 August 2026  15:26:32 +0000 (0:00:00.280)       0:00:01.316 *******
2026-08-06 15:26:32.298606 | mon1 | skipping: [mon1]
2026-08-06 15:26:32.299207 | mon1 |
2026-08-06 15:26:32.299240 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:26:32.299256 | mon1 | Thursday 06 August 2026  15:26:32 +0000 (0:00:00.037)       0:00:01.353 *******
2026-08-06 15:26:32.619157 | mon1 | changed: [mon1]
2026-08-06 15:26:32.619254 | mon1 |
2026-08-06 15:26:32.619517 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:26:32.619794 | mon1 | Thursday 06 August 2026  15:26:32 +0000 (0:00:00.319)       0:00:01.673 *******
2026-08-06 15:26:32.715450 | mon1 | ok: [mon1] => {
2026-08-06 15:26:32.715708 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:26:32.715916 | mon1 | }
2026-08-06 15:26:32.716062 | mon1 |
2026-08-06 15:26:32.716314 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:26:32.716474 | mon1 | Thursday 06 August 2026  15:26:32 +0000 (0:00:00.096)       0:00:01.770 *******
2026-08-06 15:26:33.363386 | mon1 | changed: [mon1]
2026-08-06 15:26:33.363579 | mon1 |
2026-08-06 15:26:33.363795 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:26:33.364002 | mon1 | Thursday 06 August 2026  15:26:33 +0000 (0:00:00.647)       0:00:02.418 *******
2026-08-06 15:26:33.406249 | mon1 | skipping: [mon1]
2026-08-06 15:26:33.406426 | mon1 |
2026-08-06 15:26:33.406631 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:26:33.406829 | mon1 | Thursday 06 August 2026  15:26:33 +0000 (0:00:00.043)       0:00:02.461 *******
2026-08-06 15:26:33.448831 | mon1 | skipping: [mon1]
2026-08-06 15:26:33.449003 | mon1 |
2026-08-06 15:26:33.449200 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:26:33.449395 | mon1 | Thursday 06 August 2026  15:26:33 +0000 (0:00:00.042)       0:00:02.504 *******
2026-08-06 15:26:33.657292 | mon1 | ok: [mon1]
2026-08-06 15:26:33.657438 | mon1 |
2026-08-06 15:26:33.657726 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:26:33.657964 | mon1 | Thursday 06 August 2026  15:26:33 +0000 (0:00:00.207)       0:00:02.711 *******
2026-08-06 15:26:34.959509 | mon1 | ok: [mon1]
2026-08-06 15:26:34.959620 | mon1 |
2026-08-06 15:26:34.960031 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:26:34.960128 | mon1 | Thursday 06 August 2026  15:26:34 +0000 (0:00:01.302)       0:00:04.013 *******
2026-08-06 15:26:35.032597 | mon1 | ok: [mon1] => {
2026-08-06 15:26:35.033275 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:26:35.033357 | mon1 | }
2026-08-06 15:26:35.033366 | mon1 |
2026-08-06 15:26:35.033373 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:26:35.033396 | mon1 | Thursday 06 August 2026  15:26:35 +0000 (0:00:00.073)       0:00:04.087 *******
2026-08-06 15:26:35.707339 | mon1 | changed: [mon1]
2026-08-06 15:26:35.707431 | mon1 |
2026-08-06 15:26:35.707652 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:26:35.707721 | mon1 | Thursday 06 August 2026  15:26:35 +0000 (0:00:00.675)       0:00:04.762 *******
2026-08-06 15:26:39.693459 | mon1 | changed: [mon1]
2026-08-06 15:26:39.693547 | mon1 |
2026-08-06 15:26:39.693560 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:26:39.693708 | mon1 | Thursday 06 August 2026  15:26:39 +0000 (0:00:03.985)       0:00:08.748 *******
2026-08-06 15:26:39.722607 | mon1 | skipping: [mon1]
2026-08-06 15:26:39.722656 | mon1 |
2026-08-06 15:26:39.722914 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:26:39.723127 | mon1 | Thursday 06 August 2026  15:26:39 +0000 (0:00:00.029)       0:00:08.777 *******
2026-08-06 15:26:39.750216 | mon1 | skipping: [mon1]
2026-08-06 15:26:39.750551 | mon1 |
2026-08-06 15:26:39.750658 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:26:39.750665 | mon1 | Thursday 06 August 2026  15:26:39 +0000 (0:00:00.027)       0:00:08.804 *******
2026-08-06 15:26:39.779899 | mon1 | skipping: [mon1]
2026-08-06 15:26:39.780016 | mon1 |
2026-08-06 15:26:39.780170 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:26:39.780362 | mon1 | Thursday 06 August 2026  15:26:39 +0000 (0:00:00.030)       0:00:08.834 *******
2026-08-06 15:26:47.827220 | mon1 | changed: [mon1]
2026-08-06 15:26:47.827328 | mon1 |
2026-08-06 15:26:47.827341 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:26:47.827521 | mon1 | Thursday 06 August 2026  15:26:47 +0000 (0:00:08.047)       0:00:16.882 *******
2026-08-06 15:26:48.447917 | mon1 | changed: [mon1]
2026-08-06 15:26:48.448002 | mon1 |
2026-08-06 15:26:48.448315 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:26:48.448382 | mon1 | Thursday 06 August 2026  15:26:48 +0000 (0:00:00.620)       0:00:17.502 *******
2026-08-06 15:26:49.359196 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:26:49.359468 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:26:49.359486 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:26:49.359496 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:26:49.359860 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:26:49.359924 | mon1 |
2026-08-06 15:26:49.359931 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:26:49.359936 | mon1 | Thursday 06 August 2026  15:26:49 +0000 (0:00:00.911)       0:00:18.414 *******
2026-08-06 15:26:49.991598 | mon1 | changed: [mon1]
2026-08-06 15:26:49.991681 | mon1 |
2026-08-06 15:26:49.991696 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:26:49.992066 | mon1 | Thursday 06 August 2026  15:26:49 +0000 (0:00:00.623)       0:00:19.037 *******
2026-08-06 15:26:49.992084 | mon1 |
2026-08-06 15:26:49.992090 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:26:49.992094 | mon1 | Thursday 06 August 2026  15:26:49 +0000 (0:00:00.008)       0:00:19.046 *******
2026-08-06 15:26:50.890951 | mon1 | ok: [mon1]
2026-08-06 15:26:50.891006 | mon1 |
2026-08-06 15:26:50.891013 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-06 15:26:50.891019 | mon1 | Thursday 06 August 2026  15:26:50 +0000 (0:00:00.898)       0:00:19.945 *******
2026-08-06 15:26:51.342803 | mon1 | changed: [mon1]
2026-08-06 15:26:51.342887 | mon1 |
2026-08-06 15:26:51.342896 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:26:51.342903 | mon1 | Thursday 06 August 2026  15:26:51 +0000 (0:00:00.450)       0:00:20.396 *******
2026-08-06 15:26:51.889400 | mon1 | changed: [mon1]
2026-08-06 15:26:51.889488 | mon1 |
2026-08-06 15:26:51.889504 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:26:51.889660 | mon1 | Thursday 06 August 2026  15:26:51 +0000 (0:00:00.547)       0:00:20.944 *******
2026-08-06 15:26:52.100359 | mon1 | ok: [mon1]
2026-08-06 15:26:52.100449 | mon1 |
2026-08-06 15:26:52.100461 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:26:52.100620 | mon1 | Thursday 06 August 2026  15:26:52 +0000 (0:00:00.210)       0:00:21.155 *******
2026-08-06 15:26:52.175384 | mon1 | ok: [mon1] => {
2026-08-06 15:26:52.176048 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:26:52.176104 | mon1 | }
2026-08-06 15:26:52.176111 | mon1 |
2026-08-06 15:26:52.176118 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:26:52.176125 | mon1 | Thursday 06 August 2026  15:26:52 +0000 (0:00:00.074)       0:00:21.230 *******
2026-08-06 15:26:53.246257 | mon1 | changed: [mon1]
2026-08-06 15:26:53.246353 | mon1 |
2026-08-06 15:26:53.246653 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:26:53.246721 | mon1 | Thursday 06 August 2026  15:26:53 +0000 (0:00:01.070)       0:00:22.301 *******
2026-08-06 15:26:57.760219 | mon1 | changed: [mon1]
2026-08-06 15:26:57.760301 | mon1 |
2026-08-06 15:26:57.760317 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:26:57.760484 | mon1 | Thursday 06 August 2026  15:26:57 +0000 (0:00:04.514)       0:00:26.815 *******
2026-08-06 15:26:58.831519 | mon1 | ok: [mon1]
2026-08-06 15:26:58.831615 | mon1 |
2026-08-06 15:26:58.831633 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:26:58.831792 | mon1 | Thursday 06 August 2026  15:26:58 +0000 (0:00:01.071)       0:00:27.886 *******
2026-08-06 15:26:59.204130 | mon1 | changed: [mon1]
2026-08-06 15:26:59.204201 | mon1 |
2026-08-06 15:26:59.204539 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:26:59.204611 | mon1 | Thursday 06 August 2026  15:26:59 +0000 (0:00:00.372)       0:00:28.258 *******
2026-08-06 15:26:59.682650 | mon1 | changed: [mon1]
2026-08-06 15:26:59.682722 | mon1 |
2026-08-06 15:26:59.683038 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:26:59.683104 | mon1 | Thursday 06 August 2026  15:26:59 +0000 (0:00:00.478)       0:00:28.737 *******
2026-08-06 15:27:00.249903 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:27:00.249965 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:27:00.249972 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:27:00.249978 | mon1 |
2026-08-06 15:27:00.249983 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:27:00.249987 | mon1 | Thursday 06 August 2026  15:27:00 +0000 (0:00:00.567)       0:00:29.304 *******
2026-08-06 15:27:00.717740 | mon1 | changed: [mon1]
2026-08-06 15:27:00.717810 | mon1 |
2026-08-06 15:27:00.717872 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:27:00.718007 | mon1 | Thursday 06 August 2026  15:27:00 +0000 (0:00:00.467)       0:00:29.772 *******
2026-08-06 15:27:01.193375 | mon1 | changed: [mon1]
2026-08-06 15:27:01.193451 | mon1 |
2026-08-06 15:27:01.193516 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:27:01.193915 | mon1 | Thursday 06 August 2026  15:27:01 +0000 (0:00:00.469)       0:00:30.242 *******
2026-08-06 15:27:01.193980 | mon1 |
2026-08-06 15:27:01.193986 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:27:01.194003 | mon1 | Thursday 06 August 2026  15:27:01 +0000 (0:00:00.006)       0:00:30.248 *******
2026-08-06 15:27:01.909050 | mon1 | ok: [mon1]
2026-08-06 15:27:01.909149 | mon1 |
2026-08-06 15:27:01.909421 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-06 15:27:01.909494 | mon1 | Thursday 06 August 2026  15:27:01 +0000 (0:00:00.715)       0:00:30.963 *******
2026-08-06 15:27:02.833669 | mon1 | changed: [mon1]
2026-08-06 15:27:02.833773 | mon1 |
2026-08-06 15:27:02.834039 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:27:02.834120 | mon1 | Thursday 06 August 2026  15:27:02 +0000 (0:00:00.924)       0:00:31.888 *******
2026-08-06 15:27:03.389464 | mon1 | changed: [mon1]
2026-08-06 15:27:03.389563 | mon1 |
2026-08-06 15:27:03.389576 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:27:03.389643 | mon1 | Thursday 06 August 2026  15:27:03 +0000 (0:00:00.556)       0:00:32.444 *******
2026-08-06 15:27:03.434857 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-06 15:27:03.434932 | mon1 |
2026-08-06 15:27:03.435180 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:27:03.435244 | mon1 | Thursday 06 August 2026  15:27:03 +0000 (0:00:00.045)       0:00:32.489 *******
2026-08-06 15:27:29.852844 | mon1 | changed: [mon1]
2026-08-06 15:27:29.853124 | mon1 |
2026-08-06 15:27:29.853140 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:27:29.853153 | mon1 | Thursday 06 August 2026  15:27:29 +0000 (0:00:26.417)       0:00:58.907 *******
2026-08-06 15:27:30.594658 | mon1 | ok: [mon1] => (item=chronyd)
2026-08-06 15:27:30.594752 | mon1 | ok: [mon1] => (item=sshd)
2026-08-06 15:27:30.594760 | mon1 |
2026-08-06 15:27:30.595017 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:27:30.595067 | mon1 | Thursday 06 August 2026  15:27:30 +0000 (0:00:00.742)       0:00:59.649 *******
2026-08-06 15:27:31.526298 | mon1 | changed: [mon1]
2026-08-06 15:27:31.526377 | mon1 |
2026-08-06 15:27:31.526686 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:27:31.526770 | mon1 | Thursday 06 August 2026  15:27:31 +0000 (0:00:00.931)       0:01:00.580 *******
2026-08-06 15:27:31.731470 | mon1 | ok: [mon1]
2026-08-06 15:27:31.731561 | mon1 |
2026-08-06 15:27:31.731691 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:27:31.731821 | mon1 | Thursday 06 August 2026  15:27:31 +0000 (0:00:00.205)       0:01:00.786 *******
2026-08-06 15:27:32.180572 | mon1 | changed: [mon1]
2026-08-06 15:27:32.180727 | mon1 |
2026-08-06 15:27:32.180948 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:27:32.181155 | mon1 | Thursday 06 August 2026  15:27:32 +0000 (0:00:00.449)       0:01:01.235 *******
2026-08-06 15:27:32.510158 | mon1 | changed: [mon1]
2026-08-06 15:27:32.510312 | mon1 |
2026-08-06 15:27:32.510523 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-06 15:27:32.510722 | mon1 | Thursday 06 August 2026  15:27:32 +0000 (0:00:00.329)       0:01:01.565 *******
2026-08-06 15:27:32.625616 | mon1 | ok: [mon1]
2026-08-06 15:27:32.625818 | mon1 |
2026-08-06 15:27:32.626032 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-06 15:27:32.626238 | mon1 | Thursday 06 August 2026  15:27:32 +0000 (0:00:00.115)       0:01:01.680 *******
2026-08-06 15:27:32.848845 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:27:32.849002 | mon1 |
2026-08-06 15:27:32.849214 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-06 15:27:32.849412 | mon1 | Thursday 06 August 2026  15:27:32 +0000 (0:00:00.222)       0:01:01.903 *******
2026-08-06 15:27:32.896648 | mon1 | ok: [mon1]
2026-08-06 15:27:32.896848 | mon1 |
2026-08-06 15:27:32.897062 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-06 15:27:32.897269 | mon1 | Thursday 06 August 2026  15:27:32 +0000 (0:00:00.048)       0:01:01.951 *******
2026-08-06 15:27:32.976688 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-08-06 15:27:32.976886 | mon1 |
2026-08-06 15:27:32.977101 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-08-06 15:27:32.977310 | mon1 | Thursday 06 August 2026  15:27:32 +0000 (0:00:00.080)       0:01:02.031 *******
2026-08-06 15:27:33.270885 | mon1 | changed: [mon1]
2026-08-06 15:27:33.271042 | mon1 |
2026-08-06 15:27:33.271256 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-08-06 15:27:33.271498 | mon1 | Thursday 06 August 2026  15:27:33 +0000 (0:00:00.293)       0:01:02.325 *******
2026-08-06 15:27:33.989217 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-08-06 15:27:33.989290 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-08-06 15:27:33.989302 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-08-06 15:27:33.989313 | mon1 |
2026-08-06 15:27:33.989322 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-08-06 15:27:33.989332 | mon1 | Thursday 06 August 2026  15:27:33 +0000 (0:00:00.717)       0:01:03.042 *******
2026-08-06 15:29:04.219972 | mon1 | ok: [mon1]
2026-08-06 15:29:04.220269 | mon1 |
2026-08-06 15:29:04.220443 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-08-06 15:29:04.220612 | mon1 | Thursday 06 August 2026  15:29:04 +0000 (0:01:30.219)       0:02:33.262 *******
2026-08-06 15:29:04.415561 | mon1 | changed: [mon1]
2026-08-06 15:29:04.415628 | mon1 |
2026-08-06 15:29:04.415640 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-08-06 15:29:04.415852 | mon1 | Thursday 06 August 2026  15:29:04 +0000 (0:00:00.207)       0:02:33.469 *******
2026-08-06 15:29:04.446672 | mon1 | ok: [mon1]
2026-08-06 15:29:04.446705 | mon1 |
2026-08-06 15:29:04.446716 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:29:04.446726 | mon1 | Thursday 06 August 2026  15:29:04 +0000 (0:00:00.031)       0:02:33.501 *******
2026-08-06 15:29:04.525232 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:29:04.525265 | mon1 |
2026-08-06 15:29:04.525276 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:29:04.525286 | mon1 | Thursday 06 August 2026  15:29:04 +0000 (0:00:00.078)       0:02:33.579 *******
2026-08-06 15:29:06.071329 | mon1 | ok: [mon1]
2026-08-06 15:29:06.071417 | mon1 |
2026-08-06 15:29:06.071432 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:29:06.071443 | mon1 | Thursday 06 August 2026  15:29:06 +0000 (0:00:01.545)       0:02:35.125 *******
2026-08-06 15:29:06.119353 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:29:06.119437 | mon1 |
2026-08-06 15:29:06.119449 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:29:06.119460 | mon1 | Thursday 06 August 2026  15:29:06 +0000 (0:00:00.048)       0:02:35.173 *******
2026-08-06 15:29:06.473460 | mon1 | ok: [mon1]
2026-08-06 15:29:06.473526 | mon1 |
2026-08-06 15:29:06.473539 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:29:06.473549 | mon1 | Thursday 06 August 2026  15:29:06 +0000 (0:00:00.353)       0:02:35.527 *******
2026-08-06 15:29:08.644391 | mon1 | ok: [mon1]
2026-08-06 15:29:08.644449 | mon1 |
2026-08-06 15:29:08.644462 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-06 15:29:08.644473 | mon1 | Thursday 06 August 2026  15:29:08 +0000 (0:00:02.171)       0:02:37.698 *******
2026-08-06 15:29:11.861617 | mon1 | changed: [mon1]
2026-08-06 15:29:11.861776 | mon1 |
2026-08-06 15:29:11.861986 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-08-06 15:29:11.862188 | mon1 | Thursday 06 August 2026  15:29:11 +0000 (0:00:03.217)       0:02:40.916 *******
2026-08-06 15:29:13.480238 | mon1 | ok: [mon1]
2026-08-06 15:29:13.480299 | mon1 |
2026-08-06 15:29:13.480329 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:29:13.480340 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:01.617)       0:02:42.534 *******
2026-08-06 15:29:13.535839 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:29:13.535920 | mon1 |
2026-08-06 15:29:13.536140 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:29:13.536178 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:00.056)       0:02:42.590 *******
2026-08-06 15:29:13.577722 | mon1 | skipping: [mon1]
2026-08-06 15:29:13.578296 | mon1 |
2026-08-06 15:29:13.578371 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:29:13.578382 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:00.041)       0:02:42.632 *******
2026-08-06 15:29:13.616986 | mon1 | skipping: [mon1] => (item=mon1)
2026-08-06 15:29:13.617076 | mon1 | skipping: [mon1]
2026-08-06 15:29:13.617404 | mon1 |
2026-08-06 15:29:13.617465 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:29:13.617471 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:00.039)       0:02:42.671 *******
2026-08-06 15:29:13.884946 | mon1 | ok: [mon1]
2026-08-06 15:29:13.885012 | mon1 |
2026-08-06 15:29:13.885122 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:29:13.885268 | mon1 | Thursday 06 August 2026  15:29:13 +0000 (0:00:00.267)       0:02:42.939 *******
2026-08-06 15:29:16.047557 | mon1 | ok: [mon1]
2026-08-06 15:29:16.047623 | mon1 |
2026-08-06 15:29:16.047832 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-08-06 15:29:16.047876 | mon1 | Thursday 06 August 2026  15:29:16 +0000 (0:00:02.163)       0:02:45.102 *******
2026-08-06 15:29:18.778691 | mon1 | changed: [mon1]
2026-08-06 15:29:18.778741 | mon1 |
2026-08-06 15:29:18.778749 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-08-06 15:29:18.778755 | mon1 | Thursday 06 August 2026  15:29:18 +0000 (0:00:02.730)       0:02:47.833 *******
2026-08-06 15:29:20.380740 | mon1 | ok: [mon1]
2026-08-06 15:29:20.380812 | mon1 |
2026-08-06 15:29:20.381022 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-08-06 15:29:20.381068 | mon1 | Thursday 06 August 2026  15:29:20 +0000 (0:00:01.602)       0:02:49.435 *******
2026-08-06 15:29:25.980913 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-08-06 15:29:25.980985 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-08-06 15:29:25.981000 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-08-06 15:29:25.981111 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-08-06 15:29:25.981205 | mon1 |
2026-08-06 15:29:25.981304 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-06 15:29:25.981357 | mon1 |
2026-08-06 15:29:25.981470 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:29:25.981541 | mon1 | Thursday 06 August 2026  15:29:25 +0000 (0:00:05.600)       0:02:55.036 *******
2026-08-06 15:29:27.071576 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-06 15:29:27.071634 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:29:27.071646 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:29:27.071657 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:29:27.071666 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:29:27.084630 | mon1 | ok: [osd1]
2026-08-06 15:29:27.084650 | mon1 |
2026-08-06 15:29:27.084656 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:29:27.084660 | mon1 | Thursday 06 August 2026  15:29:27 +0000 (0:00:01.103)       0:02:56.139 *******
2026-08-06 15:29:27.329645 | mon1 | ok: [osd1]
2026-08-06 15:29:27.329683 | mon1 |
2026-08-06 15:29:27.329689 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:29:27.329694 | mon1 | Thursday 06 August 2026  15:29:27 +0000 (0:00:00.244)       0:02:56.384 *******
2026-08-06 15:29:27.360216 | mon1 | skipping: [osd1]
2026-08-06 15:29:27.360253 | mon1 |
2026-08-06 15:29:27.360259 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:29:27.360263 | mon1 | Thursday 06 August 2026  15:29:27 +0000 (0:00:00.030)       0:02:56.415 *******
2026-08-06 15:29:27.563414 | mon1 | changed: [osd1]
2026-08-06 15:29:27.563455 | mon1 |
2026-08-06 15:29:27.563474 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:29:27.563479 | mon1 | Thursday 06 August 2026  15:29:27 +0000 (0:00:00.200)       0:02:56.615 *******
2026-08-06 15:29:27.610637 | mon1 | ok: [osd1] => {
2026-08-06 15:29:27.610680 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:29:27.610686 | mon1 | }
2026-08-06 15:29:27.610691 | mon1 |
2026-08-06 15:29:27.610695 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:29:27.610700 | mon1 | Thursday 06 August 2026  15:29:27 +0000 (0:00:00.049)       0:02:56.665 *******
2026-08-06 15:29:28.201700 | mon1 | changed: [osd1]
2026-08-06 15:29:28.201742 | mon1 |
2026-08-06 15:29:28.201750 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:29:28.201756 | mon1 | Thursday 06 August 2026  15:29:28 +0000 (0:00:00.591)       0:02:57.256 *******
2026-08-06 15:29:28.240450 | mon1 | skipping: [osd1]
2026-08-06 15:29:28.240466 | mon1 |
2026-08-06 15:29:28.240471 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:29:28.240476 | mon1 | Thursday 06 August 2026  15:29:28 +0000 (0:00:00.039)       0:02:57.295 *******
2026-08-06 15:29:28.278302 | mon1 | skipping: [osd1]
2026-08-06 15:29:28.278317 | mon1 |
2026-08-06 15:29:28.278327 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:29:28.278332 | mon1 | Thursday 06 August 2026  15:29:28 +0000 (0:00:00.037)       0:02:57.333 *******
2026-08-06 15:29:28.494601 | mon1 | ok: [osd1]
2026-08-06 15:29:28.494659 | mon1 |
2026-08-06 15:29:28.494847 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:29:28.494892 | mon1 | Thursday 06 August 2026  15:29:28 +0000 (0:00:00.216)       0:02:57.549 *******
2026-08-06 15:29:29.767687 | mon1 | ok: [osd1]
2026-08-06 15:29:29.767763 | mon1 |
2026-08-06 15:29:29.767820 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:29:29.767945 | mon1 | Thursday 06 August 2026  15:29:29 +0000 (0:00:01.273)       0:02:58.822 *******
2026-08-06 15:29:29.823857 | mon1 | ok: [osd1] => {
2026-08-06 15:29:29.824465 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:29:29.824498 | mon1 | }
2026-08-06 15:29:29.824505 | mon1 |
2026-08-06 15:29:29.824512 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:29:29.824519 | mon1 | Thursday 06 August 2026  15:29:29 +0000 (0:00:00.055)       0:02:58.878 *******
2026-08-06 15:29:30.576982 | mon1 | changed: [osd1]
2026-08-06 15:29:30.577054 | mon1 |
2026-08-06 15:29:30.577296 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:29:30.577343 | mon1 | Thursday 06 August 2026  15:29:30 +0000 (0:00:00.753)       0:02:59.631 *******
2026-08-06 15:29:33.204346 | mon1 | changed: [osd1]
2026-08-06 15:29:33.204390 | mon1 |
2026-08-06 15:29:33.204396 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:29:33.204401 | mon1 | Thursday 06 August 2026  15:29:33 +0000 (0:00:02.627)       0:03:02.259 *******
2026-08-06 15:29:33.232651 | mon1 | skipping: [osd1]
2026-08-06 15:29:33.232672 | mon1 |
2026-08-06 15:29:33.232680 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:29:33.232686 | mon1 | Thursday 06 August 2026  15:29:33 +0000 (0:00:00.028)       0:03:02.287 *******
2026-08-06 15:29:33.257655 | mon1 | skipping: [osd1]
2026-08-06 15:29:33.257679 | mon1 |
2026-08-06 15:29:33.257686 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:29:33.257692 | mon1 | Thursday 06 August 2026  15:29:33 +0000 (0:00:00.024)       0:03:02.312 *******
2026-08-06 15:29:33.284556 | mon1 | skipping: [osd1]
2026-08-06 15:29:33.284579 | mon1 |
2026-08-06 15:29:33.284586 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:29:33.284592 | mon1 | Thursday 06 August 2026  15:29:33 +0000 (0:00:00.026)       0:03:02.339 *******
2026-08-06 15:30:08.817305 | mon1 | changed: [osd1]
2026-08-06 15:30:08.817379 | mon1 |
2026-08-06 15:30:08.817446 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:30:08.817599 | mon1 | Thursday 06 August 2026  15:30:08 +0000 (0:00:35.532)       0:03:37.871 *******
2026-08-06 15:30:09.279285 | mon1 | changed: [osd1]
2026-08-06 15:30:09.279373 | mon1 |
2026-08-06 15:30:09.279380 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:30:09.279391 | mon1 | Thursday 06 August 2026  15:30:09 +0000 (0:00:00.461)       0:03:38.333 *******
2026-08-06 15:30:10.163504 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-08-06 15:30:10.163632 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:30:10.163648 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:30:10.163658 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:30:10.164029 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:30:10.164085 | mon1 |
2026-08-06 15:30:10.164092 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:30:10.164098 | mon1 | Thursday 06 August 2026  15:30:10 +0000 (0:00:00.884)       0:03:39.218 *******
2026-08-06 15:30:10.677715 | mon1 | changed: [osd1]
2026-08-06 15:30:10.677761 | mon1 |
2026-08-06 15:30:10.677828 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:30:10.678246 | mon1 | Thursday 06 August 2026  15:30:10 +0000 (0:00:00.508)       0:03:39.727 *******
2026-08-06 15:30:10.678331 | mon1 |
2026-08-06 15:30:10.678338 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:30:10.678343 | mon1 | Thursday 06 August 2026  15:30:10 +0000 (0:00:00.005)       0:03:39.732 *******
2026-08-06 15:30:11.382987 | mon1 | ok: [osd1]
2026-08-06 15:30:11.383117 | mon1 |
2026-08-06 15:30:11.383143 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-08-06 15:30:11.383191 | mon1 | Thursday 06 August 2026  15:30:11 +0000 (0:00:00.705)       0:03:40.437 *******
2026-08-06 15:30:11.824975 | mon1 | changed: [osd1]
2026-08-06 15:30:11.825065 | mon1 |
2026-08-06 15:30:11.825078 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:30:11.825149 | mon1 | Thursday 06 August 2026  15:30:11 +0000 (0:00:00.442)       0:03:40.879 *******
2026-08-06 15:30:12.366455 | mon1 | changed: [osd1]
2026-08-06 15:30:12.366571 | mon1 |
2026-08-06 15:30:12.366584 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:30:12.366700 | mon1 | Thursday 06 August 2026  15:30:12 +0000 (0:00:00.541)       0:03:41.421 *******
2026-08-06 15:30:12.566554 | mon1 | ok: [osd1]
2026-08-06 15:30:12.566609 | mon1 |
2026-08-06 15:30:12.566866 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:30:12.566954 | mon1 | Thursday 06 August 2026  15:30:12 +0000 (0:00:00.199)       0:03:41.621 *******
2026-08-06 15:30:12.623351 | mon1 | ok: [osd1] => {
2026-08-06 15:30:12.624004 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:30:12.624054 | mon1 | }
2026-08-06 15:30:12.624062 | mon1 |
2026-08-06 15:30:12.624069 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:30:12.624076 | mon1 | Thursday 06 August 2026  15:30:12 +0000 (0:00:00.057)       0:03:41.678 *******
2026-08-06 15:30:13.477140 | mon1 | changed: [osd1]
2026-08-06 15:30:13.477260 | mon1 |
2026-08-06 15:30:13.477273 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:30:13.477284 | mon1 | Thursday 06 August 2026  15:30:13 +0000 (0:00:00.853)       0:03:42.531 *******
2026-08-06 15:30:17.866410 | mon1 | changed: [osd1]
2026-08-06 15:30:17.866570 | mon1 |
2026-08-06 15:30:17.866592 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:30:17.866608 | mon1 | Thursday 06 August 2026  15:30:17 +0000 (0:00:04.389)       0:03:46.921 *******
2026-08-06 15:30:19.264765 | mon1 | ok: [osd1]
2026-08-06 15:30:19.264839 | mon1 |
2026-08-06 15:30:19.264853 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:30:19.264967 | mon1 | Thursday 06 August 2026  15:30:19 +0000 (0:00:01.398)       0:03:48.319 *******
2026-08-06 15:30:19.492504 | mon1 | changed: [osd1]
2026-08-06 15:30:19.492566 | mon1 |
2026-08-06 15:30:19.492580 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:30:19.492684 | mon1 | Thursday 06 August 2026  15:30:19 +0000 (0:00:00.227)       0:03:48.547 *******
2026-08-06 15:30:19.950231 | mon1 | changed: [osd1]
2026-08-06 15:30:19.950274 | mon1 |
2026-08-06 15:30:19.950460 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:30:19.950503 | mon1 | Thursday 06 August 2026  15:30:19 +0000 (0:00:00.457)       0:03:49.005 *******
2026-08-06 15:30:20.489321 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-08-06 15:30:20.489381 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:30:20.489397 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:30:20.489764 | mon1 |
2026-08-06 15:30:20.489808 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:30:20.489815 | mon1 | Thursday 06 August 2026  15:30:20 +0000 (0:00:00.539)       0:03:49.544 *******
2026-08-06 15:30:20.938256 | mon1 | changed: [osd1]
2026-08-06 15:30:20.938323 | mon1 |
2026-08-06 15:30:20.938631 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:30:20.938712 | mon1 | Thursday 06 August 2026  15:30:20 +0000 (0:00:00.448)       0:03:49.993 *******
2026-08-06 15:30:21.416793 | mon1 | changed: [osd1]
2026-08-06 15:30:21.416859 | mon1 |
2026-08-06 15:30:21.416922 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:30:21.417284 | mon1 | Thursday 06 August 2026  15:30:21 +0000 (0:00:00.473)       0:03:50.466 *******
2026-08-06 15:30:21.417330 | mon1 |
2026-08-06 15:30:21.417335 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-08-06 15:30:21.417340 | mon1 | Thursday 06 August 2026  15:30:21 +0000 (0:00:00.005)       0:03:50.471 *******
2026-08-06 15:30:22.100242 | mon1 | ok: [osd1]
2026-08-06 15:30:22.100295 | mon1 |
2026-08-06 15:30:22.100584 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-08-06 15:30:22.100628 | mon1 | Thursday 06 August 2026  15:30:22 +0000 (0:00:00.683)       0:03:51.154 *******
2026-08-06 15:30:22.823695 | mon1 | changed: [osd1]
2026-08-06 15:30:22.823796 | mon1 |
2026-08-06 15:30:22.823820 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:30:22.823832 | mon1 | Thursday 06 August 2026  15:30:22 +0000 (0:00:00.723)       0:03:51.878 *******
2026-08-06 15:30:23.370028 | mon1 | changed: [osd1]
2026-08-06 15:30:23.370108 | mon1 |
2026-08-06 15:30:23.370121 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:30:23.370225 | mon1 | Thursday 06 August 2026  15:30:23 +0000 (0:00:00.546)       0:03:52.424 *******
2026-08-06 15:30:23.410502 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-06 15:30:23.410578 | mon1 |
2026-08-06 15:30:23.410796 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:30:23.410841 | mon1 | Thursday 06 August 2026  15:30:23 +0000 (0:00:00.040)       0:03:52.465 *******
2026-08-06 15:30:30.184079 | mon1 | changed: [osd1]
2026-08-06 15:30:30.184160 | mon1 |
2026-08-06 15:30:30.184435 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:30:30.184483 | mon1 | Thursday 06 August 2026  15:30:30 +0000 (0:00:06.773)       0:03:59.239 *******
2026-08-06 15:30:30.871233 | mon1 | ok: [osd1] => (item=chronyd)
2026-08-06 15:30:30.871567 | mon1 | ok: [osd1] => (item=sshd)
2026-08-06 15:30:30.871613 | mon1 |
2026-08-06 15:30:30.871635 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:30:30.871780 | mon1 | Thursday 06 August 2026  15:30:30 +0000 (0:00:00.687)       0:03:59.926 *******
2026-08-06 15:30:32.008910 | mon1 | changed: [osd1]
2026-08-06 15:30:32.008953 | mon1 |
2026-08-06 15:30:32.008959 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:30:32.008963 | mon1 | Thursday 06 August 2026  15:30:32 +0000 (0:00:01.137)       0:04:01.063 *******
2026-08-06 15:30:32.232985 | mon1 | ok: [osd1]
2026-08-06 15:30:32.233005 | mon1 |
2026-08-06 15:30:32.233010 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:30:32.233015 | mon1 | Thursday 06 August 2026  15:30:32 +0000 (0:00:00.223)       0:04:01.286 *******
2026-08-06 15:30:32.549986 | mon1 | changed: [osd1]
2026-08-06 15:30:32.550032 | mon1 |
2026-08-06 15:30:32.550264 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:30:32.550308 | mon1 | Thursday 06 August 2026  15:30:32 +0000 (0:00:00.318)       0:04:01.604 *******
2026-08-06 15:30:32.765693 | mon1 | changed: [osd1]
2026-08-06 15:30:32.765747 | mon1 |
2026-08-06 15:30:32.765937 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-08-06 15:30:32.765982 | mon1 | Thursday 06 August 2026  15:30:32 +0000 (0:00:00.215)       0:04:01.820 *******
2026-08-06 15:30:33.112301 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-08-06 15:30:33.112357 | mon1 |
2026-08-06 15:30:33.112678 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-08-06 15:30:33.112729 | mon1 | Thursday 06 August 2026  15:30:33 +0000 (0:00:00.346)       0:04:02.167 *******
2026-08-06 15:30:33.152457 | mon1 | ok: [osd1]
2026-08-06 15:30:33.152546 | mon1 |
2026-08-06 15:30:33.152779 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:30:33.152821 | mon1 | Thursday 06 August 2026  15:30:33 +0000 (0:00:00.040)       0:04:02.207 *******
2026-08-06 15:30:33.205476 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-08-06 15:30:33.205559 | mon1 |
2026-08-06 15:30:33.205815 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:30:33.205891 | mon1 | Thursday 06 August 2026  15:30:33 +0000 (0:00:00.052)       0:04:02.260 *******
2026-08-06 15:30:34.788248 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:30:34.788319 | mon1 |
2026-08-06 15:30:34.788632 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:30:34.788675 | mon1 | Thursday 06 August 2026  15:30:34 +0000 (0:00:01.582)       0:04:03.843 *******
2026-08-06 15:30:34.836388 | mon1 | ok: [osd1] => (item=osd1)
2026-08-06 15:30:34.836800 | mon1 |
2026-08-06 15:30:34.836825 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:30:34.836833 | mon1 | Thursday 06 August 2026  15:30:34 +0000 (0:00:00.048)       0:04:03.891 *******
2026-08-06 15:30:35.093631 | mon1 | changed: [osd1]
2026-08-06 15:30:35.094051 | mon1 |
2026-08-06 15:30:35.094103 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:30:35.094112 | mon1 | Thursday 06 August 2026  15:30:35 +0000 (0:00:00.257)       0:04:04.148 *******
2026-08-06 15:30:40.236868 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:30:40.236937 | mon1 |
2026-08-06 15:30:40.237152 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-08-06 15:30:40.237193 | mon1 | Thursday 06 August 2026  15:30:40 +0000 (0:00:05.143)       0:04:09.292 *******
2026-08-06 15:30:40.968726 | mon1 | ok: [osd1]
2026-08-06 15:30:40.968787 | mon1 |
2026-08-06 15:30:40.968824 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-08-06 15:30:40.968952 | mon1 | Thursday 06 August 2026  15:30:40 +0000 (0:00:00.731)       0:04:10.023 *******
2026-08-06 15:31:25.486035 | mon1 | ok: [osd1]
2026-08-06 15:31:25.486284 | mon1 |
2026-08-06 15:31:25.486298 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-08-06 15:31:25.486308 | mon1 | Thursday 06 August 2026  15:31:25 +0000 (0:00:44.517)       0:04:54.541 *******
2026-08-06 15:32:06.384410 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-08-06 15:32:06.384482 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-08-06 15:32:06.384956 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-08-06 15:32:06.385052 | mon1 |
2026-08-06 15:32:06.385059 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-08-06 15:32:06.385064 | mon1 | Thursday 06 August 2026  15:32:06 +0000 (0:00:40.898)       0:05:35.439 *******
2026-08-06 15:32:08.152882 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:32:08.152973 | mon1 |
2026-08-06 15:32:08.153272 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-08-06 15:32:08.153323 | mon1 | Thursday 06 August 2026  15:32:08 +0000 (0:00:01.768)       0:05:37.207 *******
2026-08-06 15:32:09.702443 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:32:09.702524 | mon1 |
2026-08-06 15:32:09.702708 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-08-06 15:32:09.702746 | mon1 | Thursday 06 August 2026  15:32:09 +0000 (0:00:01.549)       0:05:38.757 *******
2026-08-06 15:32:09.750676 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-06 15:32:09.750740 | mon1 |
2026-08-06 15:32:09.750979 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-06 15:32:09.751029 | mon1 | Thursday 06 August 2026  15:32:09 +0000 (0:00:00.048)       0:05:38.805 *******
2026-08-06 15:32:09.788755 | mon1 | ok: [osd1]
2026-08-06 15:32:09.788812 | mon1 |
2026-08-06 15:32:09.788909 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-06 15:32:09.789007 | mon1 | Thursday 06 August 2026  15:32:09 +0000 (0:00:00.038)       0:05:38.843 *******
2026-08-06 15:32:11.355623 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:32:11.355691 | mon1 |
2026-08-06 15:32:11.355922 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-06 15:32:11.355939 | mon1 | Thursday 06 August 2026  15:32:11 +0000 (0:00:01.566)       0:05:40.410 *******
2026-08-06 15:32:11.391346 | mon1 | ok: [osd1]
2026-08-06 15:32:11.391450 | mon1 |
2026-08-06 15:32:11.391548 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-06 15:32:11.391641 | mon1 | Thursday 06 August 2026  15:32:11 +0000 (0:00:00.036)       0:05:40.446 *******
2026-08-06 15:32:11.416808 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"}
2026-08-06 15:32:11.430650 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:11.430745 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:11.430862 | mon1 |
2026-08-06 15:32:11.431174 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] **********************************
2026-08-06 15:32:11.431194 | mon1 | Thursday 06 August 2026  15:32:11 +0000 (0:00:00.039)       0:05:40.485 *******
2026-08-06 15:32:11.460518 | mon1 | skipping: [osd1]
2026-08-06 15:32:11.460600 | mon1 |
2026-08-06 15:32:11.460703 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] *******************
2026-08-06 15:32:11.460802 | mon1 | Thursday 06 August 2026  15:32:11 +0000 (0:00:00.030)       0:05:40.515 *******
2026-08-06 15:32:16.493831 | mon1 | Pausing for 5 seconds
2026-08-06 15:32:16.493907 | mon1 | ok: [osd1]
2026-08-06 15:32:16.493920 | mon1 |
2026-08-06 15:32:16.494131 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] ****************************************
2026-08-06 15:32:16.494177 | mon1 | Thursday 06 August 2026  15:32:16 +0000 (0:00:05.032)       0:05:45.548 *******
2026-08-06 15:32:16.544358 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-06 15:32:16.544420 | mon1 |
2026-08-06 15:32:16.544639 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-06 15:32:16.544668 | mon1 | Thursday 06 August 2026  15:32:16 +0000 (0:00:00.050)       0:05:45.599 *******
2026-08-06 15:32:16.588910 | mon1 | ok: [osd1]
2026-08-06 15:32:16.588988 | mon1 |
2026-08-06 15:32:16.589081 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-06 15:32:16.589173 | mon1 | Thursday 06 August 2026  15:32:16 +0000 (0:00:00.044)       0:05:45.644 *******
2026-08-06 15:32:18.231290 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:32:18.231500 | mon1 |
2026-08-06 15:32:18.231729 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-06 15:32:18.231943 | mon1 | Thursday 06 August 2026  15:32:18 +0000 (0:00:01.641)       0:05:47.285 *******
2026-08-06 15:32:18.272341 | mon1 | ok: [osd1]
2026-08-06 15:32:18.272596 | mon1 |
2026-08-06 15:32:18.272839 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-06 15:32:18.273065 | mon1 | Thursday 06 August 2026  15:32:18 +0000 (0:00:00.041)       0:05:47.327 *******
2026-08-06 15:32:18.308751 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:18.308880 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:18.309015 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:32:18.309147 | mon1 | skipping: [osd1]
2026-08-06 15:32:18.309270 | mon1 |
2026-08-06 15:32:18.309424 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-08-06 15:32:18.309575 | mon1 | Thursday 06 August 2026  15:32:18 +0000 (0:00:00.036)       0:05:47.363 *******
2026-08-06 15:32:18.364113 | mon1 | skipping: [osd1]
2026-08-06 15:32:18.364303 | mon1 |
2026-08-06 15:32:18.364522 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-08-06 15:32:18.364738 | mon1 |
2026-08-06 15:32:18.364951 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:32:18.365167 | mon1 | Thursday 06 August 2026  15:32:18 +0000 (0:00:00.055)       0:05:47.419 *******
2026-08-06 15:32:19.264693 | mon1 | ok: [mon1]
2026-08-06 15:32:19.264805 | mon1 |
2026-08-06 15:32:19.264818 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:19.264829 | mon1 | Thursday 06 August 2026  15:32:19 +0000 (0:00:00.898)       0:05:48.318 *******
2026-08-06 15:32:19.454352 | mon1 | ok: [mon1]
2026-08-06 15:32:19.454459 | mon1 |
2026-08-06 15:32:19.454473 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:19.454542 | mon1 | Thursday 06 August 2026  15:32:19 +0000 (0:00:00.191)       0:05:48.509 *******
2026-08-06 15:32:19.493626 | mon1 | skipping: [mon1]
2026-08-06 15:32:19.493658 | mon1 |
2026-08-06 15:32:19.493663 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:32:19.493669 | mon1 | Thursday 06 August 2026  15:32:19 +0000 (0:00:00.038)       0:05:48.548 *******
2026-08-06 15:32:19.697935 | mon1 | ok: [mon1]
2026-08-06 15:32:19.698030 | mon1 |
2026-08-06 15:32:19.698038 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:19.698045 | mon1 | Thursday 06 August 2026  15:32:19 +0000 (0:00:00.203)       0:05:48.752 *******
2026-08-06 15:32:19.756385 | mon1 | ok: [mon1] => {
2026-08-06 15:32:19.756516 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:32:19.756526 | mon1 | }
2026-08-06 15:32:19.756533 | mon1 |
2026-08-06 15:32:19.756547 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:19.756555 | mon1 | Thursday 06 August 2026  15:32:19 +0000 (0:00:00.057)       0:05:48.809 *******
2026-08-06 15:32:20.036833 | mon1 | ok: [mon1]
2026-08-06 15:32:20.036940 | mon1 |
2026-08-06 15:32:20.037250 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:20.037308 | mon1 | Thursday 06 August 2026  15:32:20 +0000 (0:00:00.281)       0:05:49.091 *******
2026-08-06 15:32:20.076085 | mon1 | skipping: [mon1]
2026-08-06 15:32:20.076172 | mon1 |
2026-08-06 15:32:20.076455 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:20.076505 | mon1 | Thursday 06 August 2026  15:32:20 +0000 (0:00:00.039)       0:05:49.131 *******
2026-08-06 15:32:20.113811 | mon1 | skipping: [mon1]
2026-08-06 15:32:20.113901 | mon1 |
2026-08-06 15:32:20.114149 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:20.114190 | mon1 | Thursday 06 August 2026  15:32:20 +0000 (0:00:00.037)       0:05:49.168 *******
2026-08-06 15:32:20.306314 | mon1 | ok: [mon1]
2026-08-06 15:32:20.306386 | mon1 |
2026-08-06 15:32:20.306449 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:20.306569 | mon1 | Thursday 06 August 2026  15:32:20 +0000 (0:00:00.192)       0:05:49.361 *******
2026-08-06 15:32:21.508652 | mon1 | ok: [mon1]
2026-08-06 15:32:21.508750 | mon1 |
2026-08-06 15:32:21.508821 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:21.508922 | mon1 | Thursday 06 August 2026  15:32:21 +0000 (0:00:01.202)       0:05:50.563 *******
2026-08-06 15:32:21.571299 | mon1 | ok: [mon1] => {
2026-08-06 15:32:21.571439 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:32:21.571805 | mon1 | }
2026-08-06 15:32:21.571847 | mon1 |
2026-08-06 15:32:21.571852 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:21.571858 | mon1 | Thursday 06 August 2026  15:32:21 +0000 (0:00:00.062)       0:05:50.626 *******
2026-08-06 15:32:21.897138 | mon1 | ok: [mon1]
2026-08-06 15:32:21.897210 | mon1 |
2026-08-06 15:32:21.897317 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:21.897449 | mon1 | Thursday 06 August 2026  15:32:21 +0000 (0:00:00.326)       0:05:50.952 *******
2026-08-06 15:32:23.783359 | mon1 | ok: [mon1]
2026-08-06 15:32:23.783432 | mon1 |
2026-08-06 15:32:23.783552 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:32:23.783660 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:01.886)       0:05:52.838 *******
2026-08-06 15:32:23.806633 | mon1 | skipping: [mon1]
2026-08-06 15:32:23.806762 | mon1 |
2026-08-06 15:32:23.806899 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:32:23.807036 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:00.023)       0:05:52.861 *******
2026-08-06 15:32:23.830368 | mon1 | skipping: [mon1]
2026-08-06 15:32:23.830459 | mon1 |
2026-08-06 15:32:23.830590 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:32:23.830719 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:00.023)       0:05:52.885 *******
2026-08-06 15:32:23.860661 | mon1 | skipping: [mon1]
2026-08-06 15:32:23.860759 | mon1 |
2026-08-06 15:32:23.860896 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:32:23.861029 | mon1 | Thursday 06 August 2026  15:32:23 +0000 (0:00:00.030)       0:05:52.916 *******
2026-08-06 15:32:24.840105 | mon1 | ok: [mon1]
2026-08-06 15:32:24.840259 | mon1 |
2026-08-06 15:32:24.840512 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:32:24.840727 | mon1 | Thursday 06 August 2026  15:32:24 +0000 (0:00:00.978)       0:05:53.894 *******
2026-08-06 15:32:25.246541 | mon1 | ok: [mon1]
2026-08-06 15:32:25.246728 | mon1 |
2026-08-06 15:32:25.246956 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:32:25.247174 | mon1 | Thursday 06 August 2026  15:32:25 +0000 (0:00:00.407)       0:05:54.301 *******
2026-08-06 15:32:26.119498 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:32:26.119558 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:32:26.119578 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:32:26.119996 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:32:26.120732 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:32:26.120830 | mon1 |
2026-08-06 15:32:26.120842 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:32:26.120853 | mon1 | Thursday 06 August 2026  15:32:26 +0000 (0:00:00.872)       0:05:55.173 *******
2026-08-06 15:32:26.637984 | mon1 | ok: [mon1]
2026-08-06 15:32:26.638071 | mon1 |
2026-08-06 15:32:26.638702 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:32:26.638752 | mon1 | Thursday 06 August 2026  15:32:26 +0000 (0:00:00.513)       0:05:55.686 *******
2026-08-06 15:32:26.638760 | mon1 |
2026-08-06 15:32:26.638767 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:32:26.638773 | mon1 | Thursday 06 August 2026  15:32:26 +0000 (0:00:00.006)       0:05:55.692 *******
2026-08-06 15:32:26.995234 | mon1 | ok: [mon1]
2026-08-06 15:32:26.995297 | mon1 |
2026-08-06 15:32:26.995571 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:26.995590 | mon1 | Thursday 06 August 2026  15:32:26 +0000 (0:00:00.357)       0:05:56.050 *******
2026-08-06 15:32:27.184256 | mon1 | ok: [mon1]
2026-08-06 15:32:27.184330 | mon1 |
2026-08-06 15:32:27.184392 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:27.184516 | mon1 | Thursday 06 August 2026  15:32:27 +0000 (0:00:00.188)       0:05:56.239 *******
2026-08-06 15:32:27.242487 | mon1 | ok: [mon1] => {
2026-08-06 15:32:27.243209 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:32:27.243289 | mon1 | }
2026-08-06 15:32:27.243297 | mon1 |
2026-08-06 15:32:27.243304 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:27.243312 | mon1 | Thursday 06 August 2026  15:32:27 +0000 (0:00:00.057)       0:05:56.296 *******
2026-08-06 15:32:27.575900 | mon1 | ok: [mon1]
2026-08-06 15:32:27.576087 | mon1 |
2026-08-06 15:32:27.576105 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:27.576121 | mon1 | Thursday 06 August 2026  15:32:27 +0000 (0:00:00.333)       0:05:56.630 *******
2026-08-06 15:32:30.595793 | mon1 | ok: [mon1]
2026-08-06 15:32:30.595864 | mon1 |
2026-08-06 15:32:30.596048 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:32:30.596092 | mon1 | Thursday 06 August 2026  15:32:30 +0000 (0:00:03.020)       0:05:59.650 *******
2026-08-06 15:32:31.594869 | mon1 | ok: [mon1]
2026-08-06 15:32:31.594956 | mon1 |
2026-08-06 15:32:31.594979 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:32:31.595106 | mon1 | Thursday 06 August 2026  15:32:31 +0000 (0:00:00.999)       0:06:00.650 *******
2026-08-06 15:32:31.784770 | mon1 | ok: [mon1]
2026-08-06 15:32:31.785198 | mon1 |
2026-08-06 15:32:31.785245 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:32:31.785253 | mon1 | Thursday 06 August 2026  15:32:31 +0000 (0:00:00.189)       0:06:00.839 *******
2026-08-06 15:32:32.205008 | mon1 | ok: [mon1]
2026-08-06 15:32:32.205378 | mon1 |
2026-08-06 15:32:32.205418 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:32:32.205424 | mon1 | Thursday 06 August 2026  15:32:32 +0000 (0:00:00.420)       0:06:01.259 *******
2026-08-06 15:32:32.784346 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:32:32.784418 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:32:32.784839 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:32:32.784883 | mon1 |
2026-08-06 15:32:32.784889 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:32:32.784894 | mon1 | Thursday 06 August 2026  15:32:32 +0000 (0:00:00.579)       0:06:01.839 *******
2026-08-06 15:32:33.185445 | mon1 | ok: [mon1]
2026-08-06 15:32:33.185507 | mon1 |
2026-08-06 15:32:33.185710 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:32:33.185755 | mon1 | Thursday 06 August 2026  15:32:33 +0000 (0:00:00.401)       0:06:02.240 *******
2026-08-06 15:32:33.602300 | mon1 | ok: [mon1]
2026-08-06 15:32:33.602389 | mon1 |
2026-08-06 15:32:33.602404 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:32:33.602819 | mon1 | Thursday 06 August 2026  15:32:33 +0000 (0:00:00.411)       0:06:02.651 *******
2026-08-06 15:32:33.602865 | mon1 |
2026-08-06 15:32:33.602872 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:32:33.602876 | mon1 | Thursday 06 August 2026  15:32:33 +0000 (0:00:00.005)       0:06:02.657 *******
2026-08-06 15:32:33.992773 | mon1 | ok: [mon1]
2026-08-06 15:32:33.992845 | mon1 |
2026-08-06 15:32:33.993085 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:32:33.993175 | mon1 | Thursday 06 August 2026  15:32:33 +0000 (0:00:00.390)       0:06:03.047 *******
2026-08-06 15:32:34.042097 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-06 15:32:34.042426 | mon1 |
2026-08-06 15:32:34.042455 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:32:34.042462 | mon1 | Thursday 06 August 2026  15:32:34 +0000 (0:00:00.049)       0:06:03.096 *******
2026-08-06 15:32:35.274093 | mon1 | ok: [mon1]
2026-08-06 15:32:35.274210 | mon1 |
2026-08-06 15:32:35.274550 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:32:35.274600 | mon1 | Thursday 06 August 2026  15:32:35 +0000 (0:00:01.232)       0:06:04.328 *******
2026-08-06 15:32:35.960677 | mon1 | ok: [mon1] => (item=chronyd)
2026-08-06 15:32:35.960737 | mon1 | ok: [mon1] => (item=sshd)
2026-08-06 15:32:35.961008 | mon1 |
2026-08-06 15:32:35.961023 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:32:35.961029 | mon1 | Thursday 06 August 2026  15:32:35 +0000 (0:00:00.686)       0:06:05.015 *******
2026-08-06 15:32:36.874451 | mon1 | ok: [mon1]
2026-08-06 15:32:36.874527 | mon1 |
2026-08-06 15:32:36.874709 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:32:36.874753 | mon1 | Thursday 06 August 2026  15:32:36 +0000 (0:00:00.913)       0:06:05.929 *******
2026-08-06 15:32:37.086776 | mon1 | ok: [mon1]
2026-08-06 15:32:37.086843 | mon1 |
2026-08-06 15:32:37.086941 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:32:37.087065 | mon1 | Thursday 06 August 2026  15:32:37 +0000 (0:00:00.212)       0:06:06.141 *******
2026-08-06 15:32:37.323358 | mon1 | ok: [mon1]
2026-08-06 15:32:37.323446 | mon1 |
2026-08-06 15:32:37.323733 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:32:37.323780 | mon1 | Thursday 06 August 2026  15:32:37 +0000 (0:00:00.236)       0:06:06.378 *******
2026-08-06 15:32:37.516336 | mon1 | ok: [mon1]
2026-08-06 15:32:37.516400 | mon1 |
2026-08-06 15:32:37.516692 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-08-06 15:32:37.516780 | mon1 | Thursday 06 August 2026  15:32:37 +0000 (0:00:00.192)       0:06:06.570 *******
2026-08-06 15:32:40.247490 | mon1 | changed: [mon1]
2026-08-06 15:32:40.247554 | mon1 |
2026-08-06 15:32:40.247567 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:32:40.247578 | mon1 | mon1                       : ok=93   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-08-06 15:32:40.247588 | mon1 | osd1                       : ok=58   changed=24   unreachable=0    failed=0    skipped=9    rescued=1    ignored=0
2026-08-06 15:32:40.247597 | mon1 |
2026-08-06 15:32:40.247606 | mon1 |
2026-08-06 15:32:40.247615 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:32:40.247624 | mon1 | Thursday 06 August 2026  15:32:40 +0000 (0:00:02.729)       0:06:09.300 *******
2026-08-06 15:32:40.247634 | mon1 | ===============================================================================
2026-08-06 15:32:40.247643 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 90.22s
2026-08-06 15:32:40.247652 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 44.52s
2026-08-06 15:32:40.247681 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 40.90s
2026-08-06 15:32:40.247690 | mon1 | vexxhost.containers.containerd : Install AppArmor packages ------------- 35.53s
2026-08-06 15:32:40.247699 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 26.42s
2026-08-06 15:32:40.247708 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.05s
2026-08-06 15:32:40.247717 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 6.77s
2026-08-06 15:32:40.247726 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 5.60s
2026-08-06 15:32:40.247735 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.14s
2026-08-06 15:32:40.247744 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.03s
2026-08-06 15:32:40.247753 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.51s
2026-08-06 15:32:40.247762 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.39s
2026-08-06 15:32:40.247771 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.99s
2026-08-06 15:32:40.247789 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.22s
2026-08-06 15:32:40.247798 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.02s
2026-08-06 15:32:40.247808 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 2.73s
2026-08-06 15:32:40.247817 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 2.73s
2026-08-06 15:32:40.248149 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.63s
2026-08-06 15:32:40.248234 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.17s
2026-08-06 15:32:40.248241 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.16s
2026-08-06 15:32:40.415854 | mon1 | INFO     [default > converge] Executed: Successful
2026-08-06 15:32:40.427736 | mon1 | INFO     [default > idempotence] Executing
2026-08-06 15:32:41.279521 | mon1 |
2026-08-06 15:32:41.279938 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-08-06 15:32:41.280194 | mon1 |
2026-08-06 15:32:41.280467 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:32:41.280737 | mon1 | Thursday 06 August 2026  15:32:41 +0000 (0:00:00.045)       0:00:00.045 *******
2026-08-06 15:32:42.431229 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:32:42.431291 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:32:42.431299 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:32:42.431311 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:32:42.431542 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:32:42.439084 | mon1 | ok: [mon1]
2026-08-06 15:32:42.439266 | mon1 |
2026-08-06 15:32:42.439510 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:42.439716 | mon1 | Thursday 06 August 2026  15:32:42 +0000 (0:00:01.160)       0:00:01.206 *******
2026-08-06 15:32:42.715894 | mon1 | ok: [mon1]
2026-08-06 15:32:42.716062 | mon1 |
2026-08-06 15:32:42.716307 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:42.716520 | mon1 | Thursday 06 August 2026  15:32:42 +0000 (0:00:00.276)       0:00:01.482 *******
2026-08-06 15:32:42.743166 | mon1 | skipping: [mon1]
2026-08-06 15:32:42.743321 | mon1 |
2026-08-06 15:32:42.743577 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:32:42.743779 | mon1 | Thursday 06 August 2026  15:32:42 +0000 (0:00:00.027)       0:00:01.510 *******
2026-08-06 15:32:43.059959 | mon1 | ok: [mon1]
2026-08-06 15:32:43.060051 | mon1 |
2026-08-06 15:32:43.060150 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:43.060253 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:00.316)       0:00:01.826 *******
2026-08-06 15:32:43.130651 | mon1 | ok: [mon1] => {
2026-08-06 15:32:43.130730 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:32:43.130824 | mon1 | }
2026-08-06 15:32:43.130914 | mon1 |
2026-08-06 15:32:43.131018 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:43.131115 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:00.071)       0:00:01.897 *******
2026-08-06 15:32:43.598750 | mon1 | ok: [mon1]
2026-08-06 15:32:43.598818 | mon1 |
2026-08-06 15:32:43.598830 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:43.598841 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:00.467)       0:00:02.364 *******
2026-08-06 15:32:43.635146 | mon1 | skipping: [mon1]
2026-08-06 15:32:43.635222 | mon1 |
2026-08-06 15:32:43.635990 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:43.636051 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:00.037)       0:00:02.402 *******
2026-08-06 15:32:43.672826 | mon1 | skipping: [mon1]
2026-08-06 15:32:43.672861 | mon1 |
2026-08-06 15:32:43.672872 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:43.672882 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:00.037)       0:00:02.439 *******
2026-08-06 15:32:43.884371 | mon1 | ok: [mon1]
2026-08-06 15:32:43.884410 | mon1 |
2026-08-06 15:32:43.884649 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:32:43.884692 | mon1 | Thursday 06 August 2026  15:32:43 +0000 (0:00:00.211)       0:00:02.651 *******
2026-08-06 15:32:45.052749 | mon1 | ok: [mon1]
2026-08-06 15:32:45.052820 | mon1 |
2026-08-06 15:32:45.052904 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:45.053000 | mon1 | Thursday 06 August 2026  15:32:45 +0000 (0:00:01.168)       0:00:03.819 *******
2026-08-06 15:32:45.130728 | mon1 | ok: [mon1] => {
2026-08-06 15:32:45.130804 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:32:45.130851 | mon1 | }
2026-08-06 15:32:45.130947 | mon1 |
2026-08-06 15:32:45.131057 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:45.131147 | mon1 | Thursday 06 August 2026  15:32:45 +0000 (0:00:00.077)       0:00:03.897 *******
2026-08-06 15:32:45.475044 | mon1 | ok: [mon1]
2026-08-06 15:32:45.475119 | mon1 |
2026-08-06 15:32:45.475341 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:45.475441 | mon1 | Thursday 06 August 2026  15:32:45 +0000 (0:00:00.344)       0:00:04.241 *******
2026-08-06 15:32:47.734250 | mon1 | ok: [mon1]
2026-08-06 15:32:47.734354 | mon1 |
2026-08-06 15:32:47.734367 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:32:47.734465 | mon1 | Thursday 06 August 2026  15:32:47 +0000 (0:00:02.259)       0:00:06.501 *******
2026-08-06 15:32:47.758922 | mon1 | skipping: [mon1]
2026-08-06 15:32:47.758955 | mon1 |
2026-08-06 15:32:47.759029 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:32:47.759116 | mon1 | Thursday 06 August 2026  15:32:47 +0000 (0:00:00.024)       0:00:06.526 *******
2026-08-06 15:32:47.785142 | mon1 | skipping: [mon1]
2026-08-06 15:32:47.785231 | mon1 |
2026-08-06 15:32:47.785367 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:32:47.785500 | mon1 | Thursday 06 August 2026  15:32:47 +0000 (0:00:00.026)       0:00:06.552 *******
2026-08-06 15:32:47.809708 | mon1 | skipping: [mon1]
2026-08-06 15:32:47.809745 | mon1 |
2026-08-06 15:32:47.809851 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:32:47.809946 | mon1 | Thursday 06 August 2026  15:32:47 +0000 (0:00:00.024)       0:00:06.577 *******
2026-08-06 15:32:48.949024 | mon1 | ok: [mon1]
2026-08-06 15:32:48.949131 | mon1 |
2026-08-06 15:32:48.949144 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:32:48.949209 | mon1 | Thursday 06 August 2026  15:32:48 +0000 (0:00:01.138)       0:00:07.715 *******
2026-08-06 15:32:49.411189 | mon1 | ok: [mon1]
2026-08-06 15:32:49.411300 | mon1 |
2026-08-06 15:32:49.411314 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:32:49.411432 | mon1 | Thursday 06 August 2026  15:32:49 +0000 (0:00:00.462)       0:00:08.178 *******
2026-08-06 15:32:50.382114 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:32:50.382181 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:32:50.382740 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:32:50.382778 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:32:50.382785 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:32:50.382790 | mon1 |
2026-08-06 15:32:50.382795 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:32:50.382800 | mon1 | Thursday 06 August 2026  15:32:50 +0000 (0:00:00.970)       0:00:09.149 *******
2026-08-06 15:32:50.910161 | mon1 | ok: [mon1]
2026-08-06 15:32:50.910203 | mon1 |
2026-08-06 15:32:50.910208 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:32:50.910213 | mon1 | Thursday 06 August 2026  15:32:50 +0000 (0:00:00.521)       0:00:09.670 *******
2026-08-06 15:32:50.910217 | mon1 |
2026-08-06 15:32:50.910221 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:32:50.910225 | mon1 | Thursday 06 August 2026  15:32:50 +0000 (0:00:00.006)       0:00:09.676 *******
2026-08-06 15:32:51.523057 | mon1 | ok: [mon1]
2026-08-06 15:32:51.523126 | mon1 |
2026-08-06 15:32:51.523217 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:32:51.523345 | mon1 | Thursday 06 August 2026  15:32:51 +0000 (0:00:00.613)       0:00:10.290 *******
2026-08-06 15:32:51.720710 | mon1 | ok: [mon1]
2026-08-06 15:32:51.720793 | mon1 |
2026-08-06 15:32:51.721030 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:32:51.721071 | mon1 | Thursday 06 August 2026  15:32:51 +0000 (0:00:00.197)       0:00:10.487 *******
2026-08-06 15:32:51.786731 | mon1 | ok: [mon1] => {
2026-08-06 15:32:51.786875 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:32:51.787250 | mon1 | }
2026-08-06 15:32:51.787269 | mon1 |
2026-08-06 15:32:51.787275 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:32:51.787279 | mon1 | Thursday 06 August 2026  15:32:51 +0000 (0:00:00.066)       0:00:10.553 *******
2026-08-06 15:32:52.130588 | mon1 | ok: [mon1]
2026-08-06 15:32:52.130636 | mon1 |
2026-08-06 15:32:52.130649 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:32:52.130666 | mon1 | Thursday 06 August 2026  15:32:52 +0000 (0:00:00.343)       0:00:10.897 *******
2026-08-06 15:32:55.210583 | mon1 | ok: [mon1]
2026-08-06 15:32:55.210637 | mon1 |
2026-08-06 15:32:55.210730 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:32:55.210863 | mon1 | Thursday 06 August 2026  15:32:55 +0000 (0:00:03.080)       0:00:13.977 *******
2026-08-06 15:32:56.390704 | mon1 | ok: [mon1]
2026-08-06 15:32:56.390772 | mon1 |
2026-08-06 15:32:56.390845 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:32:56.390970 | mon1 | Thursday 06 August 2026  15:32:56 +0000 (0:00:01.180)       0:00:15.157 *******
2026-08-06 15:32:56.713165 | mon1 | ok: [mon1]
2026-08-06 15:32:56.713217 | mon1 |
2026-08-06 15:32:56.713424 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:32:56.713464 | mon1 | Thursday 06 August 2026  15:32:56 +0000 (0:00:00.322)       0:00:15.480 *******
2026-08-06 15:32:57.134435 | mon1 | ok: [mon1]
2026-08-06 15:32:57.134490 | mon1 |
2026-08-06 15:32:57.134708 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:32:57.134751 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.421)       0:00:15.901 *******
2026-08-06 15:32:57.717715 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:32:57.717951 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:32:57.718015 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:32:57.718357 | mon1 |
2026-08-06 15:32:57.718403 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:32:57.718409 | mon1 | Thursday 06 August 2026  15:32:57 +0000 (0:00:00.583)       0:00:16.484 *******
2026-08-06 15:32:58.131435 | mon1 | ok: [mon1]
2026-08-06 15:32:58.131499 | mon1 |
2026-08-06 15:32:58.131732 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:32:58.131773 | mon1 | Thursday 06 August 2026  15:32:58 +0000 (0:00:00.413)       0:00:16.898 *******
2026-08-06 15:32:58.538777 | mon1 | ok: [mon1]
2026-08-06 15:32:58.538837 | mon1 |
2026-08-06 15:32:58.539299 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:32:58.539464 | mon1 | Thursday 06 August 2026  15:32:58 +0000 (0:00:00.400)       0:00:17.298 *******
2026-08-06 15:32:58.539472 | mon1 |
2026-08-06 15:32:58.539477 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:32:58.539482 | mon1 | Thursday 06 August 2026  15:32:58 +0000 (0:00:00.007)       0:00:17.305 *******
2026-08-06 15:32:58.887257 | mon1 | ok: [mon1]
2026-08-06 15:32:58.887314 | mon1 |
2026-08-06 15:32:58.887486 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:32:58.887540 | mon1 | Thursday 06 August 2026  15:32:58 +0000 (0:00:00.348)       0:00:17.654 *******
2026-08-06 15:32:58.935064 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-06 15:32:58.935138 | mon1 |
2026-08-06 15:32:58.935342 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:32:58.935400 | mon1 | Thursday 06 August 2026  15:32:58 +0000 (0:00:00.047)       0:00:17.702 *******
2026-08-06 15:33:00.048685 | mon1 | ok: [mon1]
2026-08-06 15:33:00.048748 | mon1 |
2026-08-06 15:33:00.048809 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:33:00.048927 | mon1 | Thursday 06 August 2026  15:33:00 +0000 (0:00:01.113)       0:00:18.815 *******
2026-08-06 15:33:00.693191 | mon1 | ok: [mon1] => (item=chronyd)
2026-08-06 15:33:00.693275 | mon1 | ok: [mon1] => (item=sshd)
2026-08-06 15:33:00.693335 | mon1 |
2026-08-06 15:33:00.693543 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:33:00.693589 | mon1 | Thursday 06 August 2026  15:33:00 +0000 (0:00:00.644)       0:00:19.460 *******
2026-08-06 15:33:01.804682 | mon1 | ok: [mon1]
2026-08-06 15:33:01.804750 | mon1 |
2026-08-06 15:33:01.805022 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:33:01.805073 | mon1 | Thursday 06 August 2026  15:33:01 +0000 (0:00:01.111)       0:00:20.571 *******
2026-08-06 15:33:02.001745 | mon1 | ok: [mon1]
2026-08-06 15:33:02.001789 | mon1 |
2026-08-06 15:33:02.001795 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:33:02.001801 | mon1 | Thursday 06 August 2026  15:33:02 +0000 (0:00:00.196)       0:00:20.768 *******
2026-08-06 15:33:02.397025 | mon1 | ok: [mon1]
2026-08-06 15:33:02.397085 | mon1 |
2026-08-06 15:33:02.397216 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:33:02.397363 | mon1 | Thursday 06 August 2026  15:33:02 +0000 (0:00:00.395)       0:00:21.164 *******
2026-08-06 15:33:02.698050 | mon1 | ok: [mon1]
2026-08-06 15:33:02.698138 | mon1 |
2026-08-06 15:33:02.698159 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-08-06 15:33:02.698289 | mon1 | Thursday 06 August 2026  15:33:02 +0000 (0:00:00.301)       0:00:21.465 *******
2026-08-06 15:33:02.788683 | mon1 | ok: [mon1]
2026-08-06 15:33:02.788731 | mon1 |
2026-08-06 15:33:02.788962 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-08-06 15:33:02.789009 | mon1 | Thursday 06 August 2026  15:33:02 +0000 (0:00:00.090)       0:00:21.555 *******
2026-08-06 15:33:03.075802 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:33:03.075874 | mon1 |
2026-08-06 15:33:03.075931 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-08-06 15:33:03.076024 | mon1 | Thursday 06 August 2026  15:33:03 +0000 (0:00:00.287)       0:00:21.842 *******
2026-08-06 15:33:03.118177 | mon1 | ok: [mon1]
2026-08-06 15:33:03.118264 | mon1 |
2026-08-06 15:33:03.118363 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-08-06 15:33:03.118461 | mon1 | Thursday 06 August 2026  15:33:03 +0000 (0:00:00.042)       0:00:21.885 *******
2026-08-06 15:33:03.150781 | mon1 | skipping: [mon1]
2026-08-06 15:33:03.150860 | mon1 |
2026-08-06 15:33:03.150951 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:33:03.151042 | mon1 | Thursday 06 August 2026  15:33:03 +0000 (0:00:00.032)       0:00:21.918 *******
2026-08-06 15:33:03.208873 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:33:03.208964 | mon1 |
2026-08-06 15:33:03.209059 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:33:03.209149 | mon1 | Thursday 06 August 2026  15:33:03 +0000 (0:00:00.058)       0:00:21.976 *******
2026-08-06 15:33:04.898520 | mon1 | ok: [mon1]
2026-08-06 15:33:04.898690 | mon1 |
2026-08-06 15:33:04.898922 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:33:04.899133 | mon1 | Thursday 06 August 2026  15:33:04 +0000 (0:00:01.689)       0:00:23.665 *******
2026-08-06 15:33:04.945256 | mon1 | ok: [mon1] => (item=mon1)
2026-08-06 15:33:04.945425 | mon1 |
2026-08-06 15:33:04.945637 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:33:04.945841 | mon1 | Thursday 06 August 2026  15:33:04 +0000 (0:00:00.047)       0:00:23.712 *******
2026-08-06 15:33:05.278647 | mon1 | ok: [mon1]
2026-08-06 15:33:05.278838 | mon1 |
2026-08-06 15:33:05.279050 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:33:05.279252 | mon1 | Thursday 06 August 2026  15:33:05 +0000 (0:00:00.333)       0:00:24.045 *******
2026-08-06 15:33:07.474327 | mon1 | ok: [mon1]
2026-08-06 15:33:07.474385 | mon1 |
2026-08-06 15:33:07.474397 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-08-06 15:33:07.474407 | mon1 | Thursday 06 August 2026  15:33:07 +0000 (0:00:02.195)       0:00:26.240 *******
2026-08-06 15:33:09.046472 | mon1 | ok: [mon1]
2026-08-06 15:33:09.046540 | mon1 |
2026-08-06 15:33:09.046618 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-08-06 15:33:09.046744 | mon1 | Thursday 06 August 2026  15:33:09 +0000 (0:00:01.572)       0:00:27.813 *******
2026-08-06 15:33:10.683834 | mon1 | ok: [mon1]
2026-08-06 15:33:10.683914 | mon1 |
2026-08-06 15:33:10.683975 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:33:10.684083 | mon1 | Thursday 06 August 2026  15:33:10 +0000 (0:00:01.637)       0:00:29.450 *******
2026-08-06 15:33:10.749657 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-08-06 15:33:10.749716 | mon1 |
2026-08-06 15:33:10.749925 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:33:10.749951 | mon1 | Thursday 06 August 2026  15:33:10 +0000 (0:00:00.065)       0:00:29.516 *******
2026-08-06 15:33:10.795269 | mon1 | skipping: [mon1]
2026-08-06 15:33:10.795328 | mon1 |
2026-08-06 15:33:10.795521 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:33:10.795591 | mon1 | Thursday 06 August 2026  15:33:10 +0000 (0:00:00.045)       0:00:29.562 *******
2026-08-06 15:33:10.836252 | mon1 | skipping: [mon1] => (item=mon1)
2026-08-06 15:33:10.836291 | mon1 | skipping: [mon1]
2026-08-06 15:33:10.836618 | mon1 |
2026-08-06 15:33:10.836664 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:33:10.836670 | mon1 | Thursday 06 August 2026  15:33:10 +0000 (0:00:00.040)       0:00:29.603 *******
2026-08-06 15:33:11.080630 | mon1 | ok: [mon1]
2026-08-06 15:33:11.081381 | mon1 |
2026-08-06 15:33:11.081485 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:33:11.081526 | mon1 | Thursday 06 August 2026  15:33:11 +0000 (0:00:00.243)       0:00:29.846 *******
2026-08-06 15:33:13.394714 | mon1 | ok: [mon1]
2026-08-06 15:33:13.394843 | mon1 |
2026-08-06 15:33:13.394856 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-08-06 15:33:13.394928 | mon1 | Thursday 06 August 2026  15:33:13 +0000 (0:00:02.315)       0:00:32.161 *******
2026-08-06 15:33:14.902260 | mon1 | ok: [mon1]
2026-08-06 15:33:14.902374 | mon1 |
2026-08-06 15:33:14.902387 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-08-06 15:33:14.902511 | mon1 | Thursday 06 August 2026  15:33:14 +0000 (0:00:01.507)       0:00:33.669 *******
2026-08-06 15:33:16.564091 | mon1 | ok: [mon1]
2026-08-06 15:33:16.564220 | mon1 |
2026-08-06 15:33:16.564515 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-08-06 15:33:16.564561 | mon1 | Thursday 06 August 2026  15:33:16 +0000 (0:00:01.661)       0:00:35.330 *******
2026-08-06 15:33:24.716672 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-08-06 15:33:24.716803 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-08-06 15:33:24.716817 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-08-06 15:33:24.716830 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-08-06 15:33:24.717318 | mon1 |
2026-08-06 15:33:24.717378 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-08-06 15:33:24.717384 | mon1 |
2026-08-06 15:33:24.717389 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:33:24.717394 | mon1 | Thursday 06 August 2026  15:33:24 +0000 (0:00:08.152)       0:00:43.483 *******
2026-08-06 15:33:25.836760 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-08-06 15:33:25.837670 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:33:25.837734 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:33:25.837747 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:33:25.837758 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:33:25.847474 | mon1 | ok: [osd1]
2026-08-06 15:33:25.847566 | mon1 |
2026-08-06 15:33:25.847763 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:33:25.847782 | mon1 | Thursday 06 August 2026  15:33:25 +0000 (0:00:01.130)       0:00:44.614 *******
2026-08-06 15:33:26.044505 | mon1 | ok: [osd1]
2026-08-06 15:33:26.044579 | mon1 |
2026-08-06 15:33:26.044679 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:33:26.044813 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.197)       0:00:44.811 *******
2026-08-06 15:33:26.078679 | mon1 | skipping: [osd1]
2026-08-06 15:33:26.078768 | mon1 |
2026-08-06 15:33:26.078873 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:33:26.078984 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.034)       0:00:44.845 *******
2026-08-06 15:33:26.276612 | mon1 | ok: [osd1]
2026-08-06 15:33:26.276663 | mon1 |
2026-08-06 15:33:26.276878 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:33:26.276920 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.197)       0:00:45.043 *******
2026-08-06 15:33:26.340479 | mon1 | ok: [osd1] => {
2026-08-06 15:33:26.340577 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:33:26.340944 | mon1 | }
2026-08-06 15:33:26.340967 | mon1 |
2026-08-06 15:33:26.340972 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:33:26.340977 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.063)       0:00:45.107 *******
2026-08-06 15:33:26.651098 | mon1 | ok: [osd1]
2026-08-06 15:33:26.651149 | mon1 |
2026-08-06 15:33:26.651213 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:33:26.651304 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.310)       0:00:45.418 *******
2026-08-06 15:33:26.690961 | mon1 | skipping: [osd1]
2026-08-06 15:33:26.691025 | mon1 |
2026-08-06 15:33:26.691198 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:33:26.691214 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.039)       0:00:45.458 *******
2026-08-06 15:33:26.726757 | mon1 | skipping: [osd1]
2026-08-06 15:33:26.726839 | mon1 |
2026-08-06 15:33:26.726935 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:33:26.727028 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.036)       0:00:45.494 *******
2026-08-06 15:33:26.924993 | mon1 | ok: [osd1]
2026-08-06 15:33:26.925045 | mon1 |
2026-08-06 15:33:26.925325 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:33:26.925400 | mon1 | Thursday 06 August 2026  15:33:26 +0000 (0:00:00.197)       0:00:45.691 *******
2026-08-06 15:33:27.926735 | mon1 | ok: [osd1]
2026-08-06 15:33:27.926873 | mon1 |
2026-08-06 15:33:27.926890 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:33:27.927056 | mon1 | Thursday 06 August 2026  15:33:27 +0000 (0:00:01.001)       0:00:46.693 *******
2026-08-06 15:33:28.005965 | mon1 | ok: [osd1] => {
2026-08-06 15:33:28.006481 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:33:28.006527 | mon1 | }
2026-08-06 15:33:28.006535 | mon1 |
2026-08-06 15:33:28.006541 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:33:28.006547 | mon1 | Thursday 06 August 2026  15:33:28 +0000 (0:00:00.079)       0:00:46.772 *******
2026-08-06 15:33:28.339904 | mon1 | ok: [osd1]
2026-08-06 15:33:28.339956 | mon1 |
2026-08-06 15:33:28.340194 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:33:28.340244 | mon1 | Thursday 06 August 2026  15:33:28 +0000 (0:00:00.334)       0:00:47.106 *******
2026-08-06 15:33:30.249663 | mon1 | ok: [osd1]
2026-08-06 15:33:30.249745 | mon1 |
2026-08-06 15:33:30.249761 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:33:30.249892 | mon1 | Thursday 06 August 2026  15:33:30 +0000 (0:00:01.909)       0:00:49.016 *******
2026-08-06 15:33:30.277613 | mon1 | skipping: [osd1]
2026-08-06 15:33:30.277968 | mon1 |
2026-08-06 15:33:30.278050 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:33:30.278059 | mon1 | Thursday 06 August 2026  15:33:30 +0000 (0:00:00.027)       0:00:49.044 *******
2026-08-06 15:33:30.305665 | mon1 | skipping: [osd1]
2026-08-06 15:33:30.305755 | mon1 |
2026-08-06 15:33:30.305883 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:33:30.306058 | mon1 | Thursday 06 August 2026  15:33:30 +0000 (0:00:00.028)       0:00:49.072 *******
2026-08-06 15:33:30.332460 | mon1 | skipping: [osd1]
2026-08-06 15:33:30.332544 | mon1 |
2026-08-06 15:33:30.332645 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:33:30.332766 | mon1 | Thursday 06 August 2026  15:33:30 +0000 (0:00:00.026)       0:00:49.099 *******
2026-08-06 15:33:31.307149 | mon1 | ok: [osd1]
2026-08-06 15:33:31.307217 | mon1 |
2026-08-06 15:33:31.307330 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:33:31.307565 | mon1 | Thursday 06 August 2026  15:33:31 +0000 (0:00:00.974)       0:00:50.073 *******
2026-08-06 15:33:31.728708 | mon1 | ok: [osd1]
2026-08-06 15:33:31.728749 | mon1 |
2026-08-06 15:33:31.728755 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:33:31.728760 | mon1 | Thursday 06 August 2026  15:33:31 +0000 (0:00:00.421)       0:00:50.495 *******
2026-08-06 15:33:32.638380 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-08-06 15:33:32.638445 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:33:32.639099 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:33:32.639182 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:33:32.639208 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:33:32.639214 | mon1 |
2026-08-06 15:33:32.639220 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:33:32.639225 | mon1 | Thursday 06 August 2026  15:33:32 +0000 (0:00:00.909)       0:00:51.404 *******
2026-08-06 15:33:33.142851 | mon1 | ok: [osd1]
2026-08-06 15:33:33.142962 | mon1 |
2026-08-06 15:33:33.142975 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:33:33.143045 | mon1 | Thursday 06 August 2026  15:33:33 +0000 (0:00:00.497)       0:00:51.902 *******
2026-08-06 15:33:33.143338 | mon1 |
2026-08-06 15:33:33.143407 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:33:33.143416 | mon1 | Thursday 06 August 2026  15:33:33 +0000 (0:00:00.007)       0:00:51.909 *******
2026-08-06 15:33:33.500007 | mon1 | ok: [osd1]
2026-08-06 15:33:33.500064 | mon1 |
2026-08-06 15:33:33.500130 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:33:33.500270 | mon1 | Thursday 06 August 2026  15:33:33 +0000 (0:00:00.356)       0:00:52.266 *******
2026-08-06 15:33:33.696189 | mon1 | ok: [osd1]
2026-08-06 15:33:33.696293 | mon1 |
2026-08-06 15:33:33.696307 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:33:33.696388 | mon1 | Thursday 06 August 2026  15:33:33 +0000 (0:00:00.196)       0:00:52.462 *******
2026-08-06 15:33:33.771472 | mon1 | ok: [osd1] => {
2026-08-06 15:33:33.771508 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:33:33.771515 | mon1 | }
2026-08-06 15:33:33.771519 | mon1 |
2026-08-06 15:33:33.771524 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:33:33.771528 | mon1 | Thursday 06 August 2026  15:33:33 +0000 (0:00:00.074)       0:00:52.537 *******
2026-08-06 15:33:34.132355 | mon1 | ok: [osd1]
2026-08-06 15:33:34.132488 | mon1 |
2026-08-06 15:33:34.132502 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:33:34.132514 | mon1 | Thursday 06 August 2026  15:33:34 +0000 (0:00:00.362)       0:00:52.899 *******
2026-08-06 15:33:37.182109 | mon1 | ok: [osd1]
2026-08-06 15:33:37.182234 | mon1 |
2026-08-06 15:33:37.182248 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:33:37.182323 | mon1 | Thursday 06 August 2026  15:33:37 +0000 (0:00:03.049)       0:00:55.949 *******
2026-08-06 15:33:38.180580 | mon1 | ok: [osd1]
2026-08-06 15:33:38.180715 | mon1 |
2026-08-06 15:33:38.180729 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:33:38.180918 | mon1 | Thursday 06 August 2026  15:33:38 +0000 (0:00:00.998)       0:00:56.947 *******
2026-08-06 15:33:38.372399 | mon1 | ok: [osd1]
2026-08-06 15:33:38.372485 | mon1 |
2026-08-06 15:33:38.372543 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:33:38.372672 | mon1 | Thursday 06 August 2026  15:33:38 +0000 (0:00:00.191)       0:00:57.138 *******
2026-08-06 15:33:38.790503 | mon1 | ok: [osd1]
2026-08-06 15:33:38.790560 | mon1 |
2026-08-06 15:33:38.790648 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:33:38.790778 | mon1 | Thursday 06 August 2026  15:33:38 +0000 (0:00:00.418)       0:00:57.557 *******
2026-08-06 15:33:39.326528 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-08-06 15:33:39.326602 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:33:39.326665 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:33:39.326942 | mon1 |
2026-08-06 15:33:39.326987 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:33:39.326993 | mon1 | Thursday 06 August 2026  15:33:39 +0000 (0:00:00.535)       0:00:58.093 *******
2026-08-06 15:33:39.748488 | mon1 | ok: [osd1]
2026-08-06 15:33:39.748533 | mon1 |
2026-08-06 15:33:39.748539 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:33:39.748544 | mon1 | Thursday 06 August 2026  15:33:39 +0000 (0:00:00.421)       0:00:58.515 *******
2026-08-06 15:33:40.173053 | mon1 | ok: [osd1]
2026-08-06 15:33:40.173121 | mon1 |
2026-08-06 15:33:40.173136 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:33:40.173577 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.417)       0:00:58.933 *******
2026-08-06 15:33:40.173621 | mon1 |
2026-08-06 15:33:40.173626 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:33:40.173631 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.006)       0:00:58.939 *******
2026-08-06 15:33:40.522763 | mon1 | ok: [osd1]
2026-08-06 15:33:40.522830 | mon1 |
2026-08-06 15:33:40.523089 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:33:40.523171 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.349)       0:00:59.289 *******
2026-08-06 15:33:40.574158 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-06 15:33:40.574246 | mon1 |
2026-08-06 15:33:40.574485 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:33:40.574543 | mon1 | Thursday 06 August 2026  15:33:40 +0000 (0:00:00.051)       0:00:59.340 *******
2026-08-06 15:33:41.629979 | mon1 | ok: [osd1]
2026-08-06 15:33:41.630056 | mon1 |
2026-08-06 15:33:41.630335 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:33:41.630417 | mon1 | Thursday 06 August 2026  15:33:41 +0000 (0:00:01.055)       0:01:00.396 *******
2026-08-06 15:33:42.267029 | mon1 | ok: [osd1] => (item=chronyd)
2026-08-06 15:33:42.267149 | mon1 | ok: [osd1] => (item=sshd)
2026-08-06 15:33:42.267562 | mon1 |
2026-08-06 15:33:42.267624 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:33:42.267632 | mon1 | Thursday 06 August 2026  15:33:42 +0000 (0:00:00.637)       0:01:01.033 *******
2026-08-06 15:33:43.378870 | mon1 | ok: [osd1]
2026-08-06 15:33:43.378945 | mon1 |
2026-08-06 15:33:43.378958 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:33:43.379072 | mon1 | Thursday 06 August 2026  15:33:43 +0000 (0:00:01.111)       0:01:02.145 *******
2026-08-06 15:33:43.572599 | mon1 | ok: [osd1]
2026-08-06 15:33:43.572650 | mon1 |
2026-08-06 15:33:43.572709 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:33:43.572809 | mon1 | Thursday 06 August 2026  15:33:43 +0000 (0:00:00.193)       0:01:02.339 *******
2026-08-06 15:33:43.803566 | mon1 | ok: [osd1]
2026-08-06 15:33:43.803625 | mon1 |
2026-08-06 15:33:43.803633 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:33:43.803645 | mon1 | Thursday 06 August 2026  15:33:43 +0000 (0:00:00.230)       0:01:02.570 *******
2026-08-06 15:33:43.996014 | mon1 | ok: [osd1]
2026-08-06 15:33:43.996078 | mon1 |
2026-08-06 15:33:43.996245 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-08-06 15:33:43.996261 | mon1 | Thursday 06 August 2026  15:33:43 +0000 (0:00:00.192)       0:01:02.763 *******
2026-08-06 15:33:44.209122 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-08-06 15:33:44.209229 | mon1 |
2026-08-06 15:33:44.209488 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-08-06 15:33:44.209541 | mon1 | Thursday 06 August 2026  15:33:44 +0000 (0:00:00.213)       0:01:02.976 *******
2026-08-06 15:33:44.253981 | mon1 | ok: [osd1]
2026-08-06 15:33:44.254291 | mon1 |
2026-08-06 15:33:44.254326 | mon1 | TASK [Install Ceph host] *******************************************************
2026-08-06 15:33:44.254333 | mon1 | Thursday 06 August 2026  15:33:44 +0000 (0:00:00.044)       0:01:03.020 *******
2026-08-06 15:33:44.304532 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-08-06 15:33:44.304623 | mon1 |
2026-08-06 15:33:44.304849 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-08-06 15:33:44.304903 | mon1 | Thursday 06 August 2026  15:33:44 +0000 (0:00:00.050)       0:01:03.071 *******
2026-08-06 15:33:45.904707 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:33:45.904804 | mon1 |
2026-08-06 15:33:45.904863 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-08-06 15:33:45.904993 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:01.600)       0:01:04.671 *******
2026-08-06 15:33:45.949311 | mon1 | ok: [osd1] => (item=osd1)
2026-08-06 15:33:45.949585 | mon1 |
2026-08-06 15:33:45.949607 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-08-06 15:33:45.949613 | mon1 | Thursday 06 August 2026  15:33:45 +0000 (0:00:00.044)       0:01:04.716 *******
2026-08-06 15:33:46.185469 | mon1 | ok: [osd1]
2026-08-06 15:33:46.185497 | mon1 |
2026-08-06 15:33:46.185656 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-08-06 15:33:46.185723 | mon1 | Thursday 06 August 2026  15:33:46 +0000 (0:00:00.236)       0:01:04.952 *******
2026-08-06 15:33:48.387146 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:33:48.387213 | mon1 |
2026-08-06 15:33:48.387264 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-08-06 15:33:48.387356 | mon1 | Thursday 06 August 2026  15:33:48 +0000 (0:00:02.201)       0:01:07.154 *******
2026-08-06 15:33:54.085593 | mon1 | ok: [osd1]
2026-08-06 15:33:54.085692 | mon1 |
2026-08-06 15:33:54.085705 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-08-06 15:33:54.085769 | mon1 | Thursday 06 August 2026  15:33:54 +0000 (0:00:05.698)       0:01:12.852 *******
2026-08-06 15:33:55.567708 | mon1 | ok: [osd1]
2026-08-06 15:33:55.567758 | mon1 |
2026-08-06 15:33:55.567764 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-08-06 15:33:55.567768 | mon1 | Thursday 06 August 2026  15:33:55 +0000 (0:00:01.481)       0:01:14.334 *******
2026-08-06 15:33:55.630882 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-08-06 15:33:55.630925 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-08-06 15:33:55.631432 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-08-06 15:33:55.631509 | mon1 | skipping: [osd1]
2026-08-06 15:33:55.631516 | mon1 |
2026-08-06 15:33:55.631521 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-08-06 15:33:55.631534 | mon1 | Thursday 06 August 2026  15:33:55 +0000 (0:00:00.063)       0:01:14.397 *******
2026-08-06 15:33:57.404375 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:33:57.404452 | mon1 |
2026-08-06 15:33:57.404458 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-08-06 15:33:57.404470 | mon1 | Thursday 06 August 2026  15:33:57 +0000 (0:00:01.773)       0:01:16.170 *******
2026-08-06 15:33:58.999450 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:33:58.999569 | mon1 |
2026-08-06 15:33:58.999583 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-08-06 15:33:58.999597 | mon1 | Thursday 06 August 2026  15:33:58 +0000 (0:00:01.595)       0:01:17.766 *******
2026-08-06 15:33:59.052798 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-08-06 15:33:59.052860 | mon1 |
2026-08-06 15:33:59.053118 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-08-06 15:33:59.053176 | mon1 | Thursday 06 August 2026  15:33:59 +0000 (0:00:00.053)       0:01:17.819 *******
2026-08-06 15:33:59.100250 | mon1 | ok: [osd1]
2026-08-06 15:33:59.101073 | mon1 |
2026-08-06 15:33:59.101140 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-08-06 15:33:59.101157 | mon1 | Thursday 06 August 2026  15:33:59 +0000 (0:00:00.046)       0:01:17.866 *******
2026-08-06 15:34:00.707919 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-08-06 15:34:00.708010 | mon1 |
2026-08-06 15:34:00.708236 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-08-06 15:34:00.708293 | mon1 | Thursday 06 August 2026  15:34:00 +0000 (0:00:01.608)       0:01:19.474 *******
2026-08-06 15:34:00.752692 | mon1 | ok: [osd1]
2026-08-06 15:34:00.752732 | mon1 |
2026-08-06 15:34:00.753010 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-08-06 15:34:00.753099 | mon1 | Thursday 06 August 2026  15:34:00 +0000 (0:00:00.044)       0:01:19.519 *******
2026-08-06 15:34:00.789256 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:34:00.789365 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:34:00.789376 | mon1 | skipping: [osd1] => (item=1)
2026-08-06 15:34:00.789739 | mon1 | skipping: [osd1]
2026-08-06 15:34:00.789763 | mon1 |
2026-08-06 15:34:00.789769 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-08-06 15:34:00.789774 | mon1 | Thursday 06 August 2026  15:34:00 +0000 (0:00:00.037)       0:01:19.556 *******
2026-08-06 15:34:00.858713 | mon1 | skipping: [osd1]
2026-08-06 15:34:00.858795 | mon1 |
2026-08-06 15:34:00.859223 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-08-06 15:34:00.859318 | mon1 |
2026-08-06 15:34:00.859325 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:34:00.859329 | mon1 | Thursday 06 August 2026  15:34:00 +0000 (0:00:00.069)       0:01:19.625 *******
2026-08-06 15:34:01.777237 | mon1 | ok: [mon1]
2026-08-06 15:34:01.777338 | mon1 |
2026-08-06 15:34:01.777351 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:34:01.777500 | mon1 | Thursday 06 August 2026  15:34:01 +0000 (0:00:00.918)       0:01:20.544 *******
2026-08-06 15:34:01.977856 | mon1 | ok: [mon1]
2026-08-06 15:34:01.977939 | mon1 |
2026-08-06 15:34:01.978002 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:34:01.978114 | mon1 | Thursday 06 August 2026  15:34:01 +0000 (0:00:00.200)       0:01:20.744 *******
2026-08-06 15:34:02.011729 | mon1 | skipping: [mon1]
2026-08-06 15:34:02.012072 | mon1 |
2026-08-06 15:34:02.012116 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-08-06 15:34:02.012122 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.033)       0:01:20.778 *******
2026-08-06 15:34:02.221248 | mon1 | ok: [mon1]
2026-08-06 15:34:02.221322 | mon1 |
2026-08-06 15:34:02.221575 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:34:02.221624 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.209)       0:01:20.987 *******
2026-08-06 15:34:02.290754 | mon1 | ok: [mon1] => {
2026-08-06 15:34:02.290860 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-08-06 15:34:02.291255 | mon1 | }
2026-08-06 15:34:02.291300 | mon1 |
2026-08-06 15:34:02.291306 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:34:02.291311 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.069)       0:01:21.057 *******
2026-08-06 15:34:02.593885 | mon1 | ok: [mon1]
2026-08-06 15:34:02.593938 | mon1 |
2026-08-06 15:34:02.594212 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:34:02.594234 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.303)       0:01:21.360 *******
2026-08-06 15:34:02.632866 | mon1 | skipping: [mon1]
2026-08-06 15:34:02.632922 | mon1 |
2026-08-06 15:34:02.633023 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:34:02.633119 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.039)       0:01:21.400 *******
2026-08-06 15:34:02.669740 | mon1 | skipping: [mon1]
2026-08-06 15:34:02.669777 | mon1 |
2026-08-06 15:34:02.669886 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:34:02.669977 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.036)       0:01:21.437 *******
2026-08-06 15:34:02.861545 | mon1 | ok: [mon1]
2026-08-06 15:34:02.861606 | mon1 |
2026-08-06 15:34:02.861692 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-08-06 15:34:02.861791 | mon1 | Thursday 06 August 2026  15:34:02 +0000 (0:00:00.191)       0:01:21.628 *******
2026-08-06 15:34:03.891636 | mon1 | ok: [mon1]
2026-08-06 15:34:03.891694 | mon1 |
2026-08-06 15:34:03.891886 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:34:03.892080 | mon1 | Thursday 06 August 2026  15:34:03 +0000 (0:00:01.029)       0:01:22.658 *******
2026-08-06 15:34:03.971887 | mon1 | ok: [mon1] => {
2026-08-06 15:34:03.971926 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz"
2026-08-06 15:34:03.972285 | mon1 | }
2026-08-06 15:34:03.972309 | mon1 |
2026-08-06 15:34:03.972314 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:34:03.972320 | mon1 | Thursday 06 August 2026  15:34:03 +0000 (0:00:00.080)       0:01:22.738 *******
2026-08-06 15:34:04.308965 | mon1 | ok: [mon1]
2026-08-06 15:34:04.309012 | mon1 |
2026-08-06 15:34:04.309262 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:34:04.309312 | mon1 | Thursday 06 August 2026  15:34:04 +0000 (0:00:00.337)       0:01:23.075 *******
2026-08-06 15:34:06.217628 | mon1 | ok: [mon1]
2026-08-06 15:34:06.217698 | mon1 |
2026-08-06 15:34:06.217754 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-08-06 15:34:06.217843 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:01.908)       0:01:24.984 *******
2026-08-06 15:34:06.241581 | mon1 | skipping: [mon1]
2026-08-06 15:34:06.241663 | mon1 |
2026-08-06 15:34:06.241897 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-08-06 15:34:06.241942 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.023)       0:01:25.008 *******
2026-08-06 15:34:06.263122 | mon1 | skipping: [mon1]
2026-08-06 15:34:06.264110 | mon1 |
2026-08-06 15:34:06.264180 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-08-06 15:34:06.264198 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.021)       0:01:25.029 *******
2026-08-06 15:34:06.289365 | mon1 | skipping: [mon1]
2026-08-06 15:34:06.290051 | mon1 |
2026-08-06 15:34:06.290152 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-08-06 15:34:06.290168 | mon1 | Thursday 06 August 2026  15:34:06 +0000 (0:00:00.025)       0:01:25.055 *******
2026-08-06 15:34:07.318846 | mon1 | ok: [mon1]
2026-08-06 15:34:07.318909 | mon1 |
2026-08-06 15:34:07.319202 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-08-06 15:34:07.319226 | mon1 | Thursday 06 August 2026  15:34:07 +0000 (0:00:01.030)       0:01:26.085 *******
2026-08-06 15:34:07.740389 | mon1 | ok: [mon1]
2026-08-06 15:34:07.740455 | mon1 |
2026-08-06 15:34:07.740789 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-08-06 15:34:07.740832 | mon1 | Thursday 06 August 2026  15:34:07 +0000 (0:00:00.421)       0:01:26.507 *******
2026-08-06 15:34:08.636532 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-08-06 15:34:08.636568 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-08-06 15:34:08.636575 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-08-06 15:34:08.636579 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-08-06 15:34:08.636584 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-08-06 15:34:08.636589 | mon1 |
2026-08-06 15:34:08.636594 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-08-06 15:34:08.636598 | mon1 | Thursday 06 August 2026  15:34:08 +0000 (0:00:00.895)       0:01:27.402 *******
2026-08-06 15:34:09.139706 | mon1 | ok: [mon1]
2026-08-06 15:34:09.139770 | mon1 |
2026-08-06 15:34:09.140227 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-08-06 15:34:09.140266 | mon1 | Thursday 06 August 2026  15:34:09 +0000 (0:00:00.498)       0:01:27.901 *******
2026-08-06 15:34:09.140271 | mon1 |
2026-08-06 15:34:09.140276 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-08-06 15:34:09.140281 | mon1 | Thursday 06 August 2026  15:34:09 +0000 (0:00:00.005)       0:01:27.906 *******
2026-08-06 15:34:09.487753 | mon1 | ok: [mon1]
2026-08-06 15:34:09.487852 | mon1 |
2026-08-06 15:34:09.487864 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-08-06 15:34:09.487988 | mon1 | Thursday 06 August 2026  15:34:09 +0000 (0:00:00.347)       0:01:28.254 *******
2026-08-06 15:34:09.682588 | mon1 | ok: [mon1]
2026-08-06 15:34:09.682662 | mon1 |
2026-08-06 15:34:09.682822 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-08-06 15:34:09.682840 | mon1 | Thursday 06 August 2026  15:34:09 +0000 (0:00:00.194)       0:01:28.449 *******
2026-08-06 15:34:09.759178 | mon1 | ok: [mon1] => {
2026-08-06 15:34:09.759219 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-08-06 15:34:09.759321 | mon1 | }
2026-08-06 15:34:09.759460 | mon1 |
2026-08-06 15:34:09.759547 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-08-06 15:34:09.759610 | mon1 | Thursday 06 August 2026  15:34:09 +0000 (0:00:00.077)       0:01:28.526 *******
2026-08-06 15:34:10.127412 | mon1 | ok: [mon1]
2026-08-06 15:34:10.127461 | mon1 |
2026-08-06 15:34:10.127473 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-08-06 15:34:10.127489 | mon1 | Thursday 06 August 2026  15:34:10 +0000 (0:00:00.367)       0:01:28.893 *******
2026-08-06 15:34:13.196355 | mon1 | ok: [mon1]
2026-08-06 15:34:13.196436 | mon1 |
2026-08-06 15:34:13.196625 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-08-06 15:34:13.196672 | mon1 | Thursday 06 August 2026  15:34:13 +0000 (0:00:03.069)       0:01:31.963 *******
2026-08-06 15:34:14.253140 | mon1 | ok: [mon1]
2026-08-06 15:34:14.253216 | mon1 |
2026-08-06 15:34:14.253492 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-08-06 15:34:14.253543 | mon1 | Thursday 06 August 2026  15:34:14 +0000 (0:00:01.056)       0:01:33.019 *******
2026-08-06 15:34:14.437612 | mon1 | ok: [mon1]
2026-08-06 15:34:14.437688 | mon1 |
2026-08-06 15:34:14.437857 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-08-06 15:34:14.437884 | mon1 | Thursday 06 August 2026  15:34:14 +0000 (0:00:00.185)       0:01:33.204 *******
2026-08-06 15:34:14.843868 | mon1 | ok: [mon1]
2026-08-06 15:34:14.843976 | mon1 |
2026-08-06 15:34:14.844289 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-08-06 15:34:14.844336 | mon1 | Thursday 06 August 2026  15:34:14 +0000 (0:00:00.405)       0:01:33.610 *******
2026-08-06 15:34:15.373380 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-08-06 15:34:15.373459 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-08-06 15:34:15.373560 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-08-06 15:34:15.373870 | mon1 |
2026-08-06 15:34:15.373911 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-08-06 15:34:15.373917 | mon1 | Thursday 06 August 2026  15:34:15 +0000 (0:00:00.529)       0:01:34.140 *******
2026-08-06 15:34:15.769953 | mon1 | ok: [mon1]
2026-08-06 15:34:15.770067 | mon1 |
2026-08-06 15:34:15.770383 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-08-06 15:34:15.770545 | mon1 | Thursday 06 August 2026  15:34:15 +0000 (0:00:00.396)       0:01:34.536 *******
2026-08-06 15:34:16.175633 | mon1 | ok: [mon1]
2026-08-06 15:34:16.175696 | mon1 |
2026-08-06 15:34:16.175754 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-08-06 15:34:16.176136 | mon1 | Thursday 06 August 2026  15:34:16 +0000 (0:00:00.401)       0:01:34.938 *******
2026-08-06 15:34:16.176183 | mon1 |
2026-08-06 15:34:16.176188 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-08-06 15:34:16.176193 | mon1 | Thursday 06 August 2026  15:34:16 +0000 (0:00:00.004)       0:01:34.942 *******
2026-08-06 15:34:16.531891 | mon1 | ok: [mon1]
2026-08-06 15:34:16.531926 | mon1 |
2026-08-06 15:34:16.531932 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-08-06 15:34:16.531936 | mon1 | Thursday 06 August 2026  15:34:16 +0000 (0:00:00.355)       0:01:35.298 *******
2026-08-06 15:34:16.578076 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-08-06 15:34:16.578099 | mon1 |
2026-08-06 15:34:16.578106 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-08-06 15:34:16.578125 | mon1 | Thursday 06 August 2026  15:34:16 +0000 (0:00:00.046)       0:01:35.344 *******
2026-08-06 15:34:17.566584 | mon1 | ok: [mon1]
2026-08-06 15:34:17.566632 | mon1 |
2026-08-06 15:34:17.566640 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-08-06 15:34:17.566646 | mon1 | Thursday 06 August 2026  15:34:17 +0000 (0:00:00.988)       0:01:36.333 *******
2026-08-06 15:34:18.196927 | mon1 | ok: [mon1] => (item=chronyd)
2026-08-06 15:34:18.196968 | mon1 | ok: [mon1] => (item=sshd)
2026-08-06 15:34:18.196973 | mon1 |
2026-08-06 15:34:18.196978 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-08-06 15:34:18.196982 | mon1 | Thursday 06 August 2026  15:34:18 +0000 (0:00:00.630)       0:01:36.963 *******
2026-08-06 15:34:19.102419 | mon1 | ok: [mon1]
2026-08-06 15:34:19.102496 | mon1 |
2026-08-06 15:34:19.102535 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-08-06 15:34:19.102667 | mon1 | Thursday 06 August 2026  15:34:19 +0000 (0:00:00.905)       0:01:37.869 *******
2026-08-06 15:34:19.289970 | mon1 | ok: [mon1]
2026-08-06 15:34:19.290035 | mon1 |
2026-08-06 15:34:19.290243 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-08-06 15:34:19.290288 | mon1 | Thursday 06 August 2026  15:34:19 +0000 (0:00:00.187)       0:01:38.057 *******
2026-08-06 15:34:19.525130 | mon1 | ok: [mon1]
2026-08-06 15:34:19.525223 | mon1 |
2026-08-06 15:34:19.525457 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-08-06 15:34:19.525500 | mon1 | Thursday 06 August 2026  15:34:19 +0000 (0:00:00.235)       0:01:38.292 *******
2026-08-06 15:34:19.725459 | mon1 | ok: [mon1]
2026-08-06 15:34:19.725540 | mon1 |
2026-08-06 15:34:19.725754 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-08-06 15:34:19.725780 | mon1 | Thursday 06 August 2026  15:34:19 +0000 (0:00:00.200)       0:01:38.492 *******
2026-08-06 15:34:21.244357 | mon1 | ok: [mon1]
2026-08-06 15:34:21.244430 | mon1 |
2026-08-06 15:34:21.244504 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:34:21.246908 | mon1 | mon1                       : ok=83   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-08-06 15:34:21.246955 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-08-06 15:34:21.246960 | mon1 |
2026-08-06 15:34:21.246965 | mon1 |
2026-08-06 15:34:21.246970 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:34:21.246974 | mon1 | Thursday 06 August 2026  15:34:21 +0000 (0:00:01.519)       0:01:40.011 *******
2026-08-06 15:34:21.246978 | mon1 | ===============================================================================
2026-08-06 15:34:21.246983 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.15s
2026-08-06 15:34:21.246987 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.70s
2026-08-06 15:34:21.246991 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.08s
2026-08-06 15:34:21.246995 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.07s
2026-08-06 15:34:21.246999 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.05s
2026-08-06 15:34:21.247003 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.32s
2026-08-06 15:34:21.247007 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.26s
2026-08-06 15:34:21.247012 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.20s
2026-08-06 15:34:21.247016 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.20s
2026-08-06 15:34:21.247020 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.91s
2026-08-06 15:34:21.247024 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 1.91s
2026-08-06 15:34:21.247028 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 1.77s
2026-08-06 15:34:21.247046 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.69s
2026-08-06 15:34:21.247050 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 1.66s
2026-08-06 15:34:21.247054 | mon1 | vexxhost.ceph.mon : Validate monitor exist ------------------------------ 1.64s
2026-08-06 15:34:21.247058 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 1.61s
2026-08-06 15:34:21.247063 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.60s
2026-08-06 15:34:21.247067 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 1.60s
2026-08-06 15:34:21.247071 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 1.57s
2026-08-06 15:34:21.247075 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 1.52s
2026-08-06 15:34:21.354415 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-08-06 15:34:21.362349 | mon1 | INFO     [default > side_effect] Executing
2026-08-06 15:34:21.362677 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-08-06 15:34:21.367643 | mon1 | INFO     [default > verify] Executing
2026-08-06 15:34:21.974843 | mon1 |
2026-08-06 15:34:21.975220 | mon1 | PLAY [Verify] ******************************************************************
2026-08-06 15:34:21.975506 | mon1 |
2026-08-06 15:34:21.975769 | mon1 | TASK [Gathering Facts] *********************************************************
2026-08-06 15:34:21.976037 | mon1 | Thursday 06 August 2026  15:34:21 +0000 (0:00:00.006)       0:00:00.006 *******
2026-08-06 15:34:23.088690 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-08-06 15:34:23.088744 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-08-06 15:34:23.088756 | mon1 | interpreter could change the meaning of that path. See
2026-08-06 15:34:23.088767 | mon1 | https://docs.ansible.com/ansible-
2026-08-06 15:34:23.088776 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-08-06 15:34:23.096554 | mon1 | ok: [mon1]
2026-08-06 15:34:23.096588 | mon1 |
2026-08-06 15:34:23.096600 | mon1 | TASK [List locally deployed Ceph daemons] **************************************
2026-08-06 15:34:23.096610 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:01.121)       0:00:01.128 *******
2026-08-06 15:34:23.845062 | mon1 | ok: [mon1]
2026-08-06 15:34:23.845135 | mon1 |
2026-08-06 15:34:23.845147 | mon1 | TASK [Collect deployed Ceph container images] **********************************
2026-08-06 15:34:23.845158 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.748)       0:00:01.876 *******
2026-08-06 15:34:23.881452 | mon1 | ok: [mon1]
2026-08-06 15:34:23.881646 | mon1 |
2026-08-06 15:34:23.881864 | mon1 | TASK [Assert that a deployed Ceph container image was found] *******************
2026-08-06 15:34:23.882073 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.037)       0:00:01.913 *******
2026-08-06 15:34:23.904348 | mon1 | fatal: [mon1]: FAILED! => {
2026-08-06 15:34:23.904528 | mon1 |     "assertion": "_ceph_container_images | length > 0",
2026-08-06 15:34:23.904731 | mon1 |     "changed": false,
2026-08-06 15:34:23.904931 | mon1 |     "evaluated_to": false,
2026-08-06 15:34:23.905140 | mon1 |     "msg": "No deployed monitor container image was found in cephadm metadata"
2026-08-06 15:34:23.905336 | mon1 | }
2026-08-06 15:34:23.905708 | mon1 |
2026-08-06 15:34:23.905943 | mon1 | PLAY RECAP *********************************************************************
2026-08-06 15:34:23.906175 | mon1 | mon1                       : ok=3    changed=0    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0
2026-08-06 15:34:23.906363 | mon1 |
2026-08-06 15:34:23.906547 | mon1 |
2026-08-06 15:34:23.906746 | mon1 | TASKS RECAP ********************************************************************
2026-08-06 15:34:23.906949 | mon1 | Thursday 06 August 2026  15:34:23 +0000 (0:00:00.024)       0:00:01.938 *******
2026-08-06 15:34:23.907129 | mon1 | ===============================================================================
2026-08-06 15:34:23.907360 | mon1 | Gathering Facts --------------------------------------------------------- 1.12s
2026-08-06 15:34:23.907598 | mon1 | List locally deployed Ceph daemons -------------------------------------- 0.75s
2026-08-06 15:34:23.907793 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.04s
2026-08-06 15:34:23.907991 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.02s
2026-08-06 15:34:23.986560 | mon1 | CRITICAL Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml
2026-08-06 15:34:23.986695 | mon1 | ERROR    [default > verify] Executed: Failed
2026-08-06 15:34:23.986812 | mon1 | ERROR    Ansible return code was 2, command was: ansible-playbook --inventory /home/zuul/.ansible/tmp/molecule.kre9.default/inventory --skip-tags molecule-notest,notest --inventory=/home/zuul/src/github.com/vexxhost/ansible-collection-ceph/inventory.yaml /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/verify.yml
2026-08-06 15:34:24.562144 | mon1 | ERROR
2026-08-06 15:34:24.562435 | mon1 | {
2026-08-06 15:34:24.562500 | mon1 |   "delta": "0:09:39.579313",
2026-08-06 15:34:24.562547 | mon1 |   "end": "2026-08-06 15:34:24.059171",
2026-08-06 15:34:24.562588 | mon1 |   "msg": "non-zero return code",
2026-08-06 15:34:24.562630 | mon1 |   "rc": 2,
2026-08-06 15:34:24.562671 | mon1 |   "start": "2026-08-06 15:24:44.479858"
2026-08-06 15:34:24.562711 | mon1 | }
failure
2026-08-06 15:34:24.579632 | 
2026-08-06 15:34:24.579683 | PLAY RECAP
2026-08-06 15:34:24.579728 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-06 15:34:24.579749 | 
2026-08-06 15:34:24.708776 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-08-06 15:34:24.715836 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-06 15:34:25.314745 | 
2026-08-06 15:34:25.314878 | PLAY [all]
2026-08-06 15:34:25.326227 | 
2026-08-06 15:34:25.326302 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-06 15:34:25.384874 | mon1 | ok
2026-08-06 15:34:25.391824 | osd1 | ok
2026-08-06 15:34:25.396401 | 
2026-08-06 15:34:25.396475 | TASK [fetch-output : Set log path for single node]
2026-08-06 15:34:25.422854 | mon1 | skipping: Conditional result was False
2026-08-06 15:34:25.434244 | osd1 | skipping: Conditional result was False
2026-08-06 15:34:25.443432 | 
2026-08-06 15:34:25.443531 | LOOP [fetch-output : Ensure local output dirs]
2026-08-06 15:34:25.816035 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/logs/mon1"
2026-08-06 15:34:25.838522 | osd1 -> localhost | changed: "/var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/logs/osd1"
2026-08-06 15:34:26.026360 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/artifacts"
2026-08-06 15:34:26.039216 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/artifacts"
2026-08-06 15:34:26.234704 | mon1 -> localhost | changed: "/var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/docs"
2026-08-06 15:34:26.244246 | osd1 -> localhost | ok: "/var/lib/zuul/builds/a2e55cad247a429c9d03134659ef6903/work/docs"
2026-08-06 15:34:26.244321 | osd1 -> localhost | changed: All items complete
2026-08-06 15:34:26.244357 | 
2026-08-06 15:34:26.267035 | 
2026-08-06 15:34:26.267253 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-06 15:34:26.899016 | mon1 | changed: .d..t...... ./
2026-08-06 15:34:26.908989 | osd1 | changed: .d..t...... ./
2026-08-06 15:34:27.362082 | osd1 | ok
2026-08-06 15:34:27.367904 | mon1 | changed: .d..t...... ./
2026-08-06 15:34:27.819970 | mon1 | changed: .d..t...... ./
2026-08-06 15:34:27.825076 | osd1 | ok
2026-08-06 15:34:27.858734 | 
2026-08-06 15:34:27.859317 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-06 15:34:28.345963 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.069057
2026-08-06 15:34:28.346245 | mon1 -> localhost | changed: All items complete
2026-08-06 15:34:28.346286 | 
2026-08-06 15:34:28.564507 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007122
2026-08-06 15:34:28.590803 | 
2026-08-06 15:34:28.590913 | PLAY [all]
2026-08-06 15:34:28.597460 | 
2026-08-06 15:34:28.597523 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-06 15:34:28.986101 | mon1 | changed
2026-08-06 15:34:29.169729 | osd1 | changed
2026-08-06 15:34:29.179039 | 
2026-08-06 15:34:29.179087 | PLAY RECAP
2026-08-06 15:34:29.179133 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-06 15:34:29.179162 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-06 15:34:29.179181 | 
2026-08-06 15:34:29.321829 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-06 15:34:29.325540 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-06 15:34:29.882057 | 
2026-08-06 15:34:29.882179 | PLAY [localhost]
2026-08-06 15:34:29.891627 | 
2026-08-06 15:34:29.891697 | TASK [Generate Zuul manifest]
2026-08-06 15:34:29.912356 | localhost | ok
2026-08-06 15:34:29.929426 | 
2026-08-06 15:34:29.929509 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-06 15:34:30.316862 | localhost | changed
2026-08-06 15:34:30.328456 | 
2026-08-06 15:34:30.328538 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-06 15:34:30.361036 | localhost | ok
2026-08-06 15:34:30.368218 | 
2026-08-06 15:34:30.368325 | TASK [Upload logs]
2026-08-06 15:34:30.388585 | localhost | ok
2026-08-06 15:34:30.452998 | 
2026-08-06 15:34:30.453194 | TASK [Set zuul-log-path fact]
2026-08-06 15:34:30.473836 | localhost | ok
2026-08-06 15:34:30.487244 | 
2026-08-06 15:34:30.487315 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-06 15:34:30.518367 | localhost | ok
2026-08-06 15:34:30.528481 | 
2026-08-06 15:34:30.528567 | TASK [upload-logs : Create log directories]
2026-08-06 15:34:30.935032 | localhost | changed
2026-08-06 15:34:30.941600 | 
2026-08-06 15:34:30.941674 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-06 15:34:31.360218 | localhost -> localhost | ok: Runtime: 0:00:00.005616
2026-08-06 15:34:31.366761 | 
2026-08-06 15:34:31.366827 | TASK [upload-logs : Upload logs to log server]
2026-08-06 15:34:31.822365 | localhost | Output suppressed because no_log was given
2026-08-06 15:34:31.827385 | 
2026-08-06 15:34:31.827468 | LOOP [upload-logs : Compress console log and json output]
2026-08-06 15:34:31.910613 | localhost | skipping: Conditional result was False
2026-08-06 15:34:31.919598 | localhost | skipping: Conditional result was False
2026-08-06 15:34:31.933125 | 
2026-08-06 15:34:31.933296 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-06 15:34:32.009291 | localhost | skipping: Conditional result was False
2026-08-06 15:34:32.009816 | 
2026-08-06 15:34:32.013465 | localhost | skipping: Conditional result was False
2026-08-06 15:34:32.066463 | 
2026-08-06 15:34:32.066619 | LOOP [upload-logs : Upload console log and json output]