2026-05-28 02:32:05.658016 | Job console starting
2026-05-28 02:32:05.673471 | Updating git repos
2026-05-28 02:32:05.697979 | Cloning repos into workspace
2026-05-28 02:32:05.748565 | Restoring repo states
2026-05-28 02:32:05.755920 | Merging changes
2026-05-28 02:32:06.018684 | Checking out repos
2026-05-28 02:32:06.052075 | Preparing playbooks
2026-05-28 02:32:07.028526 | Running Ansible setup
2026-05-28 02:32:12.288073 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-28 02:32:12.848842 | 
2026-05-28 02:32:12.911106 | PLAY [localhost]
2026-05-28 02:32:12.924135 | 
2026-05-28 02:32:12.924202 | TASK [Gathering Facts]
2026-05-28 02:32:13.895813 | localhost | ok
2026-05-28 02:32:13.907729 | 
2026-05-28 02:32:13.907905 | TASK [Setup log path fact]
2026-05-28 02:32:13.932315 | localhost | ok
2026-05-28 02:32:13.945170 | 
2026-05-28 02:32:13.977383 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-28 02:32:14.010960 | localhost | ok
2026-05-28 02:32:14.019137 | 
2026-05-28 02:32:14.019236 | TASK [emit-job-header : Print job information]
2026-05-28 02:32:14.062953 | # Job Information
2026-05-28 02:32:14.063261 | Ansible Version: 2.16.18
2026-05-28 02:32:14.063333 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-05-28 02:32:14.063384 | Pipeline: check
2026-05-28 02:32:14.063428 | Executor: 2d72f0692154
2026-05-28 02:32:14.063472 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/111
2026-05-28 02:32:14.063521 | Event ID: 56944ae0-5a3d-11f1-9e87-3bf9ff3e74e6
2026-05-28 02:32:14.069289 | 
2026-05-28 02:32:14.069418 | LOOP [emit-job-header : Print node information]
2026-05-28 02:32:14.203530 | localhost | ok:
2026-05-28 02:32:14.203795 | localhost | # Node Information
2026-05-28 02:32:14.203835 | localhost | Inventory Hostname: mon1
2026-05-28 02:32:14.203866 | localhost | Hostname: np0000177148
2026-05-28 02:32:14.203894 | localhost | Username: zuul
2026-05-28 02:32:14.203931 | localhost | Distro: Ubuntu 24.04
2026-05-28 02:32:14.203961 | localhost | Provider: yul1
2026-05-28 02:32:14.203988 | localhost | Region: ca-ymq-1
2026-05-28 02:32:14.204016 | localhost | Label: ubuntu-noble
2026-05-28 02:32:14.204042 | localhost | Product Name: OpenStack Nova
2026-05-28 02:32:14.204067 | localhost | Interface IP: 199.19.213.57
2026-05-28 02:32:14.252059 | localhost | ok:
2026-05-28 02:32:14.252171 | localhost | # Node Information
2026-05-28 02:32:14.252235 | localhost | Inventory Hostname: osd1
2026-05-28 02:32:14.252287 | localhost | Hostname: np0000177149
2026-05-28 02:32:14.252337 | localhost | Username: zuul
2026-05-28 02:32:14.252385 | localhost | Distro: Ubuntu 24.04
2026-05-28 02:32:14.252432 | localhost | Provider: yul1
2026-05-28 02:32:14.252478 | localhost | Region: ca-ymq-1
2026-05-28 02:32:14.252524 | localhost | Label: ubuntu-noble
2026-05-28 02:32:14.252572 | localhost | Product Name: OpenStack Nova
2026-05-28 02:32:14.252619 | localhost | Interface IP: 199.204.45.23
2026-05-28 02:32:14.264789 | 
2026-05-28 02:32:14.264882 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-05-28 02:32:14.634827 | localhost -> localhost | changed
2026-05-28 02:32:14.643687 | 
2026-05-28 02:32:14.643944 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-05-28 02:32:15.730507 | localhost -> localhost | changed
2026-05-28 02:32:15.736278 | 
2026-05-28 02:32:15.736335 | PLAY [all]
2026-05-28 02:32:15.744668 | 
2026-05-28 02:32:15.744731 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-05-28 02:32:16.027362 | mon1 -> localhost | ok
2026-05-28 02:32:16.040640 | 
2026-05-28 02:32:16.040729 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-05-28 02:32:16.076661 | mon1 | ok
2026-05-28 02:32:16.085400 | osd1 | ok
2026-05-28 02:32:16.498490 | mon1 | included: /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-28 02:32:16.498579 | osd1 | included: /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-28 02:32:16.504849 | 
2026-05-28 02:32:16.504914 | TASK [add-build-sshkey : Create Temp SSH key]
2026-05-28 02:32:17.356246 | mon1 -> localhost | Generating public/private rsa key pair.
2026-05-28 02:32:17.356423 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/62eb0b50182a40c39b77182c92e373f6_id_rsa
2026-05-28 02:32:17.356466 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/62eb0b50182a40c39b77182c92e373f6_id_rsa.pub
2026-05-28 02:32:17.356499 | mon1 -> localhost | The key fingerprint is:
2026-05-28 02:32:17.356530 | mon1 -> localhost | SHA256:lzE4x6iT4K2WlkWovJxXgT+xBtkyT/Fv1Gk069Izi/M zuul-build-sshkey
2026-05-28 02:32:17.356560 | mon1 -> localhost | The key's randomart image is:
2026-05-28 02:32:17.356589 | mon1 -> localhost | +---[RSA 3072]----+
2026-05-28 02:32:17.356617 | mon1 -> localhost | |      .     o    |
2026-05-28 02:32:17.356646 | mon1 -> localhost | |     = o + o +   |
2026-05-28 02:32:17.356673 | mon1 -> localhost | |    O * = * =    |
2026-05-28 02:32:17.356702 | mon1 -> localhost | | . o @ * = B     |
2026-05-28 02:32:17.356730 | mon1 -> localhost | |  o . & S * =    |
2026-05-28 02:32:17.356757 | mon1 -> localhost | | . o B o o o +   |
2026-05-28 02:32:17.356784 | mon1 -> localhost | |  + B     o .    |
2026-05-28 02:32:17.356811 | mon1 -> localhost | |   +       o     |
2026-05-28 02:32:17.356838 | mon1 -> localhost | |            E    |
2026-05-28 02:32:17.356865 | mon1 -> localhost | +----[SHA256]-----+
2026-05-28 02:32:17.356922 | mon1 -> localhost | ok: Runtime: 0:00:00.451180
2026-05-28 02:32:17.364496 | 
2026-05-28 02:32:17.364578 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-05-28 02:32:17.401785 | mon1 | ok
2026-05-28 02:32:17.407752 | osd1 | ok
2026-05-28 02:32:17.420888 | mon1 | included: /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-28 02:32:17.420938 | osd1 | included: /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-28 02:32:17.431675 | 
2026-05-28 02:32:17.431734 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-05-28 02:32:17.455112 | mon1 | skipping: Conditional result was False
2026-05-28 02:32:17.466012 | osd1 | skipping: Conditional result was False
2026-05-28 02:32:17.475218 | 
2026-05-28 02:32:17.475305 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-05-28 02:32:17.975967 | mon1 | changed
2026-05-28 02:32:18.026033 | osd1 | changed
2026-05-28 02:32:18.033970 | 
2026-05-28 02:32:18.034040 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-05-28 02:32:18.315703 | mon1 | ok
2026-05-28 02:32:18.321673 | osd1 | ok
2026-05-28 02:32:18.326989 | 
2026-05-28 02:32:18.327069 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-05-28 02:32:18.903779 | mon1 | changed
2026-05-28 02:32:18.944581 | osd1 | changed
2026-05-28 02:32:18.952371 | 
2026-05-28 02:32:18.952456 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-05-28 02:32:19.502831 | osd1 | changed
2026-05-28 02:32:19.507961 | mon1 | changed
2026-05-28 02:32:19.513390 | 
2026-05-28 02:32:19.513459 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-05-28 02:32:19.539704 | mon1 | skipping: Conditional result was False
2026-05-28 02:32:19.551301 | osd1 | skipping: Conditional result was False
2026-05-28 02:32:19.561818 | 
2026-05-28 02:32:19.561941 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-05-28 02:32:19.995299 | mon1 -> localhost | changed
2026-05-28 02:32:20.021558 | 
2026-05-28 02:32:20.021683 | TASK [add-build-sshkey : Add back temp key]
2026-05-28 02:32:20.301592 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/62eb0b50182a40c39b77182c92e373f6_id_rsa (zuul-build-sshkey)
2026-05-28 02:32:20.301870 | mon1 -> localhost | ok: Runtime: 0:00:00.016349
2026-05-28 02:32:20.307228 | 
2026-05-28 02:32:20.307292 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-05-28 02:32:20.631761 | osd1 | ok
2026-05-28 02:32:20.638212 | mon1 | ok
2026-05-28 02:32:20.643044 | 
2026-05-28 02:32:20.643107 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-05-28 02:32:20.669158 | mon1 | skipping: Conditional result was False
2026-05-28 02:32:20.680028 | osd1 | skipping: Conditional result was False
2026-05-28 02:32:20.700538 | 
2026-05-28 02:32:20.700604 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-05-28 02:32:21.004946 | mon1 | ok
2026-05-28 02:32:21.033586 | osd1 | ok
2026-05-28 02:32:21.041934 | 
2026-05-28 02:32:21.042024 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-05-28 02:32:21.793875 | osd1 | Output suppressed because no_log was given
2026-05-28 02:32:21.812338 | mon1 | Output suppressed because no_log was given
2026-05-28 02:32:21.834476 | 
2026-05-28 02:32:21.836818 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-05-28 02:32:22.060420 | mon1 | ok: "logs"
2026-05-28 02:32:22.060707 | mon1 | ok: All items complete
2026-05-28 02:32:22.060748 | 
2026-05-28 02:32:22.067344 | osd1 | ok: "logs"
2026-05-28 02:32:22.273385 | mon1 | ok: "artifacts"
2026-05-28 02:32:22.305578 | osd1 | ok: "artifacts"
2026-05-28 02:32:22.482402 | mon1 | ok: "docs"
2026-05-28 02:32:22.498171 | osd1 | ok: "docs"
2026-05-28 02:32:22.507060 | 
2026-05-28 02:32:22.507199 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-05-28 02:32:22.730426 | mon1 | changed: "logs"
2026-05-28 02:32:22.730848 | mon1 | ok: All items complete
2026-05-28 02:32:22.730890 | 
2026-05-28 02:32:22.746383 | osd1 | changed: "logs"
2026-05-28 02:32:22.936899 | mon1 | changed: "artifacts"
2026-05-28 02:32:22.942228 | osd1 | changed: "artifacts"
2026-05-28 02:32:23.130023 | mon1 | changed: "docs"
2026-05-28 02:32:23.143089 | osd1 | changed: "docs"
2026-05-28 02:32:23.159483 | 
2026-05-28 02:32:23.159612 | PLAY RECAP
2026-05-28 02:32:23.159658 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:32:23.159688 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-28 02:32:23.159712 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-28 02:32:23.159731 | 
2026-05-28 02:32:23.323382 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-28 02:32:23.328566 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-28 02:32:23.896878 | 
2026-05-28 02:32:23.897017 | PLAY [all]
2026-05-28 02:32:23.907893 | 
2026-05-28 02:32:23.907965 | TASK [setup-uv : Extract archive]
2026-05-28 02:32:26.452455 | osd1 | changed
2026-05-28 02:32:26.469736 | mon1 | changed
2026-05-28 02:32:26.477613 | 
2026-05-28 02:32:26.477713 | TASK [setup-uv : Print version]
2026-05-28 02:32:26.630400 | osd1 | uv 0.8.13
2026-05-28 02:32:25.523687 | mon1 | uv 0.8.13
2026-05-28 02:32:27.039167 | mon1 | ok: Runtime: 0:00:00.016144
2026-05-28 02:32:27.050823 | osd1 | ok: Runtime: 0:00:00.015657
2026-05-28 02:32:27.064484 | 
2026-05-28 02:32:27.064552 | TASK [Install Ansible collection siblings]
2026-05-28 02:32:27.469895 | mon1 | ok:
2026-05-28 02:32:27.470071 | mon1 | Skipping community.general: no checked-out sibling
2026-05-28 02:32:27.470110 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-05-28 02:32:27.470141 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-05-28 02:32:27.472019 | 
2026-05-28 02:32:27.472079 | PLAY RECAP
2026-05-28 02:32:27.472140 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:32:27.472193 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:32:27.472221 | 
2026-05-28 02:32:27.571107 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-28 02:32:27.573566 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-28 02:32:28.188911 | 
2026-05-28 02:32:28.189327 | PLAY [all]
2026-05-28 02:32:28.201118 | 
2026-05-28 02:32:28.201210 | TASK [Copy inventory file for Zuul]
2026-05-28 02:32:29.184941 | mon1 | changed
2026-05-28 02:32:29.194856 | 
2026-05-28 02:32:29.194966 | TASK [Switch "ansible_host" to private IP]
2026-05-28 02:32:29.532297 | mon1 | changed: 2 replacements made
2026-05-28 02:32:29.538350 | 
2026-05-28 02:32:29.538431 | TASK [Run Molecule scenario]
2026-05-28 02:32:28.597489 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-05-28 02:32:28.597669 | mon1 | Creating virtual environment at: .venv
2026-05-28 02:32:28.928213 | mon1 | Downloading netaddr (2.2MiB)
2026-05-28 02:32:28.930920 | mon1 | Downloading pygments (1.2MiB)
2026-05-28 02:32:28.936252 | mon1 | Downloading cryptography (4.3MiB)
2026-05-28 02:32:28.976375 | mon1 | Downloading ansible-core (2.1MiB)
2026-05-28 02:32:29.131827 | mon1 |  Downloading netaddr
2026-05-28 02:32:29.143533 | mon1 |  Downloading cryptography
2026-05-28 02:32:29.204090 | mon1 |  Downloading pygments
2026-05-28 02:32:29.394487 | mon1 |  Downloading ansible-core
2026-05-28 02:32:29.439422 | mon1 | Installed 37 packages in 43ms
2026-05-28 02:32:30.201240 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-05-28 02:32:30.201353 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-05-28 02:32:30.833624 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-05-28 02:32:30.833707 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-05-28 02:32:46.513160 | mon1 | INFO     [default > dependency] Executing
2026-05-28 02:32:46.513345 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-05-28 02:32:46.513546 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-05-28 02:32:46.513682 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-05-28 02:32:46.519491 | mon1 | INFO     [default > cleanup] Executing
2026-05-28 02:32:46.519819 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:32:46.525413 | mon1 | INFO     [default > destroy] Executing
2026-05-28 02:32:46.525464 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-28 02:32:46.525548 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-28 02:32:46.531190 | mon1 | INFO     [default > syntax] Executing
2026-05-28 02:32:47.690572 | mon1 |
2026-05-28 02:32:47.691142 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-05-28 02:32:47.751008 | mon1 | INFO     [default > syntax] Executed: Successful
2026-05-28 02:32:47.762394 | mon1 | INFO     [default > create] Executing
2026-05-28 02:32:47.763993 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:32:47.770192 | mon1 | INFO     [default > prepare] Executing
2026-05-28 02:32:48.526646 | mon1 |
2026-05-28 02:32:48.526832 | mon1 | PLAY [Prepare] *****************************************************************
2026-05-28 02:32:48.527078 | mon1 |
2026-05-28 02:32:48.530077 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:32:48.530109 | mon1 | Thursday 28 May 2026  02:32:48 +0000 (0:00:00.032)       0:00:00.032 **********
2026-05-28 02:32:49.824902 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:32:49.825123 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:32:49.825400 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:32:49.825640 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:32:49.825904 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:32:50.879231 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-28 02:32:50.879399 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:32:50.879579 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:32:50.879738 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:32:50.879896 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:32:50.889062 | mon1 | ok: [mon1]
2026-05-28 02:32:50.889371 | mon1 | ok: [osd1]
2026-05-28 02:32:50.889619 | mon1 |
2026-05-28 02:32:50.889889 | mon1 | TASK [Configure short hostname] ************************************************
2026-05-28 02:32:50.890244 | mon1 | Thursday 28 May 2026  02:32:50 +0000 (0:00:02.363)       0:00:02.395 **********
2026-05-28 02:32:52.729063 | mon1 | changed: [osd1]
2026-05-28 02:32:52.729099 | mon1 | changed: [mon1]
2026-05-28 02:32:52.729104 | mon1 |
2026-05-28 02:32:52.729109 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-05-28 02:32:52.729117 | mon1 | Thursday 28 May 2026  02:32:52 +0000 (0:00:01.838)       0:00:04.233 **********
2026-05-28 02:32:53.040318 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-05-28 02:32:53.040543 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-05-28 02:32:53.040803 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-05-28 02:32:53.056497 | mon1 | changed: [osd1]
2026-05-28 02:32:53.056746 | mon1 | changed: [mon1]
2026-05-28 02:32:53.056983 | mon1 |
2026-05-28 02:32:53.057275 | mon1 | TASK [Update apt cache] ********************************************************
2026-05-28 02:32:53.057534 | mon1 | Thursday 28 May 2026  02:32:53 +0000 (0:00:00.328)       0:00:04.562 **********
2026-05-28 02:33:01.562077 | mon1 | changed: [mon1]
2026-05-28 02:33:01.562425 | mon1 | changed: [osd1]
2026-05-28 02:33:01.562729 | mon1 |
2026-05-28 02:33:01.562983 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-05-28 02:33:01.563241 | mon1 |
2026-05-28 02:33:01.563479 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:33:01.563712 | mon1 | Thursday 28 May 2026  02:33:01 +0000 (0:00:08.505)       0:00:13.067 **********
2026-05-28 02:33:02.390002 | mon1 | ok: [osd1]
2026-05-28 02:33:02.390254 | mon1 |
2026-05-28 02:33:02.390563 | mon1 | TASK [Install depedencies] *****************************************************
2026-05-28 02:33:02.390808 | mon1 | Thursday 28 May 2026  02:33:02 +0000 (0:00:00.827)       0:00:13.895 **********
2026-05-28 02:33:25.116121 | mon1 | changed: [osd1]
2026-05-28 02:33:25.116295 | mon1 |
2026-05-28 02:33:25.116545 | mon1 | TASK [Start up service] ********************************************************
2026-05-28 02:33:25.116775 | mon1 | Thursday 28 May 2026  02:33:25 +0000 (0:00:22.726)       0:00:36.621 **********
2026-05-28 02:33:25.819112 | mon1 | ok: [osd1]
2026-05-28 02:33:25.819316 | mon1 |
2026-05-28 02:33:25.819573 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-05-28 02:33:25.819815 | mon1 | Thursday 28 May 2026  02:33:25 +0000 (0:00:00.702)       0:00:37.324 **********
2026-05-28 02:33:26.172517 | mon1 | ok: [osd1]
2026-05-28 02:33:26.172715 | mon1 |
2026-05-28 02:33:26.172975 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-05-28 02:33:26.173295 | mon1 | Thursday 28 May 2026  02:33:26 +0000 (0:00:00.353)       0:00:37.678 **********
2026-05-28 02:33:26.970347 | mon1 | changed: [osd1]
2026-05-28 02:33:26.970459 | mon1 |
2026-05-28 02:33:26.970973 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-05-28 02:33:26.971262 | mon1 | Thursday 28 May 2026  02:33:26 +0000 (0:00:00.796)       0:00:38.474 **********
2026-05-28 02:33:27.240337 | mon1 | ok: [osd1]
2026-05-28 02:33:27.240524 | mon1 |
2026-05-28 02:33:27.240800 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-05-28 02:33:27.241107 | mon1 | Thursday 28 May 2026  02:33:27 +0000 (0:00:00.270)       0:00:38.745 **********
2026-05-28 02:33:27.270923 | mon1 | skipping: [osd1]
2026-05-28 02:33:27.271166 | mon1 |
2026-05-28 02:33:27.271408 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-05-28 02:33:27.271647 | mon1 | Thursday 28 May 2026  02:33:27 +0000 (0:00:00.031)       0:00:38.777 **********
2026-05-28 02:33:27.941233 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:33:27.941312 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:33:27.941492 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:33:27.941638 | mon1 |
2026-05-28 02:33:27.941803 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-05-28 02:33:27.941985 | mon1 | Thursday 28 May 2026  02:33:27 +0000 (0:00:00.669)       0:00:39.447 **********
2026-05-28 02:33:28.735677 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:33:28.735850 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:33:28.736143 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:33:28.736392 | mon1 |
2026-05-28 02:33:28.736631 | mon1 | TASK [Start loop devices] ******************************************************
2026-05-28 02:33:28.736936 | mon1 | Thursday 28 May 2026  02:33:28 +0000 (0:00:00.794)       0:00:40.241 **********
2026-05-28 02:33:30.602087 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:33:30.602261 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:33:30.602509 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:33:30.602733 | mon1 |
2026-05-28 02:33:30.602977 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-05-28 02:33:30.603262 | mon1 | Thursday 28 May 2026  02:33:30 +0000 (0:00:01.865)       0:00:42.106 **********
2026-05-28 02:33:32.077698 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:33:32.077817 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:33:32.077935 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:33:32.078133 | mon1 |
2026-05-28 02:33:32.078279 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-05-28 02:33:32.078431 | mon1 | Thursday 28 May 2026  02:33:32 +0000 (0:00:01.475)       0:00:43.582 **********
2026-05-28 02:33:33.462151 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-05-28 02:33:33.462233 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-05-28 02:33:33.462244 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-05-28 02:33:33.462254 | mon1 |
2026-05-28 02:33:33.462270 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:33:33.464058 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-28 02:33:33.464085 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-05-28 02:33:33.464094 | mon1 |
2026-05-28 02:33:33.464101 | mon1 |
2026-05-28 02:33:33.464109 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:33:33.464116 | mon1 | Thursday 28 May 2026  02:33:33 +0000 (0:00:01.385)       0:00:44.967 **********
2026-05-28 02:33:33.464123 | mon1 | ===============================================================================
2026-05-28 02:33:33.464129 | mon1 | Install depedencies ---------------------------------------------------- 22.73s
2026-05-28 02:33:33.464135 | mon1 | Update apt cache -------------------------------------------------------- 8.51s
2026-05-28 02:33:33.464142 | mon1 | Gathering Facts --------------------------------------------------------- 2.36s
2026-05-28 02:33:33.464148 | mon1 | Start loop devices ------------------------------------------------------ 1.87s
2026-05-28 02:33:33.464153 | mon1 | Configure short hostname ------------------------------------------------ 1.84s
2026-05-28 02:33:33.464260 | mon1 | Create a volume group for each loop device ------------------------------ 1.48s
2026-05-28 02:33:33.464514 | mon1 | Create a logical volume for each loop device ---------------------------- 1.39s
2026-05-28 02:33:33.464720 | mon1 | Gathering Facts --------------------------------------------------------- 0.83s
2026-05-28 02:33:33.464887 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.80s
2026-05-28 02:33:33.465037 | mon1 | Set permissions on loopback devices ------------------------------------- 0.79s
2026-05-28 02:33:33.465178 | mon1 | Start up service -------------------------------------------------------- 0.70s
2026-05-28 02:33:33.465313 | mon1 | Create devices for Ceph ------------------------------------------------- 0.67s
2026-05-28 02:33:33.465447 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.35s
2026-05-28 02:33:33.465582 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.33s
2026-05-28 02:33:33.465720 | mon1 | Get list of all loopback devices ---------------------------------------- 0.27s
2026-05-28 02:33:33.465858 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s
2026-05-28 02:33:33.548170 | mon1 | INFO     [default > prepare] Executed: Successful
2026-05-28 02:33:33.559546 | mon1 | INFO     [default > converge] Executing
2026-05-28 02:33:34.554199 | mon1 |
2026-05-28 02:33:34.554591 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-28 02:33:34.554875 | mon1 |
2026-05-28 02:33:34.555219 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:33:34.555532 | mon1 | Thursday 28 May 2026  02:33:34 +0000 (0:00:00.052)       0:00:00.052 **********
2026-05-28 02:33:35.625207 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:33:35.625578 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:33:35.625900 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:33:35.626241 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:33:35.626554 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:33:35.637868 | mon1 | ok: [mon1]
2026-05-28 02:33:35.638196 | mon1 |
2026-05-28 02:33:35.638512 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:33:35.638815 | mon1 | Thursday 28 May 2026  02:33:35 +0000 (0:00:01.083)       0:00:01.135 **********
2026-05-28 02:33:35.968962 | mon1 | ok: [mon1]
2026-05-28 02:33:35.969227 | mon1 |
2026-05-28 02:33:35.969492 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:33:35.969737 | mon1 | Thursday 28 May 2026  02:33:35 +0000 (0:00:00.330)       0:00:01.466 **********
2026-05-28 02:33:36.007938 | mon1 | skipping: [mon1]
2026-05-28 02:33:36.008205 | mon1 |
2026-05-28 02:33:36.008458 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:33:36.008729 | mon1 | Thursday 28 May 2026  02:33:36 +0000 (0:00:00.039)       0:00:01.506 **********
2026-05-28 02:33:36.361785 | mon1 | changed: [mon1]
2026-05-28 02:33:36.361964 | mon1 |
2026-05-28 02:33:36.362260 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:33:36.362501 | mon1 | Thursday 28 May 2026  02:33:36 +0000 (0:00:00.352)       0:00:01.858 **********
2026-05-28 02:33:36.466176 | mon1 | ok: [mon1] => {
2026-05-28 02:33:36.466442 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:33:36.466695 | mon1 | }
2026-05-28 02:33:36.466923 | mon1 |
2026-05-28 02:33:36.467216 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:33:36.467460 | mon1 | Thursday 28 May 2026  02:33:36 +0000 (0:00:00.104)       0:00:01.963 **********
2026-05-28 02:33:37.308128 | mon1 | changed: [mon1]
2026-05-28 02:33:37.308205 | mon1 |
2026-05-28 02:33:37.308258 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:33:37.308386 | mon1 | Thursday 28 May 2026  02:33:37 +0000 (0:00:00.833)       0:00:02.796 **********
2026-05-28 02:33:37.348687 | mon1 | skipping: [mon1]
2026-05-28 02:33:37.348822 | mon1 |
2026-05-28 02:33:37.349100 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:33:37.349346 | mon1 | Thursday 28 May 2026  02:33:37 +0000 (0:00:00.049)       0:00:02.846 **********
2026-05-28 02:33:37.394537 | mon1 | skipping: [mon1]
2026-05-28 02:33:37.394739 | mon1 |
2026-05-28 02:33:37.394982 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:33:37.395288 | mon1 | Thursday 28 May 2026  02:33:37 +0000 (0:00:00.046)       0:00:02.892 **********
2026-05-28 02:33:37.634754 | mon1 | ok: [mon1]
2026-05-28 02:33:37.634832 | mon1 |
2026-05-28 02:33:37.634850 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:33:37.635012 | mon1 | Thursday 28 May 2026  02:33:37 +0000 (0:00:00.240)       0:00:03.132 **********
2026-05-28 02:33:38.693167 | mon1 | ok: [mon1]
2026-05-28 02:33:38.693238 | mon1 |
2026-05-28 02:33:38.693536 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:33:38.693809 | mon1 | Thursday 28 May 2026  02:33:38 +0000 (0:00:01.057)       0:00:04.190 **********
2026-05-28 02:33:38.887586 | mon1 | ok: [mon1] => {
2026-05-28 02:33:38.887749 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:33:38.887926 | mon1 | }
2026-05-28 02:33:38.888233 | mon1 |
2026-05-28 02:33:38.888417 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:33:38.888618 | mon1 | Thursday 28 May 2026  02:33:38 +0000 (0:00:00.194)       0:00:04.385 **********
2026-05-28 02:33:39.915229 | mon1 | changed: [mon1]
2026-05-28 02:33:39.915318 | mon1 |
2026-05-28 02:33:39.915334 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:33:39.915349 | mon1 | Thursday 28 May 2026  02:33:39 +0000 (0:00:01.026)       0:00:05.411 **********
2026-05-28 02:33:43.150174 | mon1 | changed: [mon1]
2026-05-28 02:33:43.150236 | mon1 |
2026-05-28 02:33:43.150557 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:33:43.150610 | mon1 | Thursday 28 May 2026  02:33:43 +0000 (0:00:03.236)       0:00:08.648 **********
2026-05-28 02:33:43.180549 | mon1 | skipping: [mon1]
2026-05-28 02:33:43.180591 | mon1 |
2026-05-28 02:33:43.180608 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:33:43.180621 | mon1 | Thursday 28 May 2026  02:33:43 +0000 (0:00:00.028)       0:00:08.676 **********
2026-05-28 02:33:43.207165 | mon1 | skipping: [mon1]
2026-05-28 02:33:43.207242 | mon1 |
2026-05-28 02:33:43.207263 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:33:43.207442 | mon1 | Thursday 28 May 2026  02:33:43 +0000 (0:00:00.027)       0:00:08.704 **********
2026-05-28 02:33:43.234725 | mon1 | skipping: [mon1]
2026-05-28 02:33:43.234787 | mon1 |
2026-05-28 02:33:43.234800 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:33:43.234813 | mon1 | Thursday 28 May 2026  02:33:43 +0000 (0:00:00.026)       0:00:08.730 **********
2026-05-28 02:33:52.272484 | mon1 | changed: [mon1]
2026-05-28 02:33:52.272541 | mon1 |
2026-05-28 02:33:52.272554 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:33:52.272566 | mon1 | Thursday 28 May 2026  02:33:52 +0000 (0:00:09.036)       0:00:17.767 **********
2026-05-28 02:33:52.957615 | mon1 | changed: [mon1]
2026-05-28 02:33:52.957688 | mon1 |
2026-05-28 02:33:52.957702 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:33:52.957715 | mon1 | Thursday 28 May 2026  02:33:52 +0000 (0:00:00.685)       0:00:18.453 **********
2026-05-28 02:33:54.136184 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:33:54.136272 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:33:54.136443 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:33:54.136698 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:33:54.136953 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:33:54.137241 | mon1 |
2026-05-28 02:33:54.137472 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:33:54.137708 | mon1 | Thursday 28 May 2026  02:33:54 +0000 (0:00:01.180)       0:00:19.633 **********
2026-05-28 02:33:54.902913 | mon1 | changed: [mon1]
2026-05-28 02:33:54.903077 | mon1 |
2026-05-28 02:33:54.903408 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:33:54.903607 | mon1 | Thursday 28 May 2026  02:33:54 +0000 (0:00:00.759)       0:00:20.393 **********
2026-05-28 02:33:54.903825 | mon1 |
2026-05-28 02:33:54.904214 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:33:54.904462 | mon1 | Thursday 28 May 2026  02:33:54 +0000 (0:00:00.007)       0:00:20.400 **********
2026-05-28 02:33:55.979074 | mon1 | ok: [mon1]
2026-05-28 02:33:55.979112 | mon1 |
2026-05-28 02:33:55.979120 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-28 02:33:55.979129 | mon1 | Thursday 28 May 2026  02:33:55 +0000 (0:00:01.076)       0:00:21.476 **********
2026-05-28 02:33:56.560065 | mon1 | changed: [mon1]
2026-05-28 02:33:56.560264 | mon1 |
2026-05-28 02:33:56.560522 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:33:56.561052 | mon1 | Thursday 28 May 2026  02:33:56 +0000 (0:00:00.581)       0:00:22.057 **********
2026-05-28 02:33:58.260001 | mon1 | changed: [mon1]
2026-05-28 02:33:58.260087 | mon1 |
2026-05-28 02:33:58.260098 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:33:58.260108 | mon1 | Thursday 28 May 2026  02:33:58 +0000 (0:00:01.699)       0:00:23.756 **********
2026-05-28 02:33:58.528211 | mon1 | ok: [mon1]
2026-05-28 02:33:58.528280 | mon1 |
2026-05-28 02:33:58.528328 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:33:58.528643 | mon1 | Thursday 28 May 2026  02:33:58 +0000 (0:00:00.267)       0:00:24.024 **********
2026-05-28 02:33:58.609198 | mon1 | ok: [mon1] => {
2026-05-28 02:33:58.609244 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:33:58.609257 | mon1 | }
2026-05-28 02:33:58.610083 | mon1 |
2026-05-28 02:33:58.610119 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:33:58.610128 | mon1 | Thursday 28 May 2026  02:33:58 +0000 (0:00:00.080)       0:00:24.105 **********
2026-05-28 02:33:59.641560 | mon1 | changed: [mon1]
2026-05-28 02:33:59.641665 | mon1 |
2026-05-28 02:33:59.641686 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:33:59.645193 | mon1 | Thursday 28 May 2026  02:33:59 +0000 (0:00:01.032)       0:00:25.138 **********
2026-05-28 02:34:04.221477 | mon1 | changed: [mon1]
2026-05-28 02:34:04.221540 | mon1 |
2026-05-28 02:34:04.221651 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:34:04.221766 | mon1 | Thursday 28 May 2026  02:34:04 +0000 (0:00:04.580)       0:00:29.719 **********
2026-05-28 02:34:05.225570 | mon1 | ok: [mon1]
2026-05-28 02:34:05.225646 | mon1 |
2026-05-28 02:34:05.225660 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:34:05.225674 | mon1 | Thursday 28 May 2026  02:34:05 +0000 (0:00:01.002)       0:00:30.722 **********
2026-05-28 02:34:05.623543 | mon1 | changed: [mon1]
2026-05-28 02:34:05.623602 | mon1 |
2026-05-28 02:34:05.623616 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:34:05.623628 | mon1 | Thursday 28 May 2026  02:34:05 +0000 (0:00:00.398)       0:00:31.120 **********
2026-05-28 02:34:06.192535 | mon1 | changed: [mon1]
2026-05-28 02:34:06.192584 | mon1 |
2026-05-28 02:34:06.192597 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:34:06.192609 | mon1 | Thursday 28 May 2026  02:34:06 +0000 (0:00:00.569)       0:00:31.689 **********
2026-05-28 02:34:06.895169 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:34:06.895235 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:34:06.896111 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:34:06.896174 | mon1 |
2026-05-28 02:34:06.896189 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:34:06.896202 | mon1 | Thursday 28 May 2026  02:34:06 +0000 (0:00:00.703)       0:00:32.392 **********
2026-05-28 02:34:07.439773 | mon1 | changed: [mon1]
2026-05-28 02:34:07.439811 | mon1 |
2026-05-28 02:34:07.439818 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:34:07.439824 | mon1 | Thursday 28 May 2026  02:34:07 +0000 (0:00:00.543)       0:00:32.935 **********
2026-05-28 02:34:08.022169 | mon1 | changed: [mon1]
2026-05-28 02:34:08.022534 | mon1 |
2026-05-28 02:34:08.023896 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:34:08.023928 | mon1 | Thursday 28 May 2026  02:34:08 +0000 (0:00:00.575)       0:00:33.511 **********
2026-05-28 02:34:08.023942 | mon1 |
2026-05-28 02:34:08.023956 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:34:08.023968 | mon1 | Thursday 28 May 2026  02:34:08 +0000 (0:00:00.007)       0:00:33.518 **********
2026-05-28 02:34:08.909232 | mon1 | ok: [mon1]
2026-05-28 02:34:08.909310 | mon1 |
2026-05-28 02:34:08.909318 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-28 02:34:08.909324 | mon1 | Thursday 28 May 2026  02:34:08 +0000 (0:00:00.887)       0:00:34.405 **********
2026-05-28 02:34:11.421574 | mon1 | changed: [mon1]
2026-05-28 02:34:11.421652 | mon1 |
2026-05-28 02:34:11.421720 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:34:11.421830 | mon1 | Thursday 28 May 2026  02:34:11 +0000 (0:00:02.513)       0:00:36.919 **********
2026-05-28 02:34:12.117202 | mon1 | changed: [mon1]
2026-05-28 02:34:12.117240 | mon1 |
2026-05-28 02:34:12.117253 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:34:12.117266 | mon1 | Thursday 28 May 2026  02:34:12 +0000 (0:00:00.694)       0:00:37.613 **********
2026-05-28 02:34:12.173495 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-28 02:34:12.173530 | mon1 |
2026-05-28 02:34:12.173539 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:34:12.173805 | mon1 | Thursday 28 May 2026  02:34:12 +0000 (0:00:00.056)       0:00:37.669 **********
2026-05-28 02:34:31.148373 | mon1 | changed: [mon1]
2026-05-28 02:34:31.148442 | mon1 |
2026-05-28 02:34:31.148456 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:34:31.148469 | mon1 | Thursday 28 May 2026  02:34:31 +0000 (0:00:18.974)       0:00:56.644 **********
2026-05-28 02:34:31.983964 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-05-28 02:34:31.984057 | mon1 | ok: [mon1] => (item=ssh)
2026-05-28 02:34:31.984077 | mon1 |
2026-05-28 02:34:31.984090 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:34:31.984104 | mon1 | Thursday 28 May 2026  02:34:31 +0000 (0:00:00.835)       0:00:57.479 **********
2026-05-28 02:34:32.362456 | mon1 | changed: [mon1]
2026-05-28 02:34:32.362486 | mon1 |
2026-05-28 02:34:32.362492 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:34:32.362654 | mon1 | Thursday 28 May 2026  02:34:32 +0000 (0:00:00.379)       0:00:57.859 **********
2026-05-28 02:34:32.600555 | mon1 | ok: [mon1]
2026-05-28 02:34:32.600604 | mon1 |
2026-05-28 02:34:32.600618 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:34:32.600630 | mon1 | Thursday 28 May 2026  02:34:32 +0000 (0:00:00.237)       0:00:58.096 **********
2026-05-28 02:34:33.119480 | mon1 | changed: [mon1]
2026-05-28 02:34:33.119547 | mon1 |
2026-05-28 02:34:33.119650 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:34:33.119776 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.519)       0:00:58.616 **********
2026-05-28 02:34:33.495166 | mon1 | changed: [mon1]
2026-05-28 02:34:33.495218 | mon1 |
2026-05-28 02:34:33.495246 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-28 02:34:33.495254 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.375)       0:00:58.992 **********
2026-05-28 02:34:33.623000 | mon1 | ok: [mon1]
2026-05-28 02:34:33.623068 | mon1 |
2026-05-28 02:34:33.623077 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-28 02:34:33.623085 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.127)       0:00:59.120 **********
2026-05-28 02:34:33.870476 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:34:33.870549 | mon1 |
2026-05-28 02:34:33.870658 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-28 02:34:33.870790 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.247)       0:00:59.367 **********
2026-05-28 02:34:33.916750 | mon1 | ok: [mon1]
2026-05-28 02:34:33.916784 | mon1 |
2026-05-28 02:34:33.916790 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-28 02:34:33.916796 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.045)       0:00:59.413 **********
2026-05-28 02:34:33.996896 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-05-28 02:34:33.997908 | mon1 |
2026-05-28 02:34:33.997938 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-05-28 02:34:33.997948 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.080)       0:00:59.494 **********
2026-05-28 02:34:34.314539 | mon1 | changed: [mon1]
2026-05-28 02:34:34.314587 | mon1 |
2026-05-28 02:34:34.314597 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-05-28 02:34:34.314607 | mon1 | Thursday 28 May 2026  02:34:34 +0000 (0:00:00.316)       0:00:59.810 **********
2026-05-28 02:34:35.070227 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-05-28 02:34:35.070284 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-05-28 02:34:35.070295 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-05-28 02:34:35.070305 | mon1 |
2026-05-28 02:34:35.070315 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-05-28 02:34:35.070326 | mon1 | Thursday 28 May 2026  02:34:35 +0000 (0:00:00.755)       0:01:00.566 **********
2026-05-28 02:36:26.727649 | mon1 | ok: [mon1]
2026-05-28 02:36:26.727739 | mon1 |
2026-05-28 02:36:26.727918 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-05-28 02:36:26.728213 | mon1 | Thursday 28 May 2026  02:36:26 +0000 (0:01:51.658)       0:02:52.224 **********
2026-05-28 02:36:26.995158 | mon1 | changed: [mon1]
2026-05-28 02:36:26.995211 | mon1 |
2026-05-28 02:36:26.995230 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-05-28 02:36:26.995594 | mon1 | Thursday 28 May 2026  02:36:26 +0000 (0:00:00.267)       0:02:52.492 **********
2026-05-28 02:36:27.036464 | mon1 | ok: [mon1]
2026-05-28 02:36:27.036703 | mon1 |
2026-05-28 02:36:27.037113 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:36:27.037310 | mon1 | Thursday 28 May 2026  02:36:27 +0000 (0:00:00.041)       0:02:52.534 **********
2026-05-28 02:36:27.119366 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:36:27.119499 | mon1 |
2026-05-28 02:36:27.119846 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:36:27.120102 | mon1 | Thursday 28 May 2026  02:36:27 +0000 (0:00:00.082)       0:02:52.616 **********
2026-05-28 02:36:33.566850 | mon1 | ok: [mon1]
2026-05-28 02:36:33.566958 | mon1 |
2026-05-28 02:36:33.567175 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:36:33.567342 | mon1 | Thursday 28 May 2026  02:36:33 +0000 (0:00:06.447)       0:02:59.064 **********
2026-05-28 02:36:33.628525 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:36:33.628689 | mon1 |
2026-05-28 02:36:33.628963 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:36:33.629260 | mon1 | Thursday 28 May 2026  02:36:33 +0000 (0:00:00.061)       0:02:59.125 **********
2026-05-28 02:36:34.095061 | mon1 | ok: [mon1]
2026-05-28 02:36:34.095097 | mon1 |
2026-05-28 02:36:34.095104 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:36:34.095195 | mon1 | Thursday 28 May 2026  02:36:34 +0000 (0:00:00.466)       0:02:59.591 **********
2026-05-28 02:36:41.131534 | mon1 | ok: [mon1]
2026-05-28 02:36:41.131726 | mon1 |
2026-05-28 02:36:41.131984 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-28 02:36:41.132260 | mon1 | Thursday 28 May 2026  02:36:41 +0000 (0:00:07.037)       0:03:06.629 **********
2026-05-28 02:36:54.257224 | mon1 | changed: [mon1]
2026-05-28 02:36:54.257293 | mon1 |
2026-05-28 02:36:54.257307 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-28 02:36:54.257327 | mon1 | Thursday 28 May 2026  02:36:54 +0000 (0:00:13.124)       0:03:19.754 **********
2026-05-28 02:37:08.773795 | mon1 | ok: [mon1]
2026-05-28 02:37:08.773884 | mon1 |
2026-05-28 02:37:08.773899 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:37:08.773913 | mon1 | Thursday 28 May 2026  02:37:08 +0000 (0:00:14.515)       0:03:34.270 **********
2026-05-28 02:37:08.848482 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:37:08.848518 | mon1 |
2026-05-28 02:37:08.848529 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:37:08.848538 | mon1 | Thursday 28 May 2026  02:37:08 +0000 (0:00:00.074)       0:03:34.344 **********
2026-05-28 02:37:08.896157 | mon1 | skipping: [mon1]
2026-05-28 02:37:08.896226 | mon1 |
2026-05-28 02:37:08.896239 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:37:08.896250 | mon1 | Thursday 28 May 2026  02:37:08 +0000 (0:00:00.046)       0:03:34.391 **********
2026-05-28 02:37:08.954298 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-28 02:37:08.954379 | mon1 | skipping: [mon1]
2026-05-28 02:37:08.954390 | mon1 |
2026-05-28 02:37:08.954400 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:37:08.954410 | mon1 | Thursday 28 May 2026  02:37:08 +0000 (0:00:00.058)       0:03:34.450 **********
2026-05-28 02:37:09.288472 | mon1 | ok: [mon1]
2026-05-28 02:37:09.288585 | mon1 |
2026-05-28 02:37:09.288596 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:37:09.288606 | mon1 | Thursday 28 May 2026  02:37:09 +0000 (0:00:00.334)       0:03:34.785 **********
2026-05-28 02:37:16.267104 | mon1 | ok: [mon1]
2026-05-28 02:37:16.267163 | mon1 |
2026-05-28 02:37:16.267483 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-28 02:37:16.267806 | mon1 | Thursday 28 May 2026  02:37:16 +0000 (0:00:06.979)       0:03:41.764 **********
2026-05-28 02:37:28.757558 | mon1 | changed: [mon1]
2026-05-28 02:37:28.757758 | mon1 |
2026-05-28 02:37:28.759105 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-28 02:37:28.759140 | mon1 | Thursday 28 May 2026  02:37:28 +0000 (0:00:12.489)       0:03:54.254 **********
2026-05-28 02:37:35.182974 | mon1 | ok: [mon1]
2026-05-28 02:37:35.183090 | mon1 |
2026-05-28 02:37:35.183108 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-28 02:37:35.183121 | mon1 | Thursday 28 May 2026  02:37:35 +0000 (0:00:06.425)       0:04:00.679 **********
2026-05-28 02:37:41.955984 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-28 02:37:41.956037 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-28 02:37:41.956045 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-05-28 02:37:41.956050 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-28 02:37:41.956055 | mon1 |
2026-05-28 02:37:41.956061 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-28 02:37:41.956067 | mon1 |
2026-05-28 02:37:41.956072 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:37:41.956077 | mon1 | Thursday 28 May 2026  02:37:41 +0000 (0:00:06.770)       0:04:07.450 **********
2026-05-28 02:37:43.196594 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-28 02:37:43.198508 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:37:43.198809 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:37:43.202672 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:37:43.202700 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:37:43.212319 | mon1 | ok: [osd1]
2026-05-28 02:37:43.212357 | mon1 |
2026-05-28 02:37:43.212363 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:37:43.212369 | mon1 | Thursday 28 May 2026  02:37:43 +0000 (0:00:01.259)       0:04:08.709 **********
2026-05-28 02:37:43.467420 | mon1 | ok: [osd1]
2026-05-28 02:37:43.467585 | mon1 |
2026-05-28 02:37:43.470165 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:37:43.470347 | mon1 | Thursday 28 May 2026  02:37:43 +0000 (0:00:00.254)       0:04:08.964 **********
2026-05-28 02:37:43.510596 | mon1 | skipping: [osd1]
2026-05-28 02:37:43.510615 | mon1 |
2026-05-28 02:37:43.510621 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:37:43.510638 | mon1 | Thursday 28 May 2026  02:37:43 +0000 (0:00:00.041)       0:04:09.005 **********
2026-05-28 02:37:43.756291 | mon1 | changed: [osd1]
2026-05-28 02:37:43.756464 | mon1 |
2026-05-28 02:37:43.756633 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:37:43.756776 | mon1 | Thursday 28 May 2026  02:37:43 +0000 (0:00:00.248)       0:04:09.254 **********
2026-05-28 02:37:43.819781 | mon1 | ok: [osd1] => {
2026-05-28 02:37:43.820006 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:37:43.821173 | mon1 | }
2026-05-28 02:37:43.821308 | mon1 |
2026-05-28 02:37:43.821448 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:37:43.821586 | mon1 | Thursday 28 May 2026  02:37:43 +0000 (0:00:00.063)       0:04:09.317 **********
2026-05-28 02:37:44.573895 | mon1 | changed: [osd1]
2026-05-28 02:37:44.574088 | mon1 |
2026-05-28 02:37:44.576887 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:37:44.576900 | mon1 | Thursday 28 May 2026  02:37:44 +0000 (0:00:00.754)       0:04:10.072 **********
2026-05-28 02:37:44.622217 | mon1 | skipping: [osd1]
2026-05-28 02:37:44.622404 | mon1 |
2026-05-28 02:37:44.622553 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:37:44.622695 | mon1 | Thursday 28 May 2026  02:37:44 +0000 (0:00:00.048)       0:04:10.120 **********
2026-05-28 02:37:44.669797 | mon1 | skipping: [osd1]
2026-05-28 02:37:44.672412 | mon1 |
2026-05-28 02:37:44.672426 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:37:44.672430 | mon1 | Thursday 28 May 2026  02:37:44 +0000 (0:00:00.047)       0:04:10.168 **********
2026-05-28 02:37:44.926058 | mon1 | ok: [osd1]
2026-05-28 02:37:44.927170 | mon1 |
2026-05-28 02:37:44.927321 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:37:44.927461 | mon1 | Thursday 28 May 2026  02:37:44 +0000 (0:00:00.256)       0:04:10.424 **********
2026-05-28 02:37:46.081154 | mon1 | ok: [osd1]
2026-05-28 02:37:46.083422 | mon1 |
2026-05-28 02:37:46.083435 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:37:46.083441 | mon1 | Thursday 28 May 2026  02:37:46 +0000 (0:00:01.154)       0:04:11.578 **********
2026-05-28 02:37:46.169856 | mon1 | ok: [osd1] => {
2026-05-28 02:37:46.169876 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:37:46.169881 | mon1 | }
2026-05-28 02:37:46.169886 | mon1 |
2026-05-28 02:37:46.169899 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:37:46.169904 | mon1 | Thursday 28 May 2026  02:37:46 +0000 (0:00:00.086)       0:04:11.665 **********
2026-05-28 02:37:47.075401 | mon1 | changed: [osd1]
2026-05-28 02:37:47.075579 | mon1 |
2026-05-28 02:37:47.075724 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:37:47.075865 | mon1 | Thursday 28 May 2026  02:37:47 +0000 (0:00:00.906)       0:04:12.571 **********
2026-05-28 02:37:50.016477 | mon1 | changed: [osd1]
2026-05-28 02:37:50.016581 | mon1 |
2026-05-28 02:37:50.016593 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:37:50.016603 | mon1 | Thursday 28 May 2026  02:37:50 +0000 (0:00:02.942)       0:04:15.514 **********
2026-05-28 02:37:50.053300 | mon1 | skipping: [osd1]
2026-05-28 02:37:50.053393 | mon1 |
2026-05-28 02:37:50.053510 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:37:50.053623 | mon1 | Thursday 28 May 2026  02:37:50 +0000 (0:00:00.035)       0:04:15.549 **********
2026-05-28 02:37:50.084208 | mon1 | skipping: [osd1]
2026-05-28 02:37:50.084305 | mon1 |
2026-05-28 02:37:50.084421 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:37:50.084534 | mon1 | Thursday 28 May 2026  02:37:50 +0000 (0:00:00.032)       0:04:15.582 **********
2026-05-28 02:37:50.116563 | mon1 | skipping: [osd1]
2026-05-28 02:37:50.116634 | mon1 |
2026-05-28 02:37:50.116757 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:37:50.116869 | mon1 | Thursday 28 May 2026  02:37:50 +0000 (0:00:00.032)       0:04:15.614 **********
2026-05-28 02:37:58.439445 | mon1 | changed: [osd1]
2026-05-28 02:37:58.439582 | mon1 |
2026-05-28 02:37:58.439868 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:37:58.440156 | mon1 | Thursday 28 May 2026  02:37:58 +0000 (0:00:08.322)       0:04:23.937 **********
2026-05-28 02:37:59.034863 | mon1 | changed: [osd1]
2026-05-28 02:37:59.034993 | mon1 |
2026-05-28 02:37:59.035328 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:37:59.035573 | mon1 | Thursday 28 May 2026  02:37:59 +0000 (0:00:00.595)       0:04:24.532 **********
2026-05-28 02:38:00.195262 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-05-28 02:38:00.195327 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:38:00.195567 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:38:00.195847 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:38:00.196237 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:38:00.196470 | mon1 |
2026-05-28 02:38:00.196762 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:38:00.197065 | mon1 | Thursday 28 May 2026  02:38:00 +0000 (0:00:01.159)       0:04:25.692 **********
2026-05-28 02:38:00.922592 | mon1 | changed: [osd1]
2026-05-28 02:38:00.922783 | mon1 |
2026-05-28 02:38:00.923062 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:38:00.923326 | mon1 | Thursday 28 May 2026  02:38:00 +0000 (0:00:00.720)       0:04:26.413 **********
2026-05-28 02:38:00.923544 | mon1 |
2026-05-28 02:38:00.923817 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:38:00.924100 | mon1 | Thursday 28 May 2026  02:38:00 +0000 (0:00:00.007)       0:04:26.420 **********
2026-05-28 02:38:01.802295 | mon1 | ok: [osd1]
2026-05-28 02:38:01.802363 | mon1 |
2026-05-28 02:38:01.802375 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-28 02:38:01.802396 | mon1 | Thursday 28 May 2026  02:38:01 +0000 (0:00:00.878)       0:04:27.298 **********
2026-05-28 02:38:02.412057 | mon1 | changed: [osd1]
2026-05-28 02:38:02.412152 | mon1 |
2026-05-28 02:38:02.412163 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:38:02.412174 | mon1 | Thursday 28 May 2026  02:38:02 +0000 (0:00:00.608)       0:04:27.907 **********
2026-05-28 02:38:03.129531 | mon1 | changed: [osd1]
2026-05-28 02:38:03.129587 | mon1 |
2026-05-28 02:38:03.129597 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:38:03.129607 | mon1 | Thursday 28 May 2026  02:38:03 +0000 (0:00:00.718)       0:04:28.625 **********
2026-05-28 02:38:03.391998 | mon1 | ok: [osd1]
2026-05-28 02:38:03.392106 | mon1 |
2026-05-28 02:38:03.392118 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:38:03.392128 | mon1 | Thursday 28 May 2026  02:38:03 +0000 (0:00:00.262)       0:04:28.888 **********
2026-05-28 02:38:03.458246 | mon1 | ok: [osd1] => {
2026-05-28 02:38:03.458378 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:38:03.459449 | mon1 | }
2026-05-28 02:38:03.459516 | mon1 |
2026-05-28 02:38:03.459541 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:38:03.459552 | mon1 | Thursday 28 May 2026  02:38:03 +0000 (0:00:00.066)       0:04:28.955 **********
2026-05-28 02:38:04.442691 | mon1 | changed: [osd1]
2026-05-28 02:38:04.442742 | mon1 |
2026-05-28 02:38:04.442753 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:38:04.442762 | mon1 | Thursday 28 May 2026  02:38:04 +0000 (0:00:00.983)       0:04:29.938 **********
2026-05-28 02:38:08.990172 | mon1 | changed: [osd1]
2026-05-28 02:38:08.990248 | mon1 |
2026-05-28 02:38:08.990265 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:38:08.990548 | mon1 | Thursday 28 May 2026  02:38:08 +0000 (0:00:04.548)       0:04:34.487 **********
2026-05-28 02:38:09.946827 | mon1 | ok: [osd1]
2026-05-28 02:38:09.946983 | mon1 |
2026-05-28 02:38:09.947289 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:38:09.947529 | mon1 | Thursday 28 May 2026  02:38:09 +0000 (0:00:00.956)       0:04:35.444 **********
2026-05-28 02:38:10.255935 | mon1 | changed: [osd1]
2026-05-28 02:38:10.256138 | mon1 |
2026-05-28 02:38:10.256453 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:38:10.256658 | mon1 | Thursday 28 May 2026  02:38:10 +0000 (0:00:00.308)       0:04:35.752 **********
2026-05-28 02:38:10.857871 | mon1 | changed: [osd1]
2026-05-28 02:38:10.858055 | mon1 |
2026-05-28 02:38:10.858516 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:38:10.858790 | mon1 | Thursday 28 May 2026  02:38:10 +0000 (0:00:00.602)       0:04:36.355 **********
2026-05-28 02:38:11.601213 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-05-28 02:38:11.602635 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:38:11.602692 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:38:11.602702 | mon1 |
2026-05-28 02:38:11.602711 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:38:11.602720 | mon1 | Thursday 28 May 2026  02:38:11 +0000 (0:00:00.743)       0:04:37.098 **********
2026-05-28 02:38:12.183200 | mon1 | changed: [osd1]
2026-05-28 02:38:12.183270 | mon1 |
2026-05-28 02:38:12.183282 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:38:12.183299 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:00.581)       0:04:37.680 **********
2026-05-28 02:38:12.754133 | mon1 | changed: [osd1]
2026-05-28 02:38:12.754422 | mon1 |
2026-05-28 02:38:12.754671 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:38:12.754912 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:00.565)       0:04:38.245 **********
2026-05-28 02:38:12.755161 | mon1 |
2026-05-28 02:38:12.755419 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:38:12.755697 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:00.006)       0:04:38.251 **********
2026-05-28 02:38:13.663103 | mon1 | ok: [osd1]
2026-05-28 02:38:13.663285 | mon1 |
2026-05-28 02:38:13.663602 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-28 02:38:13.663783 | mon1 | Thursday 28 May 2026  02:38:13 +0000 (0:00:00.908)       0:04:39.160 **********
2026-05-28 02:38:15.237233 | mon1 | changed: [osd1]
2026-05-28 02:38:15.237310 | mon1 |
2026-05-28 02:38:15.237331 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:38:15.237628 | mon1 | Thursday 28 May 2026  02:38:15 +0000 (0:00:01.573)       0:04:40.734 **********
2026-05-28 02:38:15.948637 | mon1 | changed: [osd1]
2026-05-28 02:38:15.948696 | mon1 |
2026-05-28 02:38:15.948709 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:38:15.948722 | mon1 | Thursday 28 May 2026  02:38:15 +0000 (0:00:00.710)       0:04:41.444 **********
2026-05-28 02:38:16.009313 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-28 02:38:16.009346 | mon1 |
2026-05-28 02:38:16.009358 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:38:16.009370 | mon1 | Thursday 28 May 2026  02:38:16 +0000 (0:00:00.061)       0:04:41.506 **********
2026-05-28 02:38:17.171827 | mon1 | ok: [osd1]
2026-05-28 02:38:17.171890 | mon1 |
2026-05-28 02:38:17.171903 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:38:17.171915 | mon1 | Thursday 28 May 2026  02:38:17 +0000 (0:00:01.161)       0:04:42.668 **********
2026-05-28 02:38:18.029741 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-05-28 02:38:18.029827 | mon1 | ok: [osd1] => (item=ssh)
2026-05-28 02:38:18.029838 | mon1 |
2026-05-28 02:38:18.029848 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:38:18.029857 | mon1 | Thursday 28 May 2026  02:38:18 +0000 (0:00:00.857)       0:04:43.525 **********
2026-05-28 02:38:18.461715 | mon1 | changed: [osd1]
2026-05-28 02:38:18.461774 | mon1 |
2026-05-28 02:38:18.461784 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:38:18.461794 | mon1 | Thursday 28 May 2026  02:38:18 +0000 (0:00:00.432)       0:04:43.957 **********
2026-05-28 02:38:18.713546 | mon1 | ok: [osd1]
2026-05-28 02:38:18.713592 | mon1 |
2026-05-28 02:38:18.713603 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:38:18.713612 | mon1 | Thursday 28 May 2026  02:38:18 +0000 (0:00:00.252)       0:04:44.210 **********
2026-05-28 02:38:19.139564 | mon1 | changed: [osd1]
2026-05-28 02:38:19.139641 | mon1 |
2026-05-28 02:38:19.139814 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:38:19.139991 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:00.426)       0:04:44.636 **********
2026-05-28 02:38:19.408718 | mon1 | changed: [osd1]
2026-05-28 02:38:19.408764 | mon1 |
2026-05-28 02:38:19.408774 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-28 02:38:19.408784 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:00.268)       0:04:44.904 **********
2026-05-28 02:38:19.728954 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-28 02:38:19.729001 | mon1 |
2026-05-28 02:38:19.729012 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-28 02:38:19.729053 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:00.320)       0:04:45.225 **********
2026-05-28 02:38:19.791186 | mon1 | ok: [osd1]
2026-05-28 02:38:19.791236 | mon1 |
2026-05-28 02:38:19.791515 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:38:19.791871 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:00.063)       0:04:45.288 **********
2026-05-28 02:38:19.863141 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-28 02:38:19.863359 | mon1 |
2026-05-28 02:38:19.863609 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:38:19.863954 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:00.072)       0:04:45.361 **********
2026-05-28 02:38:26.275232 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:38:26.275311 | mon1 |
2026-05-28 02:38:26.275834 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:38:26.275901 | mon1 | Thursday 28 May 2026  02:38:26 +0000 (0:00:06.411)       0:04:51.772 **********
2026-05-28 02:38:26.330691 | mon1 | ok: [osd1] => (item=osd1)
2026-05-28 02:38:26.330785 | mon1 |
2026-05-28 02:38:26.330943 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:38:26.331057 | mon1 | Thursday 28 May 2026  02:38:26 +0000 (0:00:00.054)       0:04:51.827 **********
2026-05-28 02:38:26.671942 | mon1 | changed: [osd1]
2026-05-28 02:38:26.672076 | mon1 |
2026-05-28 02:38:26.672358 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:38:26.672407 | mon1 | Thursday 28 May 2026  02:38:26 +0000 (0:00:00.342)       0:04:52.169 **********
2026-05-28 02:38:36.425536 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:38:36.425641 | mon1 |
2026-05-28 02:38:36.425656 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-28 02:38:36.425775 | mon1 | Thursday 28 May 2026  02:38:36 +0000 (0:00:09.753)       0:05:01.923 **********
2026-05-28 02:38:38.118603 | mon1 | ok: [osd1]
2026-05-28 02:38:38.118743 | mon1 |
2026-05-28 02:38:38.118891 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-28 02:38:38.119046 | mon1 | Thursday 28 May 2026  02:38:38 +0000 (0:00:01.692)       0:05:03.615 **********
2026-05-28 02:39:28.610195 | mon1 | ok: [osd1]
2026-05-28 02:39:28.610292 | mon1 |
2026-05-28 02:39:28.610825 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-28 02:39:28.610930 | mon1 | Thursday 28 May 2026  02:39:28 +0000 (0:00:50.491)       0:05:54.106 **********
2026-05-28 02:41:20.819495 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-05-28 02:41:20.819566 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-05-28 02:41:20.819580 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-05-28 02:41:20.819592 | mon1 |
2026-05-28 02:41:20.819605 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-28 02:41:20.819619 | mon1 | Thursday 28 May 2026  02:41:20 +0000 (0:01:52.208)       0:07:46.315 **********
2026-05-28 02:41:27.269293 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:41:27.269402 | mon1 |
2026-05-28 02:41:27.269425 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-28 02:41:27.270125 | mon1 | Thursday 28 May 2026  02:41:27 +0000 (0:00:06.450)       0:07:52.765 **********
2026-05-28 02:41:33.610674 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:41:33.610869 | mon1 |
2026-05-28 02:41:33.611229 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-28 02:41:33.611533 | mon1 | Thursday 28 May 2026  02:41:33 +0000 (0:00:06.342)       0:07:59.108 **********
2026-05-28 02:41:33.677504 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-28 02:41:33.677711 | mon1 |
2026-05-28 02:41:33.677955 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-28 02:41:33.678258 | mon1 | Thursday 28 May 2026  02:41:33 +0000 (0:00:00.067)       0:07:59.175 **********
2026-05-28 02:41:33.725283 | mon1 | ok: [osd1]
2026-05-28 02:41:33.725492 | mon1 |
2026-05-28 02:41:33.725744 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-28 02:41:33.725992 | mon1 | Thursday 28 May 2026  02:41:33 +0000 (0:00:00.047)       0:07:59.223 **********
2026-05-28 02:41:40.151225 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:41:40.151309 | mon1 |
2026-05-28 02:41:40.151316 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-28 02:41:40.151500 | mon1 | Thursday 28 May 2026  02:41:40 +0000 (0:00:06.424)       0:08:05.648 **********
2026-05-28 02:41:40.201896 | mon1 | ok: [osd1]
2026-05-28 02:41:40.201957 | mon1 |
2026-05-28 02:41:40.201971 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-28 02:41:40.201985 | mon1 | Thursday 28 May 2026  02:41:40 +0000 (0:00:00.050)       0:08:05.698 **********
2026-05-28 02:41:40.249079 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:41:40.249117 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:41:40.249130 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:41:40.249141 | mon1 | skipping: [osd1]
2026-05-28 02:41:40.249154 | mon1 |
2026-05-28 02:41:40.249166 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-28 02:41:40.249182 | mon1 | Thursday 28 May 2026  02:41:40 +0000 (0:00:00.046)       0:08:05.744 **********
2026-05-28 02:41:40.316866 | mon1 | skipping: [osd1]
2026-05-28 02:41:40.316905 | mon1 |
2026-05-28 02:41:40.316931 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-05-28 02:41:40.316944 | mon1 |
2026-05-28 02:41:40.316956 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:41:40.316968 | mon1 | Thursday 28 May 2026  02:41:40 +0000 (0:00:00.068)       0:08:05.813 **********
2026-05-28 02:41:41.300286 | mon1 | ok: [mon1]
2026-05-28 02:41:41.300354 | mon1 |
2026-05-28 02:41:41.300364 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:41:41.300372 | mon1 | Thursday 28 May 2026  02:41:41 +0000 (0:00:00.983)       0:08:06.796 **********
2026-05-28 02:41:41.581552 | mon1 | ok: [mon1]
2026-05-28 02:41:41.581618 | mon1 |
2026-05-28 02:41:41.581632 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:41:41.581665 | mon1 | Thursday 28 May 2026  02:41:41 +0000 (0:00:00.281)       0:08:07.078 **********
2026-05-28 02:41:41.628672 | mon1 | skipping: [mon1]
2026-05-28 02:41:41.628737 | mon1 |
2026-05-28 02:41:41.628874 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:41:41.628986 | mon1 | Thursday 28 May 2026  02:41:41 +0000 (0:00:00.047)       0:08:07.125 **********
2026-05-28 02:41:41.890171 | mon1 | ok: [mon1]
2026-05-28 02:41:41.890231 | mon1 |
2026-05-28 02:41:41.890557 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:41:41.890581 | mon1 | Thursday 28 May 2026  02:41:41 +0000 (0:00:00.261)       0:08:07.387 **********
2026-05-28 02:41:41.957855 | mon1 | ok: [mon1] => {
2026-05-28 02:41:41.957894 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:41:41.957908 | mon1 | }
2026-05-28 02:41:41.957920 | mon1 |
2026-05-28 02:41:41.957932 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:41:41.957944 | mon1 | Thursday 28 May 2026  02:41:41 +0000 (0:00:00.067)       0:08:07.454 **********
2026-05-28 02:41:42.330068 | mon1 | ok: [mon1]
2026-05-28 02:41:42.330111 | mon1 |
2026-05-28 02:41:42.330117 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:41:42.330122 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.372)       0:08:07.827 **********
2026-05-28 02:41:42.377429 | mon1 | skipping: [mon1]
2026-05-28 02:41:42.377532 | mon1 |
2026-05-28 02:41:42.377648 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:41:42.377758 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.047)       0:08:07.874 **********
2026-05-28 02:41:42.424740 | mon1 | skipping: [mon1]
2026-05-28 02:41:42.424814 | mon1 |
2026-05-28 02:41:42.424825 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:41:42.424835 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.046)       0:08:07.921 **********
2026-05-28 02:41:42.680873 | mon1 | ok: [mon1]
2026-05-28 02:41:42.680959 | mon1 |
2026-05-28 02:41:42.680969 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:41:42.680979 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.255)       0:08:08.177 **********
2026-05-28 02:41:43.875609 | mon1 | ok: [mon1]
2026-05-28 02:41:43.875688 | mon1 |
2026-05-28 02:41:43.875699 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:41:43.875932 | mon1 | Thursday 28 May 2026  02:41:43 +0000 (0:00:01.192)       0:08:09.369 **********
2026-05-28 02:41:43.962997 | mon1 | ok: [mon1] => {
2026-05-28 02:41:43.963060 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:41:43.963075 | mon1 | }
2026-05-28 02:41:43.963085 | mon1 |
2026-05-28 02:41:43.963094 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:41:43.963103 | mon1 | Thursday 28 May 2026  02:41:43 +0000 (0:00:00.088)       0:08:09.458 **********
2026-05-28 02:41:44.391163 | mon1 | ok: [mon1]
2026-05-28 02:41:44.391250 | mon1 |
2026-05-28 02:41:44.391687 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:41:44.391743 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.429)       0:08:09.887 **********
2026-05-28 02:41:46.632587 | mon1 | ok: [mon1]
2026-05-28 02:41:46.632664 | mon1 |
2026-05-28 02:41:46.632675 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:41:46.632685 | mon1 | Thursday 28 May 2026  02:41:46 +0000 (0:00:02.240)       0:08:12.128 **********
2026-05-28 02:41:46.662478 | mon1 | skipping: [mon1]
2026-05-28 02:41:46.662511 | mon1 |
2026-05-28 02:41:46.662521 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:41:46.662530 | mon1 | Thursday 28 May 2026  02:41:46 +0000 (0:00:00.031)       0:08:12.159 **********
2026-05-28 02:41:46.698444 | mon1 | skipping: [mon1]
2026-05-28 02:41:46.698479 | mon1 |
2026-05-28 02:41:46.698489 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:41:46.698523 | mon1 | Thursday 28 May 2026  02:41:46 +0000 (0:00:00.036)       0:08:12.195 **********
2026-05-28 02:41:46.734602 | mon1 | skipping: [mon1]
2026-05-28 02:41:46.734692 | mon1 |
2026-05-28 02:41:46.734709 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:41:46.734873 | mon1 | Thursday 28 May 2026  02:41:46 +0000 (0:00:00.035)       0:08:12.231 **********
2026-05-28 02:41:47.862773 | mon1 | ok: [mon1]
2026-05-28 02:41:47.862873 | mon1 |
2026-05-28 02:41:47.862942 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:41:47.863122 | mon1 | Thursday 28 May 2026  02:41:47 +0000 (0:00:01.127)       0:08:13.359 **********
2026-05-28 02:41:48.420624 | mon1 | ok: [mon1]
2026-05-28 02:41:48.420705 | mon1 |
2026-05-28 02:41:48.420721 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:41:48.420864 | mon1 | Thursday 28 May 2026  02:41:48 +0000 (0:00:00.558)       0:08:13.917 **********
2026-05-28 02:41:49.621477 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:41:49.621521 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:41:49.621528 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:41:49.621534 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:41:49.621540 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:41:49.621546 | mon1 |
2026-05-28 02:41:49.621555 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:41:49.621825 | mon1 | Thursday 28 May 2026  02:41:49 +0000 (0:00:01.199)       0:08:15.117 **********
2026-05-28 02:41:50.278201 | mon1 | ok: [mon1]
2026-05-28 02:41:50.278262 | mon1 |
2026-05-28 02:41:50.278273 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:41:50.278283 | mon1 | Thursday 28 May 2026  02:41:50 +0000 (0:00:00.649)       0:08:15.766 **********
2026-05-28 02:41:50.278292 | mon1 |
2026-05-28 02:41:50.278300 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:41:50.278316 | mon1 | Thursday 28 May 2026  02:41:50 +0000 (0:00:00.005)       0:08:15.772 **********
2026-05-28 02:41:50.760176 | mon1 | ok: [mon1]
2026-05-28 02:41:50.760285 | mon1 |
2026-05-28 02:41:50.760906 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:41:50.760965 | mon1 | Thursday 28 May 2026  02:41:50 +0000 (0:00:00.484)       0:08:16.256 **********
2026-05-28 02:41:51.031640 | mon1 | ok: [mon1]
2026-05-28 02:41:51.031694 | mon1 |
2026-05-28 02:41:51.031705 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:41:51.031715 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.271)       0:08:16.528 **********
2026-05-28 02:41:51.099810 | mon1 | ok: [mon1] => {
2026-05-28 02:41:51.099839 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:41:51.099849 | mon1 | }
2026-05-28 02:41:51.099858 | mon1 |
2026-05-28 02:41:51.099867 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:41:51.099876 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.067)       0:08:16.595 **********
2026-05-28 02:41:51.556802 | mon1 | ok: [mon1]
2026-05-28 02:41:51.556866 | mon1 |
2026-05-28 02:41:51.556877 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:41:51.556888 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.457)       0:08:17.053 **********
2026-05-28 02:41:54.869212 | mon1 | ok: [mon1]
2026-05-28 02:41:54.869298 | mon1 |
2026-05-28 02:41:54.869317 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:41:54.869693 | mon1 | Thursday 28 May 2026  02:41:54 +0000 (0:00:03.313)       0:08:20.366 **********
2026-05-28 02:41:55.984742 | mon1 | ok: [mon1]
2026-05-28 02:41:55.984808 | mon1 |
2026-05-28 02:41:55.984819 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:41:55.984864 | mon1 | Thursday 28 May 2026  02:41:55 +0000 (0:00:01.114)       0:08:21.480 **********
2026-05-28 02:41:56.240147 | mon1 | ok: [mon1]
2026-05-28 02:41:56.240220 | mon1 |
2026-05-28 02:41:56.240237 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:41:56.240387 | mon1 | Thursday 28 May 2026  02:41:56 +0000 (0:00:00.255)       0:08:21.736 **********
2026-05-28 02:41:56.807628 | mon1 | ok: [mon1]
2026-05-28 02:41:56.807718 | mon1 |
2026-05-28 02:41:56.807770 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:41:56.807889 | mon1 | Thursday 28 May 2026  02:41:56 +0000 (0:00:00.568)       0:08:22.304 **********
2026-05-28 02:41:57.550533 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:41:57.550607 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:41:57.550732 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:41:57.550866 | mon1 |
2026-05-28 02:41:57.550992 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:41:57.551197 | mon1 | Thursday 28 May 2026  02:41:57 +0000 (0:00:00.743)       0:08:23.047 **********
2026-05-28 02:41:58.125712 | mon1 | ok: [mon1]
2026-05-28 02:41:58.125771 | mon1 |
2026-05-28 02:41:58.125782 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:41:58.125792 | mon1 | Thursday 28 May 2026  02:41:58 +0000 (0:00:00.574)       0:08:23.622 **********
2026-05-28 02:41:58.708175 | mon1 | ok: [mon1]
2026-05-28 02:41:58.708276 | mon1 |
2026-05-28 02:41:58.709203 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:41:58.709271 | mon1 | Thursday 28 May 2026  02:41:58 +0000 (0:00:00.575)       0:08:24.197 **********
2026-05-28 02:41:58.709282 | mon1 |
2026-05-28 02:41:58.709300 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:41:58.709649 | mon1 | Thursday 28 May 2026  02:41:58 +0000 (0:00:00.007)       0:08:24.204 **********
2026-05-28 02:41:59.194780 | mon1 | ok: [mon1]
2026-05-28 02:41:59.194966 | mon1 |
2026-05-28 02:41:59.195251 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:41:59.195497 | mon1 | Thursday 28 May 2026  02:41:59 +0000 (0:00:00.487)       0:08:24.692 **********
2026-05-28 02:41:59.252969 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-28 02:41:59.253313 | mon1 |
2026-05-28 02:41:59.253631 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:41:59.253932 | mon1 | Thursday 28 May 2026  02:41:59 +0000 (0:00:00.058)       0:08:24.750 **********
2026-05-28 02:42:00.450990 | mon1 | ok: [mon1]
2026-05-28 02:42:00.451192 | mon1 |
2026-05-28 02:42:00.451465 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:42:00.451739 | mon1 | Thursday 28 May 2026  02:42:00 +0000 (0:00:01.197)       0:08:25.948 **********
2026-05-28 02:42:01.315262 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-05-28 02:42:01.315465 | mon1 | ok: [mon1] => (item=ssh)
2026-05-28 02:42:01.315696 | mon1 |
2026-05-28 02:42:01.315977 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:42:01.316248 | mon1 | Thursday 28 May 2026  02:42:01 +0000 (0:00:00.864)       0:08:26.812 **********
2026-05-28 02:42:01.700592 | mon1 | ok: [mon1]
2026-05-28 02:42:01.700748 | mon1 |
2026-05-28 02:42:01.701086 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:42:01.701334 | mon1 | Thursday 28 May 2026  02:42:01 +0000 (0:00:00.385)       0:08:27.198 **********
2026-05-28 02:42:01.944674 | mon1 | ok: [mon1]
2026-05-28 02:42:01.944731 | mon1 |
2026-05-28 02:42:01.944738 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:42:01.944745 | mon1 | Thursday 28 May 2026  02:42:01 +0000 (0:00:00.242)       0:08:27.441 **********
2026-05-28 02:42:02.252012 | mon1 | ok: [mon1]
2026-05-28 02:42:02.252211 | mon1 |
2026-05-28 02:42:02.252482 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:42:02.252729 | mon1 | Thursday 28 May 2026  02:42:02 +0000 (0:00:00.308)       0:08:27.749 **********
2026-05-28 02:42:02.511070 | mon1 | ok: [mon1]
2026-05-28 02:42:02.511114 | mon1 |
2026-05-28 02:42:02.511125 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-05-28 02:42:02.511340 | mon1 | Thursday 28 May 2026  02:42:02 +0000 (0:00:00.258)       0:08:28.008 **********
2026-05-28 02:42:14.869833 | mon1 | changed: [mon1]
2026-05-28 02:42:14.869914 | mon1 |
2026-05-28 02:42:14.870071 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist] *************
2026-05-28 02:42:14.870191 | mon1 | Thursday 28 May 2026  02:42:14 +0000 (0:00:12.359)       0:08:40.367 **********
2026-05-28 02:42:22.254933 | mon1 | ok: [mon1]
2026-05-28 02:42:22.255157 | mon1 |
2026-05-28 02:42:22.255405 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:42:22.255675 | mon1 | mon1                       : ok=94   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-05-28 02:42:22.255954 | mon1 | osd1                       : ok=53   changed=23   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-05-28 02:42:22.256214 | mon1 |
2026-05-28 02:42:22.256446 | mon1 |
2026-05-28 02:42:22.256727 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:42:22.256988 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:07.383)       0:08:47.750 **********
2026-05-28 02:42:22.257270 | mon1 | ===============================================================================
2026-05-28 02:42:22.257524 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 112.21s
2026-05-28 02:42:22.257746 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 111.66s
2026-05-28 02:42:22.257982 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 50.49s
2026-05-28 02:42:22.258264 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.97s
2026-05-28 02:42:22.258508 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.52s
2026-05-28 02:42:22.258888 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 13.12s
2026-05-28 02:42:22.259186 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.49s
2026-05-28 02:42:22.259415 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 12.36s
2026-05-28 02:42:22.259653 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.75s
2026-05-28 02:42:22.259896 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 9.04s
2026-05-28 02:42:22.260170 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.32s
2026-05-28 02:42:22.260413 | mon1 | vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist ------------- 7.38s
2026-05-28 02:42:22.260710 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.04s
2026-05-28 02:42:22.260954 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.98s
2026-05-28 02:42:22.261154 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 6.77s
2026-05-28 02:42:22.261330 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.45s
2026-05-28 02:42:22.261498 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.45s
2026-05-28 02:42:22.261665 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.43s
2026-05-28 02:42:22.261816 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.42s
2026-05-28 02:42:22.261983 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.41s
2026-05-28 02:42:22.363602 | mon1 | INFO     [default > converge] Executed: Successful
2026-05-28 02:42:22.374135 | mon1 | INFO     [default > idempotence] Executing
2026-05-28 02:42:23.413748 | mon1 |
2026-05-28 02:42:23.414049 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-28 02:42:23.414279 | mon1 |
2026-05-28 02:42:23.414524 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:42:23.414832 | mon1 | Thursday 28 May 2026  02:42:23 +0000 (0:00:00.059)       0:00:00.059 **********
2026-05-28 02:42:25.646391 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:42:25.646467 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:42:25.646649 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:42:25.646798 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:42:25.646952 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:42:25.660157 | mon1 | ok: [mon1]
2026-05-28 02:42:25.660344 | mon1 |
2026-05-28 02:42:25.660591 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:42:25.660837 | mon1 | Thursday 28 May 2026  02:42:25 +0000 (0:00:02.246)       0:00:02.305 **********
2026-05-28 02:42:26.000574 | mon1 | ok: [mon1]
2026-05-28 02:42:26.000696 | mon1 |
2026-05-28 02:42:26.000852 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:42:26.001011 | mon1 | Thursday 28 May 2026  02:42:25 +0000 (0:00:00.340)       0:00:02.646 **********
2026-05-28 02:42:26.044512 | mon1 | skipping: [mon1]
2026-05-28 02:42:26.044644 | mon1 |
2026-05-28 02:42:26.044791 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:42:26.044954 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.044)       0:00:02.690 **********
2026-05-28 02:42:26.415407 | mon1 | ok: [mon1]
2026-05-28 02:42:26.415655 | mon1 |
2026-05-28 02:42:26.415962 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:42:26.416269 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.370)       0:00:03.060 **********
2026-05-28 02:42:26.490893 | mon1 | ok: [mon1] => {
2026-05-28 02:42:26.491184 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:42:26.491410 | mon1 | }
2026-05-28 02:42:26.491636 | mon1 |
2026-05-28 02:42:26.491881 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:42:26.492154 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.075)       0:00:03.136 **********
2026-05-28 02:42:26.988639 | mon1 | ok: [mon1]
2026-05-28 02:42:26.988706 | mon1 |
2026-05-28 02:42:26.988718 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:42:26.988728 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.496)       0:00:03.633 **********
2026-05-28 02:42:27.042776 | mon1 | skipping: [mon1]
2026-05-28 02:42:27.042853 | mon1 |
2026-05-28 02:42:27.042864 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:42:27.042874 | mon1 | Thursday 28 May 2026  02:42:27 +0000 (0:00:00.053)       0:00:03.686 **********
2026-05-28 02:42:27.079155 | mon1 | skipping: [mon1]
2026-05-28 02:42:27.079197 | mon1 |
2026-05-28 02:42:27.079710 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:42:27.079792 | mon1 | Thursday 28 May 2026  02:42:27 +0000 (0:00:00.037)       0:00:03.723 **********
2026-05-28 02:42:27.328936 | mon1 | ok: [mon1]
2026-05-28 02:42:27.328984 | mon1 |
2026-05-28 02:42:27.328989 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:42:27.328993 | mon1 | Thursday 28 May 2026  02:42:27 +0000 (0:00:00.250)       0:00:03.974 **********
2026-05-28 02:42:28.525162 | mon1 | ok: [mon1]
2026-05-28 02:42:28.525268 | mon1 |
2026-05-28 02:42:28.525336 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:42:28.525625 | mon1 | Thursday 28 May 2026  02:42:28 +0000 (0:00:01.195)       0:00:05.170 **********
2026-05-28 02:42:28.712178 | mon1 | ok: [mon1] => {
2026-05-28 02:42:28.713175 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:42:28.713243 | mon1 | }
2026-05-28 02:42:28.713254 | mon1 |
2026-05-28 02:42:28.713263 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:42:28.713437 | mon1 | Thursday 28 May 2026  02:42:28 +0000 (0:00:00.186)       0:00:05.356 **********
2026-05-28 02:42:29.276515 | mon1 | ok: [mon1]
2026-05-28 02:42:29.276584 | mon1 |
2026-05-28 02:42:29.276595 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:42:29.276605 | mon1 | Thursday 28 May 2026  02:42:29 +0000 (0:00:00.564)       0:00:05.921 **********
2026-05-28 02:42:31.867216 | mon1 | ok: [mon1]
2026-05-28 02:42:31.867300 | mon1 |
2026-05-28 02:42:31.867318 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:42:31.867498 | mon1 | Thursday 28 May 2026  02:42:31 +0000 (0:00:02.590)       0:00:08.511 **********
2026-05-28 02:42:31.898932 | mon1 | skipping: [mon1]
2026-05-28 02:42:31.898961 | mon1 |
2026-05-28 02:42:31.898969 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:42:31.898976 | mon1 | Thursday 28 May 2026  02:42:31 +0000 (0:00:00.031)       0:00:08.543 **********
2026-05-28 02:42:31.934791 | mon1 | skipping: [mon1]
2026-05-28 02:42:31.934866 | mon1 |
2026-05-28 02:42:31.934877 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:42:31.934887 | mon1 | Thursday 28 May 2026  02:42:31 +0000 (0:00:00.034)       0:00:08.577 **********
2026-05-28 02:42:31.967504 | mon1 | skipping: [mon1]
2026-05-28 02:42:31.967548 | mon1 |
2026-05-28 02:42:31.967559 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:42:31.967569 | mon1 | Thursday 28 May 2026  02:42:31 +0000 (0:00:00.033)       0:00:08.611 **********
2026-05-28 02:42:32.997561 | mon1 | ok: [mon1]
2026-05-28 02:42:32.997628 | mon1 |
2026-05-28 02:42:32.997639 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:42:32.997648 | mon1 | Thursday 28 May 2026  02:42:32 +0000 (0:00:01.030)       0:00:09.641 **********
2026-05-28 02:42:33.526464 | mon1 | ok: [mon1]
2026-05-28 02:42:33.526510 | mon1 |
2026-05-28 02:42:33.526520 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:42:33.526530 | mon1 | Thursday 28 May 2026  02:42:33 +0000 (0:00:00.528)       0:00:10.170 **********
2026-05-28 02:42:34.662479 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:42:34.662554 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:42:34.662658 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:42:34.662775 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:42:34.662893 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:42:34.662995 | mon1 |
2026-05-28 02:42:34.663266 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:42:34.663307 | mon1 | Thursday 28 May 2026  02:42:34 +0000 (0:00:01.136)       0:00:11.307 **********
2026-05-28 02:42:35.344544 | mon1 | ok: [mon1]
2026-05-28 02:42:35.344615 | mon1 |
2026-05-28 02:42:35.344725 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:42:35.344825 | mon1 | Thursday 28 May 2026  02:42:35 +0000 (0:00:00.674)       0:00:11.981 **********
2026-05-28 02:42:35.344932 | mon1 |
2026-05-28 02:42:35.345053 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:42:35.345184 | mon1 | Thursday 28 May 2026  02:42:35 +0000 (0:00:00.008)       0:00:11.989 **********
2026-05-28 02:42:36.045581 | mon1 | ok: [mon1]
2026-05-28 02:42:36.045642 | mon1 |
2026-05-28 02:42:36.045653 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:42:36.045662 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.700)       0:00:12.689 **********
2026-05-28 02:42:36.300600 | mon1 | ok: [mon1]
2026-05-28 02:42:36.300665 | mon1 |
2026-05-28 02:42:36.300676 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:42:36.300686 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.255)       0:00:12.944 **********
2026-05-28 02:42:36.373481 | mon1 | ok: [mon1] => {
2026-05-28 02:42:36.373563 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:42:36.373608 | mon1 | }
2026-05-28 02:42:36.373618 | mon1 |
2026-05-28 02:42:36.373628 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:42:36.373638 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.072)       0:00:13.017 **********
2026-05-28 02:42:36.810592 | mon1 | ok: [mon1]
2026-05-28 02:42:36.810642 | mon1 |
2026-05-28 02:42:36.810653 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:42:36.810663 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.437)       0:00:13.454 **********
2026-05-28 02:42:40.170608 | mon1 | ok: [mon1]
2026-05-28 02:42:40.170691 | mon1 |
2026-05-28 02:42:40.170767 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:42:40.170878 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:03.360)       0:00:16.814 **********
2026-05-28 02:42:41.427171 | mon1 | ok: [mon1]
2026-05-28 02:42:41.427234 | mon1 |
2026-05-28 02:42:41.427892 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:42:41.427943 | mon1 | Thursday 28 May 2026  02:42:41 +0000 (0:00:01.256)       0:00:18.071 **********
2026-05-28 02:42:41.768632 | mon1 | ok: [mon1]
2026-05-28 02:42:41.768713 | mon1 |
2026-05-28 02:42:41.768863 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:42:41.769070 | mon1 | Thursday 28 May 2026  02:42:41 +0000 (0:00:00.342)       0:00:18.413 **********
2026-05-28 02:42:42.307648 | mon1 | ok: [mon1]
2026-05-28 02:42:42.307900 | mon1 |
2026-05-28 02:42:42.307911 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:42:42.307921 | mon1 | Thursday 28 May 2026  02:42:42 +0000 (0:00:00.538)       0:00:18.951 **********
2026-05-28 02:42:43.016206 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:42:43.016261 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:42:43.017364 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:42:43.017431 | mon1 |
2026-05-28 02:42:43.017445 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:42:43.017458 | mon1 | Thursday 28 May 2026  02:42:43 +0000 (0:00:00.709)       0:00:19.660 **********
2026-05-28 02:42:43.552660 | mon1 | ok: [mon1]
2026-05-28 02:42:43.552715 | mon1 |
2026-05-28 02:42:43.552727 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:42:43.552738 | mon1 | Thursday 28 May 2026  02:42:43 +0000 (0:00:00.535)       0:00:20.196 **********
2026-05-28 02:42:44.093143 | mon1 | ok: [mon1]
2026-05-28 02:42:44.093224 | mon1 |
2026-05-28 02:42:44.094473 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:42:44.094545 | mon1 | Thursday 28 May 2026  02:42:44 +0000 (0:00:00.533)       0:00:20.729 **********
2026-05-28 02:42:44.094556 | mon1 |
2026-05-28 02:42:44.094566 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:42:44.094575 | mon1 | Thursday 28 May 2026  02:42:44 +0000 (0:00:00.007)       0:00:20.736 **********
2026-05-28 02:42:44.562214 | mon1 | ok: [mon1]
2026-05-28 02:42:44.562304 | mon1 |
2026-05-28 02:42:44.562822 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:42:44.562870 | mon1 | Thursday 28 May 2026  02:42:44 +0000 (0:00:00.469)       0:00:21.206 **********
2026-05-28 02:42:44.621388 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-28 02:42:44.621426 | mon1 |
2026-05-28 02:42:44.621437 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:42:44.621446 | mon1 | Thursday 28 May 2026  02:42:44 +0000 (0:00:00.059)       0:00:21.265 **********
2026-05-28 02:42:45.624176 | mon1 | ok: [mon1]
2026-05-28 02:42:45.624272 | mon1 |
2026-05-28 02:42:45.624896 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:42:45.624955 | mon1 | Thursday 28 May 2026  02:42:45 +0000 (0:00:01.003)       0:00:22.269 **********
2026-05-28 02:42:46.427047 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-05-28 02:42:46.427089 | mon1 | ok: [mon1] => (item=ssh)
2026-05-28 02:42:46.427094 | mon1 |
2026-05-28 02:42:46.427099 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:42:46.427104 | mon1 | Thursday 28 May 2026  02:42:46 +0000 (0:00:00.802)       0:00:23.071 **********
2026-05-28 02:42:46.794005 | mon1 | ok: [mon1]
2026-05-28 02:42:46.794128 | mon1 |
2026-05-28 02:42:46.794140 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:42:46.794150 | mon1 | Thursday 28 May 2026  02:42:46 +0000 (0:00:00.365)       0:00:23.437 **********
2026-05-28 02:42:47.034984 | mon1 | ok: [mon1]
2026-05-28 02:42:47.035087 | mon1 |
2026-05-28 02:42:47.035099 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:42:47.035109 | mon1 | Thursday 28 May 2026  02:42:47 +0000 (0:00:00.241)       0:00:23.679 **********
2026-05-28 02:42:47.508115 | mon1 | ok: [mon1]
2026-05-28 02:42:47.508185 | mon1 |
2026-05-28 02:42:47.508197 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:42:47.508207 | mon1 | Thursday 28 May 2026  02:42:47 +0000 (0:00:00.473)       0:00:24.152 **********
2026-05-28 02:42:47.874232 | mon1 | ok: [mon1]
2026-05-28 02:42:47.874316 | mon1 |
2026-05-28 02:42:47.874452 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-28 02:42:47.874701 | mon1 | Thursday 28 May 2026  02:42:47 +0000 (0:00:00.366)       0:00:24.518 **********
2026-05-28 02:42:47.987698 | mon1 | ok: [mon1]
2026-05-28 02:42:47.987869 | mon1 |
2026-05-28 02:42:47.988195 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-28 02:42:47.988448 | mon1 | Thursday 28 May 2026  02:42:47 +0000 (0:00:00.114)       0:00:24.633 **********
2026-05-28 02:42:48.321699 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:42:48.321875 | mon1 |
2026-05-28 02:42:48.322170 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-28 02:42:48.322430 | mon1 | Thursday 28 May 2026  02:42:48 +0000 (0:00:00.333)       0:00:24.966 **********
2026-05-28 02:42:48.373195 | mon1 | ok: [mon1]
2026-05-28 02:42:48.373408 | mon1 |
2026-05-28 02:42:48.373704 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-28 02:42:48.373947 | mon1 | Thursday 28 May 2026  02:42:48 +0000 (0:00:00.051)       0:00:25.018 **********
2026-05-28 02:42:48.418549 | mon1 | skipping: [mon1]
2026-05-28 02:42:48.418756 | mon1 |
2026-05-28 02:42:48.419068 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:42:48.419304 | mon1 | Thursday 28 May 2026  02:42:48 +0000 (0:00:00.044)       0:00:25.063 **********
2026-05-28 02:42:48.492829 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:42:48.493145 | mon1 |
2026-05-28 02:42:48.493680 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:42:48.494033 | mon1 | Thursday 28 May 2026  02:42:48 +0000 (0:00:00.074)       0:00:25.138 **********
2026-05-28 02:42:54.925212 | mon1 | ok: [mon1]
2026-05-28 02:42:54.925298 | mon1 |
2026-05-28 02:42:54.925457 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:42:54.925616 | mon1 | Thursday 28 May 2026  02:42:54 +0000 (0:00:06.430)       0:00:31.568 **********
2026-05-28 02:42:54.983698 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:42:54.983900 | mon1 |
2026-05-28 02:42:54.984230 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:42:54.984477 | mon1 | Thursday 28 May 2026  02:42:54 +0000 (0:00:00.060)       0:00:31.629 **********
2026-05-28 02:42:55.399449 | mon1 | ok: [mon1]
2026-05-28 02:42:55.399623 | mon1 |
2026-05-28 02:42:55.399874 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:42:55.400152 | mon1 | Thursday 28 May 2026  02:42:55 +0000 (0:00:00.415)       0:00:32.044 **********
2026-05-28 02:43:02.295159 | mon1 | ok: [mon1]
2026-05-28 02:43:02.295243 | mon1 |
2026-05-28 02:43:02.295257 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-28 02:43:02.295289 | mon1 | Thursday 28 May 2026  02:43:02 +0000 (0:00:06.895)       0:00:38.939 **********
2026-05-28 02:43:08.805142 | mon1 | ok: [mon1]
2026-05-28 02:43:08.805212 | mon1 |
2026-05-28 02:43:08.805226 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-28 02:43:08.805238 | mon1 | Thursday 28 May 2026  02:43:08 +0000 (0:00:06.510)       0:00:45.449 **********
2026-05-28 02:43:23.292885 | mon1 | ok: [mon1]
2026-05-28 02:43:23.292974 | mon1 |
2026-05-28 02:43:23.292989 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:43:23.293004 | mon1 | Thursday 28 May 2026  02:43:23 +0000 (0:00:14.486)       0:00:59.936 **********
2026-05-28 02:43:23.369132 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:43:23.369204 | mon1 |
2026-05-28 02:43:23.369220 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:43:23.369234 | mon1 | Thursday 28 May 2026  02:43:23 +0000 (0:00:00.075)       0:01:00.012 **********
2026-05-28 02:43:23.425127 | mon1 | skipping: [mon1]
2026-05-28 02:43:23.425205 | mon1 |
2026-05-28 02:43:23.425240 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:43:23.425253 | mon1 | Thursday 28 May 2026  02:43:23 +0000 (0:00:00.056)       0:01:00.068 **********
2026-05-28 02:43:23.481016 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-28 02:43:23.481127 | mon1 | skipping: [mon1]
2026-05-28 02:43:23.481141 | mon1 |
2026-05-28 02:43:23.481153 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:43:23.481166 | mon1 | Thursday 28 May 2026  02:43:23 +0000 (0:00:00.056)       0:01:00.124 **********
2026-05-28 02:43:23.814217 | mon1 | ok: [mon1]
2026-05-28 02:43:23.814306 | mon1 |
2026-05-28 02:43:23.814689 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:43:23.814756 | mon1 | Thursday 28 May 2026  02:43:23 +0000 (0:00:00.333)       0:01:00.458 **********
2026-05-28 02:43:30.886654 | mon1 | ok: [mon1]
2026-05-28 02:43:30.886753 | mon1 |
2026-05-28 02:43:30.886804 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-28 02:43:30.886931 | mon1 | Thursday 28 May 2026  02:43:30 +0000 (0:00:07.072)       0:01:07.530 **********
2026-05-28 02:43:37.286843 | mon1 | ok: [mon1]
2026-05-28 02:43:37.286923 | mon1 |
2026-05-28 02:43:37.287005 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-28 02:43:37.287163 | mon1 | Thursday 28 May 2026  02:43:37 +0000 (0:00:06.401)       0:01:13.932 **********
2026-05-28 02:43:44.783586 | mon1 | ok: [mon1]
2026-05-28 02:43:44.783766 | mon1 |
2026-05-28 02:43:44.784044 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-28 02:43:44.784299 | mon1 | Thursday 28 May 2026  02:43:44 +0000 (0:00:07.494)       0:01:21.427 **********
2026-05-28 02:43:51.900521 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-28 02:43:51.900754 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-28 02:43:51.901008 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-05-28 02:43:51.901297 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-28 02:43:51.901525 | mon1 |
2026-05-28 02:43:51.901774 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-28 02:43:51.902055 | mon1 |
2026-05-28 02:43:51.902322 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:43:51.902548 | mon1 | Thursday 28 May 2026  02:43:51 +0000 (0:00:07.119)       0:01:28.546 **********
2026-05-28 02:43:53.149751 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-28 02:43:53.149884 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:43:53.150066 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:43:53.150220 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:43:53.150372 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:43:53.164465 | mon1 | ok: [osd1]
2026-05-28 02:43:53.164681 | mon1 |
2026-05-28 02:43:53.164966 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:43:53.165267 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:01.263)       0:01:29.810 **********
2026-05-28 02:43:53.407944 | mon1 | ok: [osd1]
2026-05-28 02:43:53.408218 | mon1 |
2026-05-28 02:43:53.408507 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:43:53.408778 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:00.243)       0:01:30.053 **********
2026-05-28 02:43:53.442009 | mon1 | skipping: [osd1]
2026-05-28 02:43:53.442359 | mon1 |
2026-05-28 02:43:53.442729 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:43:53.443067 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:00.034)       0:01:30.087 **********
2026-05-28 02:43:53.701843 | mon1 | ok: [osd1]
2026-05-28 02:43:53.702153 | mon1 |
2026-05-28 02:43:53.702468 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:43:53.702759 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:00.258)       0:01:30.346 **********
2026-05-28 02:43:53.773586 | mon1 | ok: [osd1] => {
2026-05-28 02:43:53.773917 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:43:53.774256 | mon1 | }
2026-05-28 02:43:53.774528 | mon1 |
2026-05-28 02:43:53.774862 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:43:53.775241 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:00.072)       0:01:30.418 **********
2026-05-28 02:43:54.161808 | mon1 | ok: [osd1]
2026-05-28 02:43:54.161987 | mon1 |
2026-05-28 02:43:54.162297 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:43:54.162552 | mon1 | Thursday 28 May 2026  02:43:54 +0000 (0:00:00.388)       0:01:30.806 **********
2026-05-28 02:43:54.205663 | mon1 | skipping: [osd1]
2026-05-28 02:43:54.205866 | mon1 |
2026-05-28 02:43:54.206169 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:43:54.206419 | mon1 | Thursday 28 May 2026  02:43:54 +0000 (0:00:00.044)       0:01:30.851 **********
2026-05-28 02:43:54.251660 | mon1 | skipping: [osd1]
2026-05-28 02:43:54.251857 | mon1 |
2026-05-28 02:43:54.252165 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:43:54.252392 | mon1 | Thursday 28 May 2026  02:43:54 +0000 (0:00:00.046)       0:01:30.897 **********
2026-05-28 02:43:54.510168 | mon1 | ok: [osd1]
2026-05-28 02:43:54.510363 | mon1 |
2026-05-28 02:43:54.510627 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:43:54.510877 | mon1 | Thursday 28 May 2026  02:43:54 +0000 (0:00:00.258)       0:01:31.155 **********
2026-05-28 02:43:55.836205 | mon1 | ok: [osd1]
2026-05-28 02:43:55.836276 | mon1 |
2026-05-28 02:43:55.836287 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:43:55.836303 | mon1 | Thursday 28 May 2026  02:43:55 +0000 (0:00:01.325)       0:01:32.481 **********
2026-05-28 02:43:56.048156 | mon1 | ok: [osd1] => {
2026-05-28 02:43:56.048219 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:43:56.048230 | mon1 | }
2026-05-28 02:43:56.048239 | mon1 |
2026-05-28 02:43:56.048248 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:43:56.048258 | mon1 | Thursday 28 May 2026  02:43:56 +0000 (0:00:00.210)       0:01:32.691 **********
2026-05-28 02:43:56.578735 | mon1 | ok: [osd1]
2026-05-28 02:43:56.578808 | mon1 |
2026-05-28 02:43:56.578819 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:43:56.578829 | mon1 | Thursday 28 May 2026  02:43:56 +0000 (0:00:00.531)       0:01:33.222 **********
2026-05-28 02:43:58.910880 | mon1 | ok: [osd1]
2026-05-28 02:43:58.910963 | mon1 |
2026-05-28 02:43:58.910974 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:43:58.910985 | mon1 | Thursday 28 May 2026  02:43:58 +0000 (0:00:02.332)       0:01:35.555 **********
2026-05-28 02:43:58.944191 | mon1 | skipping: [osd1]
2026-05-28 02:43:58.944295 | mon1 |
2026-05-28 02:43:58.944340 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:43:58.944358 | mon1 | Thursday 28 May 2026  02:43:58 +0000 (0:00:00.033)       0:01:35.588 **********
2026-05-28 02:43:58.981848 | mon1 | skipping: [osd1]
2026-05-28 02:43:58.981869 | mon1 |
2026-05-28 02:43:58.981875 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:43:58.981881 | mon1 | Thursday 28 May 2026  02:43:58 +0000 (0:00:00.038)       0:01:35.627 **********
2026-05-28 02:43:59.017058 | mon1 | skipping: [osd1]
2026-05-28 02:43:59.017087 | mon1 |
2026-05-28 02:43:59.017097 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:43:59.017106 | mon1 | Thursday 28 May 2026  02:43:59 +0000 (0:00:00.034)       0:01:35.661 **********
2026-05-28 02:44:00.295566 | mon1 | ok: [osd1]
2026-05-28 02:44:00.295628 | mon1 |
2026-05-28 02:44:00.295639 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:44:00.295648 | mon1 | Thursday 28 May 2026  02:44:00 +0000 (0:00:01.277)       0:01:36.939 **********
2026-05-28 02:44:00.856664 | mon1 | ok: [osd1]
2026-05-28 02:44:00.856736 | mon1 |
2026-05-28 02:44:00.856747 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:44:00.856756 | mon1 | Thursday 28 May 2026  02:44:00 +0000 (0:00:00.561)       0:01:37.500 **********
2026-05-28 02:44:01.975177 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-05-28 02:44:01.975253 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:44:01.976679 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:44:01.976743 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:44:01.976754 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:44:01.976763 | mon1 |
2026-05-28 02:44:01.976773 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:44:01.976782 | mon1 | Thursday 28 May 2026  02:44:01 +0000 (0:00:01.119)       0:01:38.619 **********
2026-05-28 02:44:02.675162 | mon1 | ok: [osd1]
2026-05-28 02:44:02.675223 | mon1 |
2026-05-28 02:44:02.676442 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:44:02.676492 | mon1 | Thursday 28 May 2026  02:44:02 +0000 (0:00:00.692)       0:01:39.312 **********
2026-05-28 02:44:02.676503 | mon1 |
2026-05-28 02:44:02.676512 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:44:02.676521 | mon1 | Thursday 28 May 2026  02:44:02 +0000 (0:00:00.006)       0:01:39.319 **********
2026-05-28 02:44:03.129238 | mon1 | ok: [osd1]
2026-05-28 02:44:03.129332 | mon1 |
2026-05-28 02:44:03.129588 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:44:03.129893 | mon1 | Thursday 28 May 2026  02:44:03 +0000 (0:00:00.454)       0:01:39.773 **********
2026-05-28 02:44:03.388301 | mon1 | ok: [osd1]
2026-05-28 02:44:03.388412 | mon1 |
2026-05-28 02:44:03.388667 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:44:03.388912 | mon1 | Thursday 28 May 2026  02:44:03 +0000 (0:00:00.259)       0:01:40.033 **********
2026-05-28 02:44:03.466614 | mon1 | ok: [osd1] => {
2026-05-28 02:44:03.466727 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:44:03.466970 | mon1 | }
2026-05-28 02:44:03.467311 | mon1 |
2026-05-28 02:44:03.467451 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:44:03.467699 | mon1 | Thursday 28 May 2026  02:44:03 +0000 (0:00:00.078)       0:01:40.112 **********
2026-05-28 02:44:03.933057 | mon1 | ok: [osd1]
2026-05-28 02:44:03.933254 | mon1 |
2026-05-28 02:44:03.933511 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:44:03.933764 | mon1 | Thursday 28 May 2026  02:44:03 +0000 (0:00:00.466)       0:01:40.578 **********
2026-05-28 02:44:07.277688 | mon1 | ok: [osd1]
2026-05-28 02:44:07.277920 | mon1 |
2026-05-28 02:44:07.278210 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:44:07.278454 | mon1 | Thursday 28 May 2026  02:44:07 +0000 (0:00:03.344)       0:01:43.922 **********
2026-05-28 02:44:08.692183 | mon1 | ok: [osd1]
2026-05-28 02:44:08.692237 | mon1 |
2026-05-28 02:44:08.692244 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:44:08.692436 | mon1 | Thursday 28 May 2026  02:44:08 +0000 (0:00:01.414)       0:01:45.336 **********
2026-05-28 02:44:08.949115 | mon1 | ok: [osd1]
2026-05-28 02:44:08.949318 | mon1 |
2026-05-28 02:44:08.949585 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:44:08.949824 | mon1 | Thursday 28 May 2026  02:44:08 +0000 (0:00:00.257)       0:01:45.594 **********
2026-05-28 02:44:09.531275 | mon1 | ok: [osd1]
2026-05-28 02:44:09.531448 | mon1 |
2026-05-28 02:44:09.531712 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:44:09.531955 | mon1 | Thursday 28 May 2026  02:44:09 +0000 (0:00:00.582)       0:01:46.176 **********
2026-05-28 02:44:10.234775 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-05-28 02:44:10.235120 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:44:10.235416 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:44:10.235634 | mon1 |
2026-05-28 02:44:10.235898 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:44:10.236210 | mon1 | Thursday 28 May 2026  02:44:10 +0000 (0:00:00.703)       0:01:46.879 **********
2026-05-28 02:44:10.772771 | mon1 | ok: [osd1]
2026-05-28 02:44:10.772940 | mon1 |
2026-05-28 02:44:10.773286 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:44:10.773538 | mon1 | Thursday 28 May 2026  02:44:10 +0000 (0:00:00.538)       0:01:47.418 **********
2026-05-28 02:44:11.364129 | mon1 | ok: [osd1]
2026-05-28 02:44:11.364202 | mon1 |
2026-05-28 02:44:11.364221 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:44:11.365240 | mon1 | Thursday 28 May 2026  02:44:11 +0000 (0:00:00.584)       0:01:48.003 **********
2026-05-28 02:44:11.365309 | mon1 |
2026-05-28 02:44:11.365320 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:44:11.365329 | mon1 | Thursday 28 May 2026  02:44:11 +0000 (0:00:00.006)       0:01:48.009 **********
2026-05-28 02:44:11.813045 | mon1 | ok: [osd1]
2026-05-28 02:44:11.813093 | mon1 |
2026-05-28 02:44:11.813099 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:44:11.813104 | mon1 | Thursday 28 May 2026  02:44:11 +0000 (0:00:00.448)       0:01:48.457 **********
2026-05-28 02:44:11.874755 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-28 02:44:11.874775 | mon1 |
2026-05-28 02:44:11.874780 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:44:11.874785 | mon1 | Thursday 28 May 2026  02:44:11 +0000 (0:00:00.062)       0:01:48.519 **********
2026-05-28 02:44:13.094626 | mon1 | ok: [osd1]
2026-05-28 02:44:13.094677 | mon1 |
2026-05-28 02:44:13.094688 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:44:13.094698 | mon1 | Thursday 28 May 2026  02:44:13 +0000 (0:00:01.218)       0:01:49.738 **********
2026-05-28 02:44:13.907487 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-05-28 02:44:13.907578 | mon1 | ok: [osd1] => (item=ssh)
2026-05-28 02:44:13.907627 | mon1 |
2026-05-28 02:44:13.907755 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:44:13.907864 | mon1 | Thursday 28 May 2026  02:44:13 +0000 (0:00:00.811)       0:01:50.550 **********
2026-05-28 02:44:14.336711 | mon1 | ok: [osd1]
2026-05-28 02:44:14.336788 | mon1 |
2026-05-28 02:44:14.336877 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:44:14.336988 | mon1 | Thursday 28 May 2026  02:44:14 +0000 (0:00:00.431)       0:01:50.982 **********
2026-05-28 02:44:14.585178 | mon1 | ok: [osd1]
2026-05-28 02:44:14.585324 | mon1 |
2026-05-28 02:44:14.585336 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:44:14.585480 | mon1 | Thursday 28 May 2026  02:44:14 +0000 (0:00:00.248)       0:01:51.230 **********
2026-05-28 02:44:14.902783 | mon1 | ok: [osd1]
2026-05-28 02:44:14.902978 | mon1 |
2026-05-28 02:44:14.903349 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:44:14.903637 | mon1 | Thursday 28 May 2026  02:44:14 +0000 (0:00:00.317)       0:01:51.547 **********
2026-05-28 02:44:15.167749 | mon1 | ok: [osd1]
2026-05-28 02:44:15.167931 | mon1 |
2026-05-28 02:44:15.168335 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-28 02:44:15.168640 | mon1 | Thursday 28 May 2026  02:44:15 +0000 (0:00:00.265)       0:01:51.812 **********
2026-05-28 02:44:15.469899 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-28 02:44:15.470192 | mon1 |
2026-05-28 02:44:15.470457 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-28 02:44:15.470728 | mon1 | Thursday 28 May 2026  02:44:15 +0000 (0:00:00.302)       0:01:52.115 **********
2026-05-28 02:44:15.525165 | mon1 | ok: [osd1]
2026-05-28 02:44:15.525402 | mon1 |
2026-05-28 02:44:15.525748 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:44:15.526186 | mon1 | Thursday 28 May 2026  02:44:15 +0000 (0:00:00.055)       0:01:52.170 **********
2026-05-28 02:44:15.587802 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-28 02:44:15.588051 | mon1 |
2026-05-28 02:44:15.588325 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:44:15.588598 | mon1 | Thursday 28 May 2026  02:44:15 +0000 (0:00:00.062)       0:01:52.233 **********
2026-05-28 02:44:21.936773 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:21.936987 | mon1 |
2026-05-28 02:44:21.937325 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:44:21.937588 | mon1 | Thursday 28 May 2026  02:44:21 +0000 (0:00:06.348)       0:01:58.581 **********
2026-05-28 02:44:21.989772 | mon1 | ok: [osd1] => (item=osd1)
2026-05-28 02:44:21.989970 | mon1 |
2026-05-28 02:44:21.990279 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:44:21.990536 | mon1 | Thursday 28 May 2026  02:44:21 +0000 (0:00:00.053)       0:01:58.635 **********
2026-05-28 02:44:22.314737 | mon1 | ok: [osd1]
2026-05-28 02:44:22.314902 | mon1 |
2026-05-28 02:44:22.315256 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:44:22.315520 | mon1 | Thursday 28 May 2026  02:44:22 +0000 (0:00:00.324)       0:01:58.959 **********
2026-05-28 02:44:29.213773 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:29.213887 | mon1 |
2026-05-28 02:44:29.214206 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-28 02:44:29.214446 | mon1 | Thursday 28 May 2026  02:44:29 +0000 (0:00:06.899)       0:02:05.859 **********
2026-05-28 02:44:34.926253 | mon1 | ok: [osd1]
2026-05-28 02:44:34.926331 | mon1 |
2026-05-28 02:44:34.926345 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-28 02:44:34.926357 | mon1 | Thursday 28 May 2026  02:44:34 +0000 (0:00:05.711)       0:02:11.570 **********
2026-05-28 02:44:57.465591 | mon1 | ok: [osd1]
2026-05-28 02:44:57.465719 | mon1 |
2026-05-28 02:44:57.465734 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-28 02:44:57.465748 | mon1 | Thursday 28 May 2026  02:44:57 +0000 (0:00:22.539)       0:02:34.110 **********
2026-05-28 02:44:57.531697 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-05-28 02:44:57.531807 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-05-28 02:44:57.532117 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-05-28 02:44:57.532371 | mon1 | skipping: [osd1]
2026-05-28 02:44:57.532607 | mon1 |
2026-05-28 02:44:57.532873 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-28 02:44:57.533176 | mon1 | Thursday 28 May 2026  02:44:57 +0000 (0:00:00.066)       0:02:34.176 **********
2026-05-28 02:45:04.047995 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:45:04.048222 | mon1 |
2026-05-28 02:45:04.048518 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-28 02:45:04.048732 | mon1 | Thursday 28 May 2026  02:45:04 +0000 (0:00:06.516)       0:02:40.693 **********
2026-05-28 02:45:10.511517 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:45:10.511726 | mon1 |
2026-05-28 02:45:10.512094 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-28 02:45:10.512371 | mon1 | Thursday 28 May 2026  02:45:10 +0000 (0:00:06.463)       0:02:47.156 **********
2026-05-28 02:45:10.575863 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-28 02:45:10.576051 | mon1 |
2026-05-28 02:45:10.576333 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-28 02:45:10.576603 | mon1 | Thursday 28 May 2026  02:45:10 +0000 (0:00:00.064)       0:02:47.221 **********
2026-05-28 02:45:10.626084 | mon1 | ok: [osd1]
2026-05-28 02:45:10.626352 | mon1 |
2026-05-28 02:45:10.626743 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-28 02:45:10.627045 | mon1 | Thursday 28 May 2026  02:45:10 +0000 (0:00:00.050)       0:02:47.271 **********
2026-05-28 02:45:17.134236 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:45:17.134330 | mon1 |
2026-05-28 02:45:17.134964 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-28 02:45:17.135076 | mon1 | Thursday 28 May 2026  02:45:17 +0000 (0:00:06.507)       0:02:53.779 **********
2026-05-28 02:45:17.186449 | mon1 | ok: [osd1]
2026-05-28 02:45:17.186492 | mon1 |
2026-05-28 02:45:17.186643 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-28 02:45:17.186764 | mon1 | Thursday 28 May 2026  02:45:17 +0000 (0:00:00.051)       0:02:53.831 **********
2026-05-28 02:45:17.232272 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:45:17.232346 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:45:17.232466 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:45:17.232903 | mon1 | skipping: [osd1]
2026-05-28 02:45:17.232942 | mon1 |
2026-05-28 02:45:17.232948 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-28 02:45:17.232955 | mon1 | Thursday 28 May 2026  02:45:17 +0000 (0:00:00.047)       0:02:53.878 **********
2026-05-28 02:45:17.308213 | mon1 | skipping: [osd1]
2026-05-28 02:45:17.308319 | mon1 |
2026-05-28 02:45:17.308335 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-05-28 02:45:17.308348 | mon1 |
2026-05-28 02:45:17.308360 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:45:17.308381 | mon1 | Thursday 28 May 2026  02:45:17 +0000 (0:00:00.073)       0:02:53.951 **********
2026-05-28 02:45:18.343934 | mon1 | ok: [mon1]
2026-05-28 02:45:18.344019 | mon1 |
2026-05-28 02:45:18.344071 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:45:18.344085 | mon1 | Thursday 28 May 2026  02:45:18 +0000 (0:00:01.036)       0:02:54.987 **********
2026-05-28 02:45:18.602181 | mon1 | ok: [mon1]
2026-05-28 02:45:18.602278 | mon1 |
2026-05-28 02:45:18.602825 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:45:18.602913 | mon1 | Thursday 28 May 2026  02:45:18 +0000 (0:00:00.259)       0:02:55.246 **********
2026-05-28 02:45:18.648224 | mon1 | skipping: [mon1]
2026-05-28 02:45:18.648311 | mon1 |
2026-05-28 02:45:18.648326 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:45:18.648340 | mon1 | Thursday 28 May 2026  02:45:18 +0000 (0:00:00.045)       0:02:55.291 **********
2026-05-28 02:45:18.931537 | mon1 | ok: [mon1]
2026-05-28 02:45:18.931665 | mon1 |
2026-05-28 02:45:18.931680 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:45:18.931774 | mon1 | Thursday 28 May 2026  02:45:18 +0000 (0:00:00.284)       0:02:55.576 **********
2026-05-28 02:45:19.114658 | mon1 | ok: [mon1] => {
2026-05-28 02:45:19.114800 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:45:19.114811 | mon1 | }
2026-05-28 02:45:19.114821 | mon1 |
2026-05-28 02:45:19.114831 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:45:19.114841 | mon1 | Thursday 28 May 2026  02:45:19 +0000 (0:00:00.181)       0:02:55.758 **********
2026-05-28 02:45:19.525108 | mon1 | ok: [mon1]
2026-05-28 02:45:19.525194 | mon1 |
2026-05-28 02:45:19.525210 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:45:19.525221 | mon1 | Thursday 28 May 2026  02:45:19 +0000 (0:00:00.410)       0:02:56.168 **********
2026-05-28 02:45:19.572260 | mon1 | skipping: [mon1]
2026-05-28 02:45:19.572352 | mon1 |
2026-05-28 02:45:19.572554 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:45:19.572795 | mon1 | Thursday 28 May 2026  02:45:19 +0000 (0:00:00.049)       0:02:56.217 **********
2026-05-28 02:45:19.621759 | mon1 | skipping: [mon1]
2026-05-28 02:45:19.621961 | mon1 |
2026-05-28 02:45:19.622281 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:45:19.622509 | mon1 | Thursday 28 May 2026  02:45:19 +0000 (0:00:00.049)       0:02:56.267 **********
2026-05-28 02:45:19.891460 | mon1 | ok: [mon1]
2026-05-28 02:45:19.891620 | mon1 |
2026-05-28 02:45:19.891892 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:45:19.892149 | mon1 | Thursday 28 May 2026  02:45:19 +0000 (0:00:00.268)       0:02:56.536 **********
2026-05-28 02:45:21.237845 | mon1 | ok: [mon1]
2026-05-28 02:45:21.238120 | mon1 |
2026-05-28 02:45:21.238443 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:45:21.238703 | mon1 | Thursday 28 May 2026  02:45:21 +0000 (0:00:01.346)       0:02:57.882 **********
2026-05-28 02:45:21.439627 | mon1 | ok: [mon1] => {
2026-05-28 02:45:21.439850 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:45:21.440124 | mon1 | }
2026-05-28 02:45:21.440357 | mon1 |
2026-05-28 02:45:21.440613 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:45:21.440880 | mon1 | Thursday 28 May 2026  02:45:21 +0000 (0:00:00.201)       0:02:58.084 **********
2026-05-28 02:45:21.978651 | mon1 | ok: [mon1]
2026-05-28 02:45:21.978746 | mon1 |
2026-05-28 02:45:21.978796 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:45:21.978911 | mon1 | Thursday 28 May 2026  02:45:21 +0000 (0:00:00.538)       0:02:58.623 **********
2026-05-28 02:45:24.357107 | mon1 | ok: [mon1]
2026-05-28 02:45:24.357186 | mon1 |
2026-05-28 02:45:24.357198 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:45:24.357276 | mon1 | Thursday 28 May 2026  02:45:24 +0000 (0:00:02.376)       0:03:00.999 **********
2026-05-28 02:45:24.393017 | mon1 | skipping: [mon1]
2026-05-28 02:45:24.393453 | mon1 |
2026-05-28 02:45:24.393786 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:45:24.394163 | mon1 | Thursday 28 May 2026  02:45:24 +0000 (0:00:00.037)       0:03:01.037 **********
2026-05-28 02:45:24.423863 | mon1 | skipping: [mon1]
2026-05-28 02:45:24.424336 | mon1 |
2026-05-28 02:45:24.424721 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:45:24.425071 | mon1 | Thursday 28 May 2026  02:45:24 +0000 (0:00:00.031)       0:03:01.068 **********
2026-05-28 02:45:24.454607 | mon1 | skipping: [mon1]
2026-05-28 02:45:24.455520 | mon1 |
2026-05-28 02:45:24.455549 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:45:24.455559 | mon1 | Thursday 28 May 2026  02:45:24 +0000 (0:00:00.031)       0:03:01.100 **********
2026-05-28 02:45:25.651155 | mon1 | ok: [mon1]
2026-05-28 02:45:25.651245 | mon1 |
2026-05-28 02:45:25.651727 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:45:25.651775 | mon1 | Thursday 28 May 2026  02:45:25 +0000 (0:00:01.195)       0:03:02.295 **********
2026-05-28 02:45:26.211782 | mon1 | ok: [mon1]
2026-05-28 02:45:26.211840 | mon1 |
2026-05-28 02:45:26.211851 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:45:26.211860 | mon1 | Thursday 28 May 2026  02:45:26 +0000 (0:00:00.560)       0:03:02.855 **********
2026-05-28 02:45:27.369137 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:45:27.369199 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:45:27.369210 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:45:27.369227 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:45:27.370117 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:45:27.370205 | mon1 |
2026-05-28 02:45:27.370216 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:45:27.370454 | mon1 | Thursday 28 May 2026  02:45:27 +0000 (0:00:01.157)       0:03:04.012 **********
2026-05-28 02:45:28.057861 | mon1 | ok: [mon1]
2026-05-28 02:45:28.058147 | mon1 |
2026-05-28 02:45:28.058392 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:45:28.058596 | mon1 | Thursday 28 May 2026  02:45:28 +0000 (0:00:00.682)       0:03:04.694 **********
2026-05-28 02:45:28.058794 | mon1 |
2026-05-28 02:45:28.059003 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:45:28.059232 | mon1 | Thursday 28 May 2026  02:45:28 +0000 (0:00:00.008)       0:03:04.702 **********
2026-05-28 02:45:28.549066 | mon1 | ok: [mon1]
2026-05-28 02:45:28.549981 | mon1 |
2026-05-28 02:45:28.550001 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:45:28.550012 | mon1 | Thursday 28 May 2026  02:45:28 +0000 (0:00:00.491)       0:03:05.194 **********
2026-05-28 02:45:28.807626 | mon1 | ok: [mon1]
2026-05-28 02:45:28.807688 | mon1 |
2026-05-28 02:45:28.807790 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:45:28.807902 | mon1 | Thursday 28 May 2026  02:45:28 +0000 (0:00:00.258)       0:03:05.452 **********
2026-05-28 02:45:28.887198 | mon1 | ok: [mon1] => {
2026-05-28 02:45:28.888449 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:45:28.888532 | mon1 | }
2026-05-28 02:45:28.888543 | mon1 |
2026-05-28 02:45:28.888553 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:45:28.888563 | mon1 | Thursday 28 May 2026  02:45:28 +0000 (0:00:00.079)       0:03:05.531 **********
2026-05-28 02:45:29.343646 | mon1 | ok: [mon1]
2026-05-28 02:45:29.343689 | mon1 |
2026-05-28 02:45:29.343695 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:45:29.343700 | mon1 | Thursday 28 May 2026  02:45:29 +0000 (0:00:00.457)       0:03:05.988 **********
2026-05-28 02:45:32.726939 | mon1 | ok: [mon1]
2026-05-28 02:45:32.726993 | mon1 |
2026-05-28 02:45:32.727005 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:45:32.727015 | mon1 | Thursday 28 May 2026  02:45:32 +0000 (0:00:03.382)       0:03:09.371 **********
2026-05-28 02:45:33.827016 | mon1 | ok: [mon1]
2026-05-28 02:45:33.827112 | mon1 |
2026-05-28 02:45:33.827123 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:45:33.827132 | mon1 | Thursday 28 May 2026  02:45:33 +0000 (0:00:01.099)       0:03:10.471 **********
2026-05-28 02:45:34.102859 | mon1 | ok: [mon1]
2026-05-28 02:45:34.102935 | mon1 |
2026-05-28 02:45:34.102946 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:45:34.102956 | mon1 | Thursday 28 May 2026  02:45:34 +0000 (0:00:00.274)       0:03:10.745 **********
2026-05-28 02:45:34.709794 | mon1 | ok: [mon1]
2026-05-28 02:45:34.709898 | mon1 |
2026-05-28 02:45:34.709915 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:45:34.710070 | mon1 | Thursday 28 May 2026  02:45:34 +0000 (0:00:00.606)       0:03:11.352 **********
2026-05-28 02:45:35.429628 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:45:35.429738 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:45:35.429903 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:45:35.430010 | mon1 |
2026-05-28 02:45:35.430167 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:45:35.430281 | mon1 | Thursday 28 May 2026  02:45:35 +0000 (0:00:00.722)       0:03:12.074 **********
2026-05-28 02:45:36.015609 | mon1 | ok: [mon1]
2026-05-28 02:45:36.015671 | mon1 |
2026-05-28 02:45:36.015688 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:45:36.015695 | mon1 | Thursday 28 May 2026  02:45:36 +0000 (0:00:00.582)       0:03:12.657 **********
2026-05-28 02:45:36.588834 | mon1 | ok: [mon1]
2026-05-28 02:45:36.589288 | mon1 |
2026-05-28 02:45:36.589728 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:45:36.590201 | mon1 | Thursday 28 May 2026  02:45:36 +0000 (0:00:00.569)       0:03:13.227 **********
2026-05-28 02:45:36.590601 | mon1 |
2026-05-28 02:45:36.591009 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:45:36.591475 | mon1 | Thursday 28 May 2026  02:45:36 +0000 (0:00:00.006)       0:03:13.233 **********
2026-05-28 02:45:37.088638 | mon1 | ok: [mon1]
2026-05-28 02:45:37.088712 | mon1 |
2026-05-28 02:45:37.088837 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:45:37.088953 | mon1 | Thursday 28 May 2026  02:45:37 +0000 (0:00:00.498)       0:03:13.732 **********
2026-05-28 02:45:37.145074 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-28 02:45:37.145133 | mon1 |
2026-05-28 02:45:37.145382 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:45:37.145422 | mon1 | Thursday 28 May 2026  02:45:37 +0000 (0:00:00.057)       0:03:13.790 **********
2026-05-28 02:45:38.364589 | mon1 | ok: [mon1]
2026-05-28 02:45:38.364694 | mon1 |
2026-05-28 02:45:38.364805 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:45:38.364975 | mon1 | Thursday 28 May 2026  02:45:38 +0000 (0:00:01.218)       0:03:15.008 **********
2026-05-28 02:45:39.168208 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-05-28 02:45:39.168302 | mon1 | ok: [mon1] => (item=ssh)
2026-05-28 02:45:39.168931 | mon1 |
2026-05-28 02:45:39.168979 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:45:39.168990 | mon1 | Thursday 28 May 2026  02:45:39 +0000 (0:00:00.804)       0:03:15.813 **********
2026-05-28 02:45:39.602138 | mon1 | ok: [mon1]
2026-05-28 02:45:39.602207 | mon1 |
2026-05-28 02:45:39.602219 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:45:39.602507 | mon1 | Thursday 28 May 2026  02:45:39 +0000 (0:00:00.433)       0:03:16.246 **********
2026-05-28 02:45:39.874638 | mon1 | ok: [mon1]
2026-05-28 02:45:39.874704 | mon1 |
2026-05-28 02:45:39.874714 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:45:39.874724 | mon1 | Thursday 28 May 2026  02:45:39 +0000 (0:00:00.271)       0:03:16.517 **********
2026-05-28 02:45:40.191751 | mon1 | ok: [mon1]
2026-05-28 02:45:40.191815 | mon1 |
2026-05-28 02:45:40.191825 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:45:40.191835 | mon1 | Thursday 28 May 2026  02:45:40 +0000 (0:00:00.317)       0:03:16.834 **********
2026-05-28 02:45:40.445964 | mon1 | ok: [mon1]
2026-05-28 02:45:40.446073 | mon1 |
2026-05-28 02:45:40.446089 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-05-28 02:45:40.446100 | mon1 | Thursday 28 May 2026  02:45:40 +0000 (0:00:00.255)       0:03:17.089 **********
2026-05-28 02:45:46.897845 | mon1 | ok: [mon1]
2026-05-28 02:45:46.897901 | mon1 |
2026-05-28 02:45:46.897910 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist] *************
2026-05-28 02:45:46.897917 | mon1 | Thursday 28 May 2026  02:45:46 +0000 (0:00:06.449)       0:03:23.539 **********
2026-05-28 02:45:53.331125 | mon1 | ok: [mon1]
2026-05-28 02:45:53.331249 | mon1 |
2026-05-28 02:45:53.331266 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:45:53.331373 | mon1 | mon1                       : ok=84   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-05-28 02:45:53.331485 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-05-28 02:45:53.333127 | mon1 |
2026-05-28 02:45:53.333193 | mon1 |
2026-05-28 02:45:53.333228 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:45:53.333242 | mon1 | Thursday 28 May 2026  02:45:53 +0000 (0:00:06.437)       0:03:29.976 **********
2026-05-28 02:45:53.333254 | mon1 | ===============================================================================
2026-05-28 02:45:53.333267 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.54s
2026-05-28 02:45:53.333280 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.49s
2026-05-28 02:45:53.333296 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 7.49s
2026-05-28 02:45:53.333313 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.12s
2026-05-28 02:45:53.333330 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.07s
2026-05-28 02:45:53.333346 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.90s
2026-05-28 02:45:53.333360 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.90s
2026-05-28 02:45:53.333371 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.52s
2026-05-28 02:45:53.333383 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.51s
2026-05-28 02:45:53.333403 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.51s
2026-05-28 02:45:53.333416 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.46s
2026-05-28 02:45:53.333428 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 6.45s
2026-05-28 02:45:53.333531 | mon1 | vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist ------------- 6.44s
2026-05-28 02:45:53.334427 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.43s
2026-05-28 02:45:53.334445 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.40s
2026-05-28 02:45:53.334451 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.35s
2026-05-28 02:45:53.334458 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.71s
2026-05-28 02:45:53.334464 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.38s
2026-05-28 02:45:53.334470 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.36s
2026-05-28 02:45:53.334475 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s
2026-05-28 02:45:53.468203 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-05-28 02:45:53.481482 | mon1 | INFO     [default > side_effect] Executing
2026-05-28 02:45:53.482065 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:45:53.490327 | mon1 | INFO     [default > verify] Executing
2026-05-28 02:45:54.244355 | mon1 |
2026-05-28 02:45:54.244723 | mon1 | PLAY [Verify] ******************************************************************
2026-05-28 02:45:54.245552 | mon1 |
2026-05-28 02:45:54.245580 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:45:54.245592 | mon1 | Thursday 28 May 2026  02:45:54 +0000 (0:00:00.008)       0:00:00.008 **********
2026-05-28 02:45:55.518226 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:45:55.518323 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-28 02:45:55.518337 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:45:55.518349 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:45:55.518408 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:45:55.527167 | mon1 | ok: [mon1]
2026-05-28 02:45:55.527253 | mon1 |
2026-05-28 02:45:55.527264 | mon1 | TASK [Get cluster health status] ***********************************************
2026-05-28 02:45:55.527274 | mon1 | Thursday 28 May 2026  02:45:55 +0000 (0:00:01.281)       0:00:01.290 **********
2026-05-28 02:46:06.430185 | mon1 | ok: [mon1]
2026-05-28 02:46:06.430396 | mon1 |
2026-05-28 02:46:06.430684 | mon1 | TASK [Print cluster health status] *********************************************
2026-05-28 02:46:06.430958 | mon1 | Thursday 28 May 2026  02:46:06 +0000 (0:00:10.903)       0:00:12.193 **********
2026-05-28 02:46:06.468805 | mon1 | ok: [mon1] => {
2026-05-28 02:46:06.469074 | mon1 |     "_ceph_health": {
2026-05-28 02:46:06.469400 | mon1 |         "changed": false,
2026-05-28 02:46:06.469719 | mon1 |         "cmd": [
2026-05-28 02:46:06.470070 | mon1 |             "cephadm",
2026-05-28 02:46:06.470425 | mon1 |             "shell",
2026-05-28 02:46:06.470799 | mon1 |             "--",
2026-05-28 02:46:06.471112 | mon1 |             "ceph",
2026-05-28 02:46:06.471378 | mon1 |             "health"
2026-05-28 02:46:06.471635 | mon1 |         ],
2026-05-28 02:46:06.471905 | mon1 |         "delta": "0:00:10.558872",
2026-05-28 02:46:06.472182 | mon1 |         "end": "2026-05-28 02:46:06.379244",
2026-05-28 02:46:06.472441 | mon1 |         "failed": false,
2026-05-28 02:46:06.472656 | mon1 |         "msg": "",
2026-05-28 02:46:06.472862 | mon1 |         "rc": 0,
2026-05-28 02:46:06.473130 | mon1 |         "start": "2026-05-28 02:45:55.820372",
2026-05-28 02:46:06.473410 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-05-28 02:46:06.473666 | mon1 |         "stderr_lines": [
2026-05-28 02:46:06.473886 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-05-28 02:46:06.474173 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-05-28 02:46:06.474409 | mon1 |         ],
2026-05-28 02:46:06.474638 | mon1 |         "stdout": "HEALTH_OK",
2026-05-28 02:46:06.475055 | mon1 |         "stdout_lines": [
2026-05-28 02:46:06.475340 | mon1 |             "HEALTH_OK"
2026-05-28 02:46:06.475559 | mon1 |         ]
2026-05-28 02:46:06.475707 | mon1 |     }
2026-05-28 02:46:06.475881 | mon1 | }
2026-05-28 02:46:06.476076 | mon1 |
2026-05-28 02:46:06.476243 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-05-28 02:46:06.476386 | mon1 | Thursday 28 May 2026  02:46:06 +0000 (0:00:00.038)       0:00:12.232 **********
2026-05-28 02:46:06.504177 | mon1 | ok: [mon1] => {
2026-05-28 02:46:06.504389 | mon1 |     "changed": false,
2026-05-28 02:46:06.504640 | mon1 |     "msg": "All assertions passed"
2026-05-28 02:46:06.504883 | mon1 | }
2026-05-28 02:46:06.505154 | mon1 |
2026-05-28 02:46:06.505420 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-05-28 02:46:06.505680 | mon1 | Thursday 28 May 2026  02:46:06 +0000 (0:00:00.035)       0:00:12.268 **********
2026-05-28 02:46:15.519236 | mon1 | changed: [mon1]
2026-05-28 02:46:15.519341 | mon1 |
2026-05-28 02:46:15.519365 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-05-28 02:46:15.519614 | mon1 | Thursday 28 May 2026  02:46:15 +0000 (0:00:09.014)       0:00:21.282 **********
2026-05-28 02:46:18.118397 | mon1 | changed: [mon1]
2026-05-28 02:46:18.118685 | mon1 |
2026-05-28 02:46:18.119055 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-05-28 02:46:18.119448 | mon1 | Thursday 28 May 2026  02:46:18 +0000 (0:00:02.599)       0:00:23.881 **********
2026-05-28 02:46:19.380363 | mon1 | ok: [mon1]
2026-05-28 02:46:19.380479 | mon1 |
2026-05-28 02:46:19.380494 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-05-28 02:46:19.380507 | mon1 | Thursday 28 May 2026  02:46:19 +0000 (0:00:01.260)       0:00:25.142 **********
2026-05-28 02:46:19.429576 | mon1 | ok: [mon1] => {
2026-05-28 02:46:19.429728 | mon1 |     "changed": false,
2026-05-28 02:46:19.429897 | mon1 |     "msg": "All assertions passed"
2026-05-28 02:46:19.430074 | mon1 | }
2026-05-28 02:46:19.430559 | mon1 |
2026-05-28 02:46:19.430593 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] *********
2026-05-28 02:46:19.430600 | mon1 | Thursday 28 May 2026  02:46:19 +0000 (0:00:00.048)       0:00:25.191 **********
2026-05-28 02:46:20.629857 | mon1 | ok: [mon1]
2026-05-28 02:46:20.629900 | mon1 |
2026-05-28 02:46:20.629906 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] ****
2026-05-28 02:46:20.629913 | mon1 | Thursday 28 May 2026  02:46:20 +0000 (0:00:01.198)       0:00:26.389 **********
2026-05-28 02:46:20.669089 | mon1 | ok: [mon1] => {
2026-05-28 02:46:20.669158 | mon1 |     "changed": false,
2026-05-28 02:46:20.669167 | mon1 |     "msg": "All assertions passed"
2026-05-28 02:46:20.669175 | mon1 | }
2026-05-28 02:46:20.669183 | mon1 |
2026-05-28 02:46:20.669191 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:46:20.669200 | mon1 | mon1                       : ok=10   changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-28 02:46:20.669208 | mon1 |
2026-05-28 02:46:20.669216 | mon1 |
2026-05-28 02:46:20.669223 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:46:20.669408 | mon1 | Thursday 28 May 2026  02:46:20 +0000 (0:00:00.041)       0:00:26.430 **********
2026-05-28 02:46:20.669593 | mon1 | ===============================================================================
2026-05-28 02:46:20.669784 | mon1 | Get cluster health status ---------------------------------------------- 10.90s
2026-05-28 02:46:20.669975 | mon1 | Create a test Ceph pool ------------------------------------------------- 9.01s
2026-05-28 02:46:20.670192 | mon1 | Create a test Ceph key -------------------------------------------------- 2.60s
2026-05-28 02:46:20.670387 | mon1 | Gathering Facts --------------------------------------------------------- 1.28s
2026-05-28 02:46:20.670579 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.26s
2026-05-28 02:46:20.670780 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.20s
2026-05-28 02:46:20.670973 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.05s
2026-05-28 02:46:20.671195 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.04s
2026-05-28 02:46:20.671390 | mon1 | Print cluster health status --------------------------------------------- 0.04s
2026-05-28 02:46:20.671580 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.04s
2026-05-28 02:46:20.754372 | mon1 | INFO     [default > verify] Executed: Successful
2026-05-28 02:46:20.766246 | mon1 | INFO     [default > cleanup] Executing
2026-05-28 02:46:20.766735 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:46:20.795945 | mon1 | INFO     [default > destroy] Executing
2026-05-28 02:46:20.796131 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-28 02:46:20.796266 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-28 02:46:20.796577 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-05-28 02:46:21.181965 | mon1 | ok: Runtime: 0:13:52.379960
2026-05-28 02:46:21.201793 | 
2026-05-28 02:46:21.201900 | PLAY RECAP
2026-05-28 02:46:21.201964 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:46:21.202001 | 
2026-05-28 02:46:21.347507 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-28 02:46:21.354016 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-28 02:46:21.967704 | 
2026-05-28 02:46:21.967838 | PLAY [all]
2026-05-28 02:46:21.980291 | 
2026-05-28 02:46:21.980386 | TASK [fetch-output : Set log path for multiple nodes]
2026-05-28 02:46:22.045707 | mon1 | ok
2026-05-28 02:46:22.050305 | osd1 | ok
2026-05-28 02:46:22.054960 | 
2026-05-28 02:46:22.055031 | TASK [fetch-output : Set log path for single node]
2026-05-28 02:46:22.078365 | mon1 | skipping: Conditional result was False
2026-05-28 02:46:22.089665 | osd1 | skipping: Conditional result was False
2026-05-28 02:46:22.100322 | 
2026-05-28 02:46:22.100422 | LOOP [fetch-output : Ensure local output dirs]
2026-05-28 02:46:22.482131 | osd1 -> localhost | changed: "/var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/logs/osd1"
2026-05-28 02:46:22.504319 | mon1 -> localhost | changed: "/var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/logs/mon1"
2026-05-28 02:46:22.696166 | mon1 -> localhost | changed: "/var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/artifacts"
2026-05-28 02:46:22.712355 | osd1 -> localhost | ok: "/var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/artifacts"
2026-05-28 02:46:22.910426 | mon1 -> localhost | changed: "/var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/docs"
2026-05-28 02:46:22.920464 | osd1 -> localhost | ok: "/var/lib/zuul/builds/62eb0b50182a40c39b77182c92e373f6/work/docs"
2026-05-28 02:46:22.920583 | osd1 -> localhost | changed: All items complete
2026-05-28 02:46:22.920633 | 
2026-05-28 02:46:22.940222 | 
2026-05-28 02:46:22.940363 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-05-28 02:46:23.581201 | osd1 | changed: .d..t...... ./
2026-05-28 02:46:23.594248 | mon1 | changed: .d..t...... ./
2026-05-28 02:46:24.037466 | osd1 | changed: .d..t...... ./
2026-05-28 02:46:24.054093 | mon1 | changed: .d..t...... ./
2026-05-28 02:46:24.493472 | osd1 | changed: .d..t...... ./
2026-05-28 02:46:24.530237 | mon1 | changed: .d..t...... ./
2026-05-28 02:46:24.530380 | mon1 | changed: All items complete
2026-05-28 02:46:24.530449 | 
2026-05-28 02:46:24.558813 | 
2026-05-28 02:46:24.558936 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-05-28 02:46:24.991886 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006884
2026-05-28 02:46:25.213435 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007626
2026-05-28 02:46:25.234471 | 
2026-05-28 02:46:25.235480 | PLAY [all]
2026-05-28 02:46:25.242229 | 
2026-05-28 02:46:25.242288 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-05-28 02:46:25.731602 | mon1 | changed
2026-05-28 02:46:25.953683 | osd1 | changed
2026-05-28 02:46:25.965661 | 
2026-05-28 02:46:25.965713 | PLAY RECAP
2026-05-28 02:46:25.965757 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-28 02:46:25.965786 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-28 02:46:25.965805 | 
2026-05-28 02:46:26.076768 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-28 02:46:26.082191 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-05-28 02:46:26.665821 | 
2026-05-28 02:46:26.665943 | PLAY [localhost]
2026-05-28 02:46:26.675669 | 
2026-05-28 02:46:26.675744 | TASK [Generate Zuul manifest]
2026-05-28 02:46:26.696118 | localhost | ok
2026-05-28 02:46:26.712935 | 
2026-05-28 02:46:26.713076 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-05-28 02:46:27.098366 | localhost | changed
2026-05-28 02:46:27.110063 | 
2026-05-28 02:46:27.110166 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-05-28 02:46:27.141961 | localhost | ok
2026-05-28 02:46:27.185963 | 
2026-05-28 02:46:27.186082 | TASK [Upload logs]
2026-05-28 02:46:27.215266 | localhost | ok
2026-05-28 02:46:27.335499 | 
2026-05-28 02:46:27.335625 | TASK [Set zuul-log-path fact]
2026-05-28 02:46:27.352329 | localhost | ok
2026-05-28 02:46:27.362924 | 
2026-05-28 02:46:27.362988 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-28 02:46:27.389842 | localhost | ok
2026-05-28 02:46:27.396470 | 
2026-05-28 02:46:27.396535 | TASK [upload-logs : Create log directories]
2026-05-28 02:46:27.798597 | localhost | changed
2026-05-28 02:46:27.804538 | 
2026-05-28 02:46:27.804602 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-05-28 02:46:28.178925 | localhost -> localhost | ok: Runtime: 0:00:00.003892
2026-05-28 02:46:28.186295 | 
2026-05-28 02:46:28.186387 | TASK [upload-logs : Upload logs to log server]
2026-05-28 02:46:28.611209 | localhost | Output suppressed because no_log was given
2026-05-28 02:46:28.616250 | 
2026-05-28 02:46:28.616349 | LOOP [upload-logs : Compress console log and json output]
2026-05-28 02:46:28.685631 | localhost | skipping: Conditional result was False
2026-05-28 02:46:28.692785 | localhost | skipping: Conditional result was False
2026-05-28 02:46:28.712435 | 
2026-05-28 02:46:28.712601 | LOOP [upload-logs : Upload compressed console log and json output]
2026-05-28 02:46:28.786532 | localhost | skipping: Conditional result was False
2026-05-28 02:46:28.786864 | 
2026-05-28 02:46:28.790975 | localhost | skipping: Conditional result was False
2026-05-28 02:46:28.839883 | 
2026-05-28 02:46:28.839992 | LOOP [upload-logs : Upload console log and json output]