2026-05-08 04:10:22.646978 | Job console starting
2026-05-08 04:10:22.684264 | Updating git repos
2026-05-08 04:10:22.792270 | Cloning repos into workspace
2026-05-08 04:10:22.940282 | Restoring repo states
2026-05-08 04:10:22.947954 | Merging changes
2026-05-08 04:10:23.254391 | Checking out repos
2026-05-08 04:10:23.289522 | Preparing playbooks
2026-05-08 04:10:24.950071 | Running Ansible setup
2026-05-08 04:10:29.755216 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-08 04:10:30.387410 | 
2026-05-08 04:10:30.387546 | PLAY [localhost]
2026-05-08 04:10:30.395175 | 
2026-05-08 04:10:30.395244 | TASK [Gathering Facts]
2026-05-08 04:10:31.277921 | localhost | ok
2026-05-08 04:10:31.285596 | 
2026-05-08 04:10:31.285669 | TASK [Setup log path fact]
2026-05-08 04:10:31.305264 | localhost | ok
2026-05-08 04:10:31.317560 | 
2026-05-08 04:10:31.317624 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-08 04:10:31.347450 | localhost | ok
2026-05-08 04:10:31.354457 | 
2026-05-08 04:10:31.354522 | TASK [emit-job-header : Print job information]
2026-05-08 04:10:31.396161 | # Job Information
2026-05-08 04:10:31.396424 | Ansible Version: 2.16.18
2026-05-08 04:10:31.396476 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-05-08 04:10:31.396509 | Pipeline: check
2026-05-08 04:10:31.396538 | Executor: 2d72f0692154
2026-05-08 04:10:31.396567 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/108
2026-05-08 04:10:31.396599 | Event ID: cfeb2c60-4a93-11f1-8c80-efa4176c08e9
2026-05-08 04:10:31.400887 | 
2026-05-08 04:10:31.401004 | LOOP [emit-job-header : Print node information]
2026-05-08 04:10:31.506227 | localhost | ok:
2026-05-08 04:10:31.506592 | localhost | # Node Information
2026-05-08 04:10:31.506657 | localhost | Inventory Hostname: mon1
2026-05-08 04:10:31.506705 | localhost | Hostname: np0000172669
2026-05-08 04:10:31.506749 | localhost | Username: zuul
2026-05-08 04:10:31.506798 | localhost | Distro: Ubuntu 24.04
2026-05-08 04:10:31.506842 | localhost | Provider: yul1
2026-05-08 04:10:31.506884 | localhost | Region: ca-ymq-1
2026-05-08 04:10:31.506925 | localhost | Label: ubuntu-noble
2026-05-08 04:10:31.506965 | localhost | Product Name: OpenStack Nova
2026-05-08 04:10:31.507006 | localhost | Interface IP: 199.204.45.144
2026-05-08 04:10:31.558448 | localhost | ok:
2026-05-08 04:10:31.558583 | localhost | # Node Information
2026-05-08 04:10:31.558625 | localhost | Inventory Hostname: osd1
2026-05-08 04:10:31.558658 | localhost | Hostname: np0000172670
2026-05-08 04:10:31.558688 | localhost | Username: zuul
2026-05-08 04:10:31.558716 | localhost | Distro: Ubuntu 24.04
2026-05-08 04:10:31.558746 | localhost | Provider: yul1
2026-05-08 04:10:31.558776 | localhost | Region: ca-ymq-1
2026-05-08 04:10:31.558805 | localhost | Label: ubuntu-noble
2026-05-08 04:10:31.558834 | localhost | Product Name: OpenStack Nova
2026-05-08 04:10:31.558862 | localhost | Interface IP: 199.204.45.53
2026-05-08 04:10:31.575562 | 
2026-05-08 04:10:31.575706 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-05-08 04:10:31.956985 | localhost -> localhost | changed
2026-05-08 04:10:31.963964 | 
2026-05-08 04:10:31.964065 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-05-08 04:10:32.808343 | localhost -> localhost | changed
2026-05-08 04:10:32.819829 | 
2026-05-08 04:10:32.819886 | PLAY [all]
2026-05-08 04:10:32.828602 | 
2026-05-08 04:10:32.828671 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-05-08 04:10:33.057372 | mon1 -> localhost | ok
2026-05-08 04:10:33.067281 | 
2026-05-08 04:10:33.067368 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-05-08 04:10:33.107371 | mon1 | ok
2026-05-08 04:10:33.113252 | osd1 | ok
2026-05-08 04:10:33.132259 | mon1 | included: /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-08 04:10:33.132315 | osd1 | included: /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-08 04:10:33.138925 | 
2026-05-08 04:10:33.138987 | TASK [add-build-sshkey : Create Temp SSH key]
2026-05-08 04:10:34.289821 | mon1 -> localhost | Generating public/private rsa key pair.
2026-05-08 04:10:34.290037 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/8ed541c1e12f4e4fb80a51c885acfc7d_id_rsa
2026-05-08 04:10:34.290082 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/8ed541c1e12f4e4fb80a51c885acfc7d_id_rsa.pub
2026-05-08 04:10:34.290116 | mon1 -> localhost | The key fingerprint is:
2026-05-08 04:10:34.290149 | mon1 -> localhost | SHA256:Wsq7wUF4F4kUXOEv9FC9vSdVzIg8218taoshWi4TeVc zuul-build-sshkey
2026-05-08 04:10:34.290179 | mon1 -> localhost | The key's randomart image is:
2026-05-08 04:10:34.290208 | mon1 -> localhost | +---[RSA 3072]----+
2026-05-08 04:10:34.290237 | mon1 -> localhost | |     oo++o.o . + |
2026-05-08 04:10:34.290266 | mon1 -> localhost | |     .o..o  = . +|
2026-05-08 04:10:34.290294 | mon1 -> localhost | |    . o =    *  o|
2026-05-08 04:10:34.290324 | mon1 -> localhost | |     o o +  E + +|
2026-05-08 04:10:34.290352 | mon1 -> localhost | |      ..S o. . =.|
2026-05-08 04:10:34.290379 | mon1 -> localhost | |     oo=+.o o o o|
2026-05-08 04:10:34.290407 | mon1 -> localhost | |      ** o + . o |
2026-05-08 04:10:34.290434 | mon1 -> localhost | |      +o. . .    |
2026-05-08 04:10:34.290461 | mon1 -> localhost | |      o+         |
2026-05-08 04:10:34.290488 | mon1 -> localhost | +----[SHA256]-----+
2026-05-08 04:10:34.290600 | mon1 -> localhost | ok: Runtime: 0:00:00.721094
2026-05-08 04:10:34.299386 | 
2026-05-08 04:10:34.299520 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-05-08 04:10:34.340222 | mon1 | ok
2026-05-08 04:10:34.345648 | osd1 | ok
2026-05-08 04:10:34.360542 | mon1 | included: /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-08 04:10:34.360649 | osd1 | included: /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-08 04:10:34.372039 | 
2026-05-08 04:10:34.372122 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-05-08 04:10:34.398339 | mon1 | skipping: Conditional result was False
2026-05-08 04:10:34.409690 | osd1 | skipping: Conditional result was False
2026-05-08 04:10:34.420368 | 
2026-05-08 04:10:34.420439 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-05-08 04:10:34.966841 | mon1 | changed
2026-05-08 04:10:34.975409 | osd1 | changed
2026-05-08 04:10:34.982991 | 
2026-05-08 04:10:34.983054 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-05-08 04:10:35.200289 | mon1 | ok
2026-05-08 04:10:35.219172 | osd1 | ok
2026-05-08 04:10:35.226452 | 
2026-05-08 04:10:35.226541 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-05-08 04:10:35.811199 | mon1 | changed
2026-05-08 04:10:35.861408 | osd1 | changed
2026-05-08 04:10:35.868668 | 
2026-05-08 04:10:35.868753 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-05-08 04:10:36.415044 | mon1 | changed
2026-05-08 04:10:36.422460 | osd1 | changed
2026-05-08 04:10:36.428939 | 
2026-05-08 04:10:36.429023 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-05-08 04:10:36.461618 | mon1 | skipping: Conditional result was False
2026-05-08 04:10:36.483072 | osd1 | skipping: Conditional result was False
2026-05-08 04:10:36.492707 | 
2026-05-08 04:10:36.492799 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-05-08 04:10:36.821795 | mon1 -> localhost | changed
2026-05-08 04:10:36.838837 | 
2026-05-08 04:10:36.838909 | TASK [add-build-sshkey : Add back temp key]
2026-05-08 04:10:37.142616 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/8ed541c1e12f4e4fb80a51c885acfc7d_id_rsa (zuul-build-sshkey)
2026-05-08 04:10:37.142873 | mon1 -> localhost | ok: Runtime: 0:00:00.025250
2026-05-08 04:10:37.148529 | 
2026-05-08 04:10:37.148598 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-05-08 04:10:37.445775 | mon1 | ok
2026-05-08 04:10:37.486832 | osd1 | ok
2026-05-08 04:10:37.492389 | 
2026-05-08 04:10:37.492458 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-05-08 04:10:37.518416 | mon1 | skipping: Conditional result was False
2026-05-08 04:10:37.529500 | osd1 | skipping: Conditional result was False
2026-05-08 04:10:37.549164 | 
2026-05-08 04:10:37.549229 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-05-08 04:10:37.867146 | mon1 | ok
2026-05-08 04:10:37.871820 | osd1 | ok
2026-05-08 04:10:37.877608 | 
2026-05-08 04:10:37.877673 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-05-08 04:10:38.684700 | mon1 | Output suppressed because no_log was given
2026-05-08 04:10:38.691954 | osd1 | Output suppressed because no_log was given
2026-05-08 04:10:38.705846 | 
2026-05-08 04:10:38.705931 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-05-08 04:10:38.924392 | mon1 | ok: "logs"
2026-05-08 04:10:38.924699 | mon1 | ok: All items complete
2026-05-08 04:10:38.924740 | 
2026-05-08 04:10:38.960731 | osd1 | ok: "logs"
2026-05-08 04:10:39.114435 | mon1 | ok: "artifacts"
2026-05-08 04:10:39.160337 | osd1 | ok: "artifacts"
2026-05-08 04:10:39.301463 | mon1 | ok: "docs"
2026-05-08 04:10:39.347109 | osd1 | ok: "docs"
2026-05-08 04:10:39.368522 | 
2026-05-08 04:10:39.368705 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-05-08 04:10:39.591545 | mon1 | changed: "logs"
2026-05-08 04:10:39.855845 | mon1 | ok: All items complete
2026-05-08 04:10:39.856003 | 
2026-05-08 04:10:39.869161 | osd1 | changed: "logs"
2026-05-08 04:10:39.874432 | mon1 | changed: "artifacts"
2026-05-08 04:10:39.878959 | osd1 | changed: "artifacts"
2026-05-08 04:10:39.973687 | mon1 | changed: "docs"
2026-05-08 04:10:40.001367 | osd1 | changed: "docs"
2026-05-08 04:10:40.018049 | 
2026-05-08 04:10:40.018566 | PLAY RECAP
2026-05-08 04:10:40.018622 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:10:40.018654 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-08 04:10:40.018680 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-08 04:10:40.018699 | 
2026-05-08 04:10:40.205712 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-08 04:10:40.210805 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-08 04:10:40.790095 | 
2026-05-08 04:10:40.790244 | PLAY [all]
2026-05-08 04:10:40.802619 | 
2026-05-08 04:10:40.802721 | TASK [setup-uv : Extract archive]
2026-05-08 04:10:43.150226 | osd1 | changed
2026-05-08 04:10:43.168502 | mon1 | changed
2026-05-08 04:10:43.176841 | 
2026-05-08 04:10:43.176928 | TASK [setup-uv : Print version]
2026-05-08 04:10:43.582783 | osd1 | uv 0.8.13
2026-05-08 04:10:43.582205 | mon1 | uv 0.8.13
2026-05-08 04:10:43.756155 | mon1 | ok: Runtime: 0:00:00.014462
2026-05-08 04:10:43.767312 | osd1 | ok: Runtime: 0:00:00.017950
2026-05-08 04:10:43.777949 | 
2026-05-08 04:10:43.777998 | PLAY RECAP
2026-05-08 04:10:43.778044 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:10:43.778084 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:10:43.778105 | 
2026-05-08 04:10:43.938335 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-08 04:10:44.048658 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-08 04:10:44.682449 | 
2026-05-08 04:10:44.682608 | PLAY [all]
2026-05-08 04:10:44.694519 | 
2026-05-08 04:10:44.694592 | TASK [Copy inventory file for Zuul]
2026-05-08 04:10:45.646282 | mon1 | changed
2026-05-08 04:10:45.653087 | 
2026-05-08 04:10:45.653163 | TASK [Switch "ansible_host" to private IP]
2026-05-08 04:10:46.002660 | mon1 | changed: 2 replacements made
2026-05-08 04:10:46.010481 | 
2026-05-08 04:10:46.010550 | TASK [Run Molecule scenario]
2026-05-08 04:10:46.457582 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3
2026-05-08 04:10:46.457843 | mon1 | Creating virtual environment at: .venv
2026-05-08 04:10:46.712372 | mon1 | Downloading pygments (1.2MiB)
2026-05-08 04:10:46.712647 | mon1 | Downloading cryptography (4.3MiB)
2026-05-08 04:10:46.712920 | mon1 | Downloading netaddr (2.2MiB)
2026-05-08 04:10:46.713731 | mon1 | Downloading ansible-core (2.1MiB)
2026-05-08 04:10:46.902686 | mon1 |  Downloading netaddr
2026-05-08 04:10:46.911958 | mon1 |  Downloading cryptography
2026-05-08 04:10:46.969676 | mon1 |  Downloading pygments
2026-05-08 04:10:47.127060 | mon1 |  Downloading ansible-core
2026-05-08 04:10:47.174392 | mon1 | Installed 37 packages in 46ms
2026-05-08 04:10:47.927030 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-05-08 04:10:47.927129 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-05-08 04:10:48.589496 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-05-08 04:10:48.589547 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-05-08 04:11:08.607419 | mon1 | INFO     [default > dependency] Executing
2026-05-08 04:11:08.607743 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-05-08 04:11:08.608083 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-05-08 04:11:08.608288 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-05-08 04:11:08.614418 | mon1 | INFO     [default > cleanup] Executing
2026-05-08 04:11:08.614782 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:11:08.620527 | mon1 | INFO     [default > destroy] Executing
2026-05-08 04:11:08.620625 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-08 04:11:08.620731 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-08 04:11:08.626353 | mon1 | INFO     [default > syntax] Executing
2026-05-08 04:11:09.706453 | mon1 |
2026-05-08 04:11:09.706824 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-05-08 04:11:09.797091 | mon1 | INFO     [default > syntax] Executed: Successful
2026-05-08 04:11:09.809019 | mon1 | INFO     [default > create] Executing
2026-05-08 04:11:09.810578 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:11:09.816615 | mon1 | INFO     [default > prepare] Executing
2026-05-08 04:11:10.644188 | mon1 |
2026-05-08 04:11:10.644281 | mon1 | PLAY [Prepare] *****************************************************************
2026-05-08 04:11:10.644420 | mon1 |
2026-05-08 04:11:10.644580 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:11:10.644748 | mon1 | Friday 08 May 2026  04:11:10 +0000 (0:00:00.034)       0:00:00.034 ************
2026-05-08 04:11:11.910561 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:11:11.910824 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:11:11.911101 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:11:11.911337 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:11:11.911587 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:11:11.961085 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-08 04:11:11.961308 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:11:11.961552 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:11:11.961826 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:11:11.962077 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:11:11.971311 | mon1 | ok: [mon1]
2026-05-08 04:11:11.971572 | mon1 | ok: [osd1]
2026-05-08 04:11:11.971812 | mon1 |
2026-05-08 04:11:11.972110 | mon1 | TASK [Configure short hostname] ************************************************
2026-05-08 04:11:11.972379 | mon1 | Friday 08 May 2026  04:11:11 +0000 (0:00:01.327)       0:00:01.362 ************
2026-05-08 04:11:12.762619 | mon1 | changed: [mon1]
2026-05-08 04:11:12.762903 | mon1 | changed: [osd1]
2026-05-08 04:11:12.763133 | mon1 |
2026-05-08 04:11:12.763462 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-05-08 04:11:12.763725 | mon1 | Friday 08 May 2026  04:11:12 +0000 (0:00:00.790)       0:00:02.153 ************
2026-05-08 04:11:13.094438 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-05-08 04:11:13.094677 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-05-08 04:11:13.094988 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-05-08 04:11:13.105409 | mon1 | changed: [osd1]
2026-05-08 04:11:13.105567 | mon1 | changed: [mon1]
2026-05-08 04:11:13.105718 | mon1 |
2026-05-08 04:11:13.105905 | mon1 | TASK [Update apt cache] ********************************************************
2026-05-08 04:11:13.106072 | mon1 | Friday 08 May 2026  04:11:13 +0000 (0:00:00.343)       0:00:02.496 ************
2026-05-08 04:11:37.088299 | mon1 | changed: [mon1]
2026-05-08 04:11:37.088546 | mon1 | changed: [osd1]
2026-05-08 04:11:37.088783 | mon1 |
2026-05-08 04:11:37.089074 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-05-08 04:11:37.089303 | mon1 |
2026-05-08 04:11:37.089568 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:11:37.089862 | mon1 | Friday 08 May 2026  04:11:37 +0000 (0:00:23.982)       0:00:26.479 ************
2026-05-08 04:11:37.896540 | mon1 | ok: [osd1]
2026-05-08 04:11:37.896629 | mon1 |
2026-05-08 04:11:37.896644 | mon1 | TASK [Install depedencies] *****************************************************
2026-05-08 04:11:37.896664 | mon1 | Friday 08 May 2026  04:11:37 +0000 (0:00:00.808)       0:00:27.287 ************
2026-05-08 04:11:57.176871 | mon1 | changed: [osd1]
2026-05-08 04:11:57.177011 | mon1 |
2026-05-08 04:11:57.177128 | mon1 | TASK [Start up service] ********************************************************
2026-05-08 04:11:57.177309 | mon1 | Friday 08 May 2026  04:11:57 +0000 (0:00:19.279)       0:00:46.567 ************
2026-05-08 04:11:57.845228 | mon1 | ok: [osd1]
2026-05-08 04:11:57.845322 | mon1 |
2026-05-08 04:11:57.845409 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-05-08 04:11:57.845522 | mon1 | Friday 08 May 2026  04:11:57 +0000 (0:00:00.668)       0:00:47.236 ************
2026-05-08 04:11:58.198328 | mon1 | ok: [osd1]
2026-05-08 04:11:58.198382 | mon1 |
2026-05-08 04:11:58.198479 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-05-08 04:11:58.198602 | mon1 | Friday 08 May 2026  04:11:58 +0000 (0:00:00.352)       0:00:47.588 ************
2026-05-08 04:11:58.998288 | mon1 | changed: [osd1]
2026-05-08 04:11:58.998390 | mon1 |
2026-05-08 04:11:58.998536 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-05-08 04:11:58.998675 | mon1 | Friday 08 May 2026  04:11:58 +0000 (0:00:00.799)       0:00:48.388 ************
2026-05-08 04:11:59.256963 | mon1 | ok: [osd1]
2026-05-08 04:11:59.257201 | mon1 |
2026-05-08 04:11:59.257591 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-05-08 04:11:59.257974 | mon1 | Friday 08 May 2026  04:11:59 +0000 (0:00:00.258)       0:00:48.647 ************
2026-05-08 04:11:59.288917 | mon1 | skipping: [osd1]
2026-05-08 04:11:59.289206 | mon1 |
2026-05-08 04:11:59.289443 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-05-08 04:11:59.289693 | mon1 | Friday 08 May 2026  04:11:59 +0000 (0:00:00.033)       0:00:48.680 ************
2026-05-08 04:11:59.989434 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:11:59.989523 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:11:59.989650 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:11:59.989779 | mon1 |
2026-05-08 04:11:59.989958 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-05-08 04:11:59.990126 | mon1 | Friday 08 May 2026  04:11:59 +0000 (0:00:00.699)       0:00:49.380 ************
2026-05-08 04:12:00.762401 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:12:00.762556 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:12:00.762849 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:12:00.763172 | mon1 |
2026-05-08 04:12:00.763371 | mon1 | TASK [Start loop devices] ******************************************************
2026-05-08 04:12:00.763609 | mon1 | Friday 08 May 2026  04:12:00 +0000 (0:00:00.773)       0:00:50.153 ************
2026-05-08 04:12:01.591151 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:12:01.591268 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:12:01.591405 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:12:01.591589 | mon1 |
2026-05-08 04:12:01.591700 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-05-08 04:12:01.591871 | mon1 | Friday 08 May 2026  04:12:01 +0000 (0:00:00.828)       0:00:50.982 ************
2026-05-08 04:12:03.031464 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:12:03.031592 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:12:03.031778 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:12:03.031952 | mon1 |
2026-05-08 04:12:03.032152 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-05-08 04:12:03.032311 | mon1 | Friday 08 May 2026  04:12:03 +0000 (0:00:01.440)       0:00:52.422 ************
2026-05-08 04:12:04.428953 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-05-08 04:12:04.429046 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-05-08 04:12:04.429068 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-05-08 04:12:04.430319 | mon1 |
2026-05-08 04:12:04.430433 | mon1 | PLAY [Enable loopback precheck skip for coverage] ******************************
2026-05-08 04:12:04.430445 | mon1 |
2026-05-08 04:12:04.430455 | mon1 | TASK [Set loopback precheck skip variable] *************************************
2026-05-08 04:12:04.430464 | mon1 | Friday 08 May 2026  04:12:04 +0000 (0:00:01.396)       0:00:53.819 ************
2026-05-08 04:12:04.471076 | mon1 | ok: [osd1]
2026-05-08 04:12:04.471114 | mon1 |
2026-05-08 04:12:04.471125 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-05-08 04:12:04.471135 | mon1 |
2026-05-08 04:12:04.471145 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:12:04.471154 | mon1 | Friday 08 May 2026  04:12:04 +0000 (0:00:00.041)       0:00:53.860 ************
2026-05-08 04:12:05.442970 | mon1 | ok: [osd1]
2026-05-08 04:12:05.443049 | mon1 |
2026-05-08 04:12:05.443317 | mon1 | TASK [Install depedencies] *****************************************************
2026-05-08 04:12:05.443601 | mon1 | Friday 08 May 2026  04:12:05 +0000 (0:00:00.972)       0:00:54.833 ************
2026-05-08 04:12:06.580961 | mon1 | ok: [osd1]
2026-05-08 04:12:06.581043 | mon1 |
2026-05-08 04:12:06.581054 | mon1 | TASK [Start up service] ********************************************************
2026-05-08 04:12:06.581064 | mon1 | Friday 08 May 2026  04:12:06 +0000 (0:00:01.137)       0:00:55.970 ************
2026-05-08 04:12:07.024535 | mon1 | ok: [osd1]
2026-05-08 04:12:07.024654 | mon1 |
2026-05-08 04:12:07.024849 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-05-08 04:12:07.025074 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.444)       0:00:56.415 ************
2026-05-08 04:12:07.328496 | mon1 | ok: [osd1]
2026-05-08 04:12:07.328563 | mon1 |
2026-05-08 04:12:07.328574 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-05-08 04:12:07.328586 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.302)       0:00:56.717 ************
2026-05-08 04:12:07.880024 | mon1 | ok: [osd1]
2026-05-08 04:12:07.880079 | mon1 |
2026-05-08 04:12:07.880086 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-05-08 04:12:07.880092 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.552)       0:00:57.269 ************
2026-05-08 04:12:07.915161 | mon1 | skipping: [osd1]
2026-05-08 04:12:07.915191 | mon1 |
2026-05-08 04:12:07.915203 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-05-08 04:12:07.915213 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.035)       0:00:57.305 ************
2026-05-08 04:12:07.948048 | mon1 | skipping: [osd1]
2026-05-08 04:12:07.948076 | mon1 |
2026-05-08 04:12:07.948086 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-05-08 04:12:07.948118 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.032)       0:00:57.338 ************
2026-05-08 04:12:08.624956 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:08.625022 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:08.625032 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:08.625042 | mon1 |
2026-05-08 04:12:08.625052 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-05-08 04:12:08.625061 | mon1 | Friday 08 May 2026  04:12:08 +0000 (0:00:00.676)       0:00:58.014 ************
2026-05-08 04:12:09.323024 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:09.323095 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:09.323106 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:09.323116 | mon1 |
2026-05-08 04:12:09.323126 | mon1 | TASK [Start loop devices] ******************************************************
2026-05-08 04:12:09.323143 | mon1 | Friday 08 May 2026  04:12:09 +0000 (0:00:00.697)       0:00:58.712 ************
2026-05-08 04:12:10.001314 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:10.001396 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:10.001407 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:10.001417 | mon1 |
2026-05-08 04:12:10.001428 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-05-08 04:12:10.001472 | mon1 | Friday 08 May 2026  04:12:09 +0000 (0:00:00.678)       0:00:59.390 ************
2026-05-08 04:12:11.030998 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:11.031068 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:11.031078 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:11.031088 | mon1 |
2026-05-08 04:12:11.031098 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-05-08 04:12:11.031108 | mon1 | Friday 08 May 2026  04:12:11 +0000 (0:00:01.029)       0:01:00.419 ************
2026-05-08 04:12:12.217949 | mon1 | ok: [osd1] => (item=ceph-osd1-osd0)
2026-05-08 04:12:12.219995 | mon1 | ok: [osd1] => (item=ceph-osd1-osd1)
2026-05-08 04:12:12.220080 | mon1 | ok: [osd1] => (item=ceph-osd1-osd2)
2026-05-08 04:12:12.220094 | mon1 |
2026-05-08 04:12:12.220107 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:12:12.220120 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-08 04:12:12.220133 | mon1 | osd1                       : ok=26   changed=10   unreachable=0    failed=0    skipped=3    rescued=0    ignored=0
2026-05-08 04:12:12.220145 | mon1 |
2026-05-08 04:12:12.220156 | mon1 |
2026-05-08 04:12:12.220168 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:12:12.220179 | mon1 | Friday 08 May 2026  04:12:12 +0000 (0:00:01.188)       0:01:01.608 ************
2026-05-08 04:12:12.220191 | mon1 | ===============================================================================
2026-05-08 04:12:12.220202 | mon1 | Update apt cache ------------------------------------------------------- 23.98s
2026-05-08 04:12:12.220215 | mon1 | Install depedencies ---------------------------------------------------- 19.28s
2026-05-08 04:12:12.220226 | mon1 | Create a volume group for each loop device ------------------------------ 1.44s
2026-05-08 04:12:12.220237 | mon1 | Create a logical volume for each loop device ---------------------------- 1.40s
2026-05-08 04:12:12.220248 | mon1 | Gathering Facts --------------------------------------------------------- 1.33s
2026-05-08 04:12:12.220267 | mon1 | Create a logical volume for each loop device ---------------------------- 1.19s
2026-05-08 04:12:12.220279 | mon1 | Install depedencies ----------------------------------------------------- 1.14s
2026-05-08 04:12:12.220290 | mon1 | Create a volume group for each loop device ------------------------------ 1.03s
2026-05-08 04:12:12.220302 | mon1 | Gathering Facts --------------------------------------------------------- 0.97s
2026-05-08 04:12:12.220843 | mon1 | Start loop devices ------------------------------------------------------ 0.83s
2026-05-08 04:12:12.220868 | mon1 | Gathering Facts --------------------------------------------------------- 0.81s
2026-05-08 04:12:12.220874 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.80s
2026-05-08 04:12:12.220894 | mon1 | Configure short hostname ------------------------------------------------ 0.79s
2026-05-08 04:12:12.220898 | mon1 | Set permissions on loopback devices ------------------------------------- 0.77s
2026-05-08 04:12:12.221012 | mon1 | Create devices for Ceph ------------------------------------------------- 0.70s
2026-05-08 04:12:12.221150 | mon1 | Set permissions on loopback devices ------------------------------------- 0.70s
2026-05-08 04:12:12.221286 | mon1 | Start loop devices ------------------------------------------------------ 0.68s
2026-05-08 04:12:12.221422 | mon1 | Create devices for Ceph ------------------------------------------------- 0.68s
2026-05-08 04:12:12.221555 | mon1 | Start up service -------------------------------------------------------- 0.67s
2026-05-08 04:12:12.221689 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.55s
2026-05-08 04:12:12.358403 | mon1 | INFO     [default > prepare] Executed: Successful
2026-05-08 04:12:12.372485 | mon1 | INFO     [default > converge] Executing
2026-05-08 04:12:13.346516 | mon1 |
2026-05-08 04:12:13.347852 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-08 04:12:13.347883 | mon1 |
2026-05-08 04:12:13.347895 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:12:13.347905 | mon1 | Friday 08 May 2026  04:12:13 +0000 (0:00:00.053)       0:00:00.053 ************
2026-05-08 04:12:15.439945 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:12:15.440012 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:12:15.440024 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:12:15.440034 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:12:15.440050 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:12:15.452389 | mon1 | ok: [mon1]
2026-05-08 04:12:15.452494 | mon1 |
2026-05-08 04:12:15.452610 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:12:15.452721 | mon1 | Friday 08 May 2026  04:12:15 +0000 (0:00:02.106)       0:00:02.160 ************
2026-05-08 04:12:15.787322 | mon1 | ok: [mon1]
2026-05-08 04:12:15.787388 | mon1 |
2026-05-08 04:12:15.787490 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:12:15.787630 | mon1 | Friday 08 May 2026  04:12:15 +0000 (0:00:00.334)       0:00:02.495 ************
2026-05-08 04:12:15.834763 | mon1 | skipping: [mon1]
2026-05-08 04:12:15.834879 | mon1 |
2026-05-08 04:12:15.834892 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:12:15.834926 | mon1 | Friday 08 May 2026  04:12:15 +0000 (0:00:00.046)       0:00:02.542 ************
2026-05-08 04:12:16.193933 | mon1 | changed: [mon1]
2026-05-08 04:12:16.194002 | mon1 |
2026-05-08 04:12:16.194023 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:12:16.194136 | mon1 | Friday 08 May 2026  04:12:16 +0000 (0:00:00.359)       0:00:02.901 ************
2026-05-08 04:12:16.299482 | mon1 | ok: [mon1] => {
2026-05-08 04:12:16.299583 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:12:16.299693 | mon1 | }
2026-05-08 04:12:16.299823 | mon1 |
2026-05-08 04:12:16.300085 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:12:16.300123 | mon1 | Friday 08 May 2026  04:12:16 +0000 (0:00:00.106)       0:00:03.007 ************
2026-05-08 04:12:16.989342 | mon1 | changed: [mon1]
2026-05-08 04:12:16.989423 | mon1 |
2026-05-08 04:12:16.989512 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:12:16.989624 | mon1 | Friday 08 May 2026  04:12:16 +0000 (0:00:00.689)       0:00:03.697 ************
2026-05-08 04:12:17.043144 | mon1 | skipping: [mon1]
2026-05-08 04:12:17.043242 | mon1 |
2026-05-08 04:12:17.044067 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:12:17.044186 | mon1 | Friday 08 May 2026  04:12:17 +0000 (0:00:00.053)       0:00:03.751 ************
2026-05-08 04:12:17.092519 | mon1 | skipping: [mon1]
2026-05-08 04:12:17.092561 | mon1 |
2026-05-08 04:12:17.092571 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:12:17.092581 | mon1 | Friday 08 May 2026  04:12:17 +0000 (0:00:00.048)       0:00:03.800 ************
2026-05-08 04:12:17.350448 | mon1 | ok: [mon1]
2026-05-08 04:12:17.350517 | mon1 |
2026-05-08 04:12:17.350569 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:12:17.350744 | mon1 | Friday 08 May 2026  04:12:17 +0000 (0:00:00.258)       0:00:04.058 ************
2026-05-08 04:12:18.603590 | mon1 | ok: [mon1]
2026-05-08 04:12:18.603659 | mon1 |
2026-05-08 04:12:18.603670 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:12:18.603680 | mon1 | Friday 08 May 2026  04:12:18 +0000 (0:00:01.252)       0:00:05.310 ************
2026-05-08 04:12:18.787959 | mon1 | ok: [mon1] => {
2026-05-08 04:12:18.788040 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:12:18.788051 | mon1 | }
2026-05-08 04:12:18.788061 | mon1 |
2026-05-08 04:12:18.788072 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:12:18.788091 | mon1 | Friday 08 May 2026  04:12:18 +0000 (0:00:00.185)       0:00:05.495 ************
2026-05-08 04:12:19.661514 | mon1 | changed: [mon1]
2026-05-08 04:12:19.661577 | mon1 |
2026-05-08 04:12:19.661588 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:12:19.661598 | mon1 | Friday 08 May 2026  04:12:19 +0000 (0:00:00.872)       0:00:06.368 ************
2026-05-08 04:12:22.890060 | mon1 | changed: [mon1]
2026-05-08 04:12:22.890107 | mon1 |
2026-05-08 04:12:22.890112 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:12:22.890118 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:03.229)       0:00:09.597 ************
2026-05-08 04:12:22.924769 | mon1 | skipping: [mon1]
2026-05-08 04:12:22.924883 | mon1 |
2026-05-08 04:12:22.924895 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:12:22.924906 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:00.034)       0:00:09.631 ************
2026-05-08 04:12:22.953559 | mon1 | skipping: [mon1]
2026-05-08 04:12:22.953655 | mon1 |
2026-05-08 04:12:22.953667 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:12:22.953677 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:00.028)       0:00:09.660 ************
2026-05-08 04:12:22.986637 | mon1 | skipping: [mon1]
2026-05-08 04:12:22.986715 | mon1 |
2026-05-08 04:12:22.986726 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:12:22.986736 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:00.033)       0:00:09.693 ************
2026-05-08 04:12:31.095621 | mon1 | changed: [mon1]
2026-05-08 04:12:31.095697 | mon1 |
2026-05-08 04:12:31.095712 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:12:31.095726 | mon1 | Friday 08 May 2026  04:12:31 +0000 (0:00:08.108)       0:00:17.802 ************
2026-05-08 04:12:31.751355 | mon1 | changed: [mon1]
2026-05-08 04:12:31.751428 | mon1 |
2026-05-08 04:12:31.751535 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:12:31.751648 | mon1 | Friday 08 May 2026  04:12:31 +0000 (0:00:00.655)       0:00:18.458 ************
2026-05-08 04:12:32.843426 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-05-08 04:12:32.843512 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:12:32.843561 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:12:32.844153 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:12:32.844199 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:12:32.844205 | mon1 |
2026-05-08 04:12:32.844211 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:12:32.844230 | mon1 | Friday 08 May 2026  04:12:32 +0000 (0:00:01.093)       0:00:19.551 ************
2026-05-08 04:12:33.595915 | mon1 | changed: [mon1]
2026-05-08 04:12:33.595991 | mon1 |
2026-05-08 04:12:33.596002 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:12:33.596012 | mon1 | Friday 08 May 2026  04:12:33 +0000 (0:00:00.743)       0:00:20.295 ************
2026-05-08 04:12:33.596020 | mon1 |
2026-05-08 04:12:33.596029 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:12:33.596074 | mon1 | Friday 08 May 2026  04:12:33 +0000 (0:00:00.007)       0:00:20.302 ************
2026-05-08 04:12:34.703849 | mon1 | ok: [mon1]
2026-05-08 04:12:34.703884 | mon1 |
2026-05-08 04:12:34.703894 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-08 04:12:34.704147 | mon1 | Friday 08 May 2026  04:12:34 +0000 (0:00:01.108)       0:00:21.411 ************
2026-05-08 04:12:35.309178 | mon1 | changed: [mon1]
2026-05-08 04:12:35.309400 | mon1 |
2026-05-08 04:12:35.309662 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:12:35.310021 | mon1 | Friday 08 May 2026  04:12:35 +0000 (0:00:00.605)       0:00:22.017 ************
2026-05-08 04:12:35.985361 | mon1 | changed: [mon1]
2026-05-08 04:12:35.985423 | mon1 |
2026-05-08 04:12:35.985542 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:12:35.988823 | mon1 | Friday 08 May 2026  04:12:35 +0000 (0:00:00.676)       0:00:22.693 ************
2026-05-08 04:12:36.247402 | mon1 | ok: [mon1]
2026-05-08 04:12:36.247615 | mon1 |
2026-05-08 04:12:36.247894 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:12:36.248136 | mon1 | Friday 08 May 2026  04:12:36 +0000 (0:00:00.261)       0:00:22.955 ************
2026-05-08 04:12:36.322193 | mon1 | ok: [mon1] => {
2026-05-08 04:12:36.322474 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:12:36.322706 | mon1 | }
2026-05-08 04:12:36.322956 | mon1 |
2026-05-08 04:12:36.323205 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:12:36.323446 | mon1 | Friday 08 May 2026  04:12:36 +0000 (0:00:00.075)       0:00:23.030 ************
2026-05-08 04:12:37.286772 | mon1 | changed: [mon1]
2026-05-08 04:12:37.287228 | mon1 |
2026-05-08 04:12:37.287566 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:12:37.287924 | mon1 | Friday 08 May 2026  04:12:37 +0000 (0:00:00.964)       0:00:23.995 ************
2026-05-08 04:12:42.902750 | mon1 | changed: [mon1]
2026-05-08 04:12:42.903180 | mon1 |
2026-05-08 04:12:42.903512 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:12:42.903850 | mon1 | Friday 08 May 2026  04:12:42 +0000 (0:00:05.607)       0:00:29.602 ************
2026-05-08 04:12:43.857333 | mon1 | ok: [mon1]
2026-05-08 04:12:43.857563 | mon1 |
2026-05-08 04:12:43.857764 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:12:43.857996 | mon1 | Friday 08 May 2026  04:12:43 +0000 (0:00:00.962)       0:00:30.565 ************
2026-05-08 04:12:44.235601 | mon1 | changed: [mon1]
2026-05-08 04:12:44.235897 | mon1 |
2026-05-08 04:12:44.236123 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:12:44.236331 | mon1 | Friday 08 May 2026  04:12:44 +0000 (0:00:00.377)       0:00:30.943 ************
2026-05-08 04:12:44.791138 | mon1 | changed: [mon1]
2026-05-08 04:12:44.793203 | mon1 |
2026-05-08 04:12:44.793216 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:12:44.793221 | mon1 | Friday 08 May 2026  04:12:44 +0000 (0:00:00.556)       0:00:31.500 ************
2026-05-08 04:12:45.468587 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-05-08 04:12:45.469018 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:12:45.469389 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:12:45.469682 | mon1 |
2026-05-08 04:12:45.470033 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:12:45.470371 | mon1 | Friday 08 May 2026  04:12:45 +0000 (0:00:00.676)       0:00:32.176 ************
2026-05-08 04:12:46.008153 | mon1 | changed: [mon1]
2026-05-08 04:12:46.008317 | mon1 |
2026-05-08 04:12:46.008463 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:12:46.008602 | mon1 | Friday 08 May 2026  04:12:46 +0000 (0:00:00.539)       0:00:32.716 ************
2026-05-08 04:12:46.552948 | mon1 | changed: [mon1]
2026-05-08 04:12:46.553003 | mon1 |
2026-05-08 04:12:46.553137 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:12:46.553585 | mon1 | Friday 08 May 2026  04:12:46 +0000 (0:00:00.538)       0:00:33.255 ************
2026-05-08 04:12:46.553611 | mon1 |
2026-05-08 04:12:46.553616 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:12:46.553620 | mon1 | Friday 08 May 2026  04:12:46 +0000 (0:00:00.006)       0:00:33.262 ************
2026-05-08 04:12:47.411284 | mon1 | ok: [mon1]
2026-05-08 04:12:47.411327 | mon1 |
2026-05-08 04:12:47.411337 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-08 04:12:47.411346 | mon1 | Friday 08 May 2026  04:12:47 +0000 (0:00:00.856)       0:00:34.118 ************
2026-05-08 04:12:48.389293 | mon1 | changed: [mon1]
2026-05-08 04:12:48.389352 | mon1 |
2026-05-08 04:12:48.389366 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:12:48.389379 | mon1 | Friday 08 May 2026  04:12:48 +0000 (0:00:00.977)       0:00:35.096 ************
2026-05-08 04:12:49.057696 | mon1 | changed: [mon1]
2026-05-08 04:12:49.057790 | mon1 |
2026-05-08 04:12:49.057842 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:12:49.057855 | mon1 | Friday 08 May 2026  04:12:49 +0000 (0:00:00.668)       0:00:35.764 ************
2026-05-08 04:12:49.113578 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-08 04:12:49.113652 | mon1 |
2026-05-08 04:12:49.113667 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:12:49.113680 | mon1 | Friday 08 May 2026  04:12:49 +0000 (0:00:00.055)       0:00:35.820 ************
2026-05-08 04:13:07.287482 | mon1 | changed: [mon1]
2026-05-08 04:13:07.287542 | mon1 |
2026-05-08 04:13:07.287555 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:13:07.287584 | mon1 | Friday 08 May 2026  04:13:07 +0000 (0:00:18.174)       0:00:53.995 ************
2026-05-08 04:13:08.085687 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-05-08 04:13:08.085746 | mon1 | ok: [mon1] => (item=ssh)
2026-05-08 04:13:08.085760 | mon1 |
2026-05-08 04:13:08.085773 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:13:08.085785 | mon1 | Friday 08 May 2026  04:13:08 +0000 (0:00:00.796)       0:00:54.792 ************
2026-05-08 04:13:08.519298 | mon1 | changed: [mon1]
2026-05-08 04:13:08.519388 | mon1 |
2026-05-08 04:13:08.519402 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:13:08.519414 | mon1 | Friday 08 May 2026  04:13:08 +0000 (0:00:00.434)       0:00:55.226 ************
2026-05-08 04:13:08.754299 | mon1 | ok: [mon1]
2026-05-08 04:13:08.754377 | mon1 |
2026-05-08 04:13:08.754535 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:13:08.754761 | mon1 | Friday 08 May 2026  04:13:08 +0000 (0:00:00.235)       0:00:55.461 ************
2026-05-08 04:13:09.338216 | mon1 | changed: [mon1]
2026-05-08 04:13:09.338286 | mon1 |
2026-05-08 04:13:09.338393 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:13:09.338504 | mon1 | Friday 08 May 2026  04:13:09 +0000 (0:00:00.584)       0:00:56.046 ************
2026-05-08 04:13:09.722209 | mon1 | changed: [mon1]
2026-05-08 04:13:09.722271 | mon1 |
2026-05-08 04:13:09.722394 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-08 04:13:09.722512 | mon1 | Friday 08 May 2026  04:13:09 +0000 (0:00:00.384)       0:00:56.430 ************
2026-05-08 04:13:09.845293 | mon1 | ok: [mon1]
2026-05-08 04:13:09.845324 | mon1 |
2026-05-08 04:13:09.845335 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-08 04:13:09.845344 | mon1 | Friday 08 May 2026  04:13:09 +0000 (0:00:00.122)       0:00:56.552 ************
2026-05-08 04:13:10.102354 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:13:10.102411 | mon1 |
2026-05-08 04:13:10.102422 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-08 04:13:10.102432 | mon1 | Friday 08 May 2026  04:13:10 +0000 (0:00:00.256)       0:00:56.809 ************
2026-05-08 04:13:10.158066 | mon1 | ok: [mon1]
2026-05-08 04:13:10.158096 | mon1 |
2026-05-08 04:13:10.158107 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-08 04:13:10.158116 | mon1 | Friday 08 May 2026  04:13:10 +0000 (0:00:00.055)       0:00:56.865 ************
2026-05-08 04:13:10.298855 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-05-08 04:13:10.298889 | mon1 |
2026-05-08 04:13:10.299032 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-05-08 04:13:10.299346 | mon1 | Friday 08 May 2026  04:13:10 +0000 (0:00:00.141)       0:00:57.006 ************
2026-05-08 04:13:10.616470 | mon1 | changed: [mon1]
2026-05-08 04:13:10.616851 | mon1 |
2026-05-08 04:13:10.617192 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-05-08 04:13:10.617515 | mon1 | Friday 08 May 2026  04:13:10 +0000 (0:00:00.317)       0:00:57.324 ************
2026-05-08 04:13:11.413362 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-05-08 04:13:11.413664 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-05-08 04:13:11.414539 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-05-08 04:13:11.414562 | mon1 |
2026-05-08 04:13:11.414571 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-05-08 04:13:11.414578 | mon1 | Friday 08 May 2026  04:13:11 +0000 (0:00:00.789)       0:00:58.113 ************
2026-05-08 04:14:42.968630 | mon1 | ok: [mon1]
2026-05-08 04:14:42.968673 | mon1 |
2026-05-08 04:14:42.968680 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-05-08 04:14:42.968686 | mon1 | Friday 08 May 2026  04:14:42 +0000 (0:01:31.561)       0:02:29.674 ************
2026-05-08 04:14:43.253567 | mon1 | changed: [mon1]
2026-05-08 04:14:43.253628 | mon1 |
2026-05-08 04:14:43.253751 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-05-08 04:14:43.253893 | mon1 | Friday 08 May 2026  04:14:43 +0000 (0:00:00.287)       0:02:29.962 ************
2026-05-08 04:14:43.304524 | mon1 | ok: [mon1]
2026-05-08 04:14:43.304543 | mon1 |
2026-05-08 04:14:43.304549 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:14:43.304555 | mon1 | Friday 08 May 2026  04:14:43 +0000 (0:00:00.048)       0:02:30.011 ************
2026-05-08 04:14:43.379076 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:14:43.379093 | mon1 |
2026-05-08 04:14:43.379099 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:14:43.379104 | mon1 | Friday 08 May 2026  04:14:43 +0000 (0:00:00.076)       0:02:30.088 ************
2026-05-08 04:14:50.271217 | mon1 | ok: [mon1]
2026-05-08 04:14:50.271289 | mon1 |
2026-05-08 04:14:50.271451 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:14:50.271572 | mon1 | Friday 08 May 2026  04:14:50 +0000 (0:00:06.891)       0:02:36.979 ************
2026-05-08 04:14:50.327924 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:14:50.327975 | mon1 |
2026-05-08 04:14:50.328412 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:14:50.328448 | mon1 | Friday 08 May 2026  04:14:50 +0000 (0:00:00.056)       0:02:37.036 ************
2026-05-08 04:14:50.740980 | mon1 | ok: [mon1]
2026-05-08 04:14:50.741163 | mon1 |
2026-05-08 04:14:50.741423 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:14:50.741666 | mon1 | Friday 08 May 2026  04:14:50 +0000 (0:00:00.413)       0:02:37.449 ************
2026-05-08 04:14:57.488288 | mon1 | ok: [mon1]
2026-05-08 04:14:57.488355 | mon1 |
2026-05-08 04:14:57.488574 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-08 04:14:57.488607 | mon1 | Friday 08 May 2026  04:14:57 +0000 (0:00:06.747)       0:02:44.196 ************
2026-05-08 04:15:43.769592 | mon1 | changed: [mon1]
2026-05-08 04:15:43.769630 | mon1 |
2026-05-08 04:15:43.769636 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-08 04:15:43.769642 | mon1 | Friday 08 May 2026  04:15:43 +0000 (0:00:46.281)       0:03:30.477 ************
2026-05-08 04:15:58.082291 | mon1 | ok: [mon1]
2026-05-08 04:15:58.082356 | mon1 |
2026-05-08 04:15:58.082370 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:15:58.082383 | mon1 | Friday 08 May 2026  04:15:58 +0000 (0:00:14.312)       0:03:44.789 ************
2026-05-08 04:15:58.155913 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:15:58.156009 | mon1 |
2026-05-08 04:15:58.156121 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:15:58.156363 | mon1 | Friday 08 May 2026  04:15:58 +0000 (0:00:00.073)       0:03:44.863 ************
2026-05-08 04:15:58.199424 | mon1 | skipping: [mon1]
2026-05-08 04:15:58.199630 | mon1 |
2026-05-08 04:15:58.199978 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:15:58.200224 | mon1 | Friday 08 May 2026  04:15:58 +0000 (0:00:00.045)       0:03:44.908 ************
2026-05-08 04:15:58.241679 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-08 04:15:58.241939 | mon1 | skipping: [mon1]
2026-05-08 04:15:58.242160 | mon1 |
2026-05-08 04:15:58.242412 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:15:58.242656 | mon1 | Friday 08 May 2026  04:15:58 +0000 (0:00:00.042)       0:03:44.950 ************
2026-05-08 04:15:58.543406 | mon1 | ok: [mon1]
2026-05-08 04:15:58.543679 | mon1 |
2026-05-08 04:15:58.544007 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:15:58.544286 | mon1 | Friday 08 May 2026  04:15:58 +0000 (0:00:00.301)       0:03:45.252 ************
2026-05-08 04:16:05.274331 | mon1 | ok: [mon1]
2026-05-08 04:16:05.274434 | mon1 |
2026-05-08 04:16:05.274609 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-08 04:16:05.274898 | mon1 | Friday 08 May 2026  04:16:05 +0000 (0:00:06.730)       0:03:51.982 ************
2026-05-08 04:16:18.036490 | mon1 | changed: [mon1]
2026-05-08 04:16:18.036606 | mon1 |
2026-05-08 04:16:18.036835 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-08 04:16:18.037118 | mon1 | Friday 08 May 2026  04:16:18 +0000 (0:00:12.762)       0:04:04.745 ************
2026-05-08 04:16:24.313251 | mon1 | ok: [mon1]
2026-05-08 04:16:24.313432 | mon1 |
2026-05-08 04:16:24.313689 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-08 04:16:24.313967 | mon1 | Friday 08 May 2026  04:16:24 +0000 (0:00:06.276)       0:04:11.021 ************
2026-05-08 04:16:32.329052 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-08 04:16:32.329213 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-08 04:16:32.329229 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-05-08 04:16:32.329285 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-08 04:16:32.329400 | mon1 |
2026-05-08 04:16:32.329505 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-08 04:16:32.329609 | mon1 |
2026-05-08 04:16:32.329714 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:16:32.329844 | mon1 | Friday 08 May 2026  04:16:32 +0000 (0:00:08.016)       0:04:19.038 ************
2026-05-08 04:16:35.558912 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-08 04:16:35.558976 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:16:35.559019 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:16:35.559029 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:16:35.559037 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:16:35.572256 | mon1 | ok: [osd1]
2026-05-08 04:16:35.572298 | mon1 |
2026-05-08 04:16:35.572412 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:16:35.572541 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:03.240)       0:04:22.278 ************
2026-05-08 04:16:35.827217 | mon1 | ok: [osd1]
2026-05-08 04:16:35.827286 | mon1 |
2026-05-08 04:16:35.827304 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:16:35.827424 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:00.257)       0:04:22.536 ************
2026-05-08 04:16:35.867894 | mon1 | skipping: [osd1]
2026-05-08 04:16:35.867934 | mon1 |
2026-05-08 04:16:35.868072 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:16:35.868177 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:00.040)       0:04:22.577 ************
2026-05-08 04:16:36.138276 | mon1 | changed: [osd1]
2026-05-08 04:16:36.138335 | mon1 |
2026-05-08 04:16:36.138452 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:16:36.138565 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:00.268)       0:04:22.846 ************
2026-05-08 04:16:36.204213 | mon1 | ok: [osd1] => {
2026-05-08 04:16:36.204277 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:16:36.204407 | mon1 | }
2026-05-08 04:16:36.204495 | mon1 |
2026-05-08 04:16:36.204610 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:16:36.204726 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:00.064)       0:04:22.910 ************
2026-05-08 04:16:36.848052 | mon1 | changed: [osd1]
2026-05-08 04:16:36.848119 | mon1 |
2026-05-08 04:16:36.848282 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:16:36.848431 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:00.645)       0:04:23.556 ************
2026-05-08 04:16:36.892446 | mon1 | skipping: [osd1]
2026-05-08 04:16:36.892485 | mon1 |
2026-05-08 04:16:36.892500 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:16:36.892678 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:00.044)       0:04:23.601 ************
2026-05-08 04:16:36.941539 | mon1 | skipping: [osd1]
2026-05-08 04:16:36.941582 | mon1 |
2026-05-08 04:16:36.941597 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:16:36.941623 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:00.045)       0:04:23.646 ************
2026-05-08 04:16:37.189706 | mon1 | ok: [osd1]
2026-05-08 04:16:37.189830 | mon1 |
2026-05-08 04:16:37.190001 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:16:37.190140 | mon1 | Friday 08 May 2026  04:16:37 +0000 (0:00:00.252)       0:04:23.898 ************
2026-05-08 04:16:38.318377 | mon1 | ok: [osd1]
2026-05-08 04:16:38.318716 | mon1 |
2026-05-08 04:16:38.319113 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:16:38.319260 | mon1 | Friday 08 May 2026  04:16:38 +0000 (0:00:01.127)       0:04:25.026 ************
2026-05-08 04:16:38.408823 | mon1 | ok: [osd1] => {
2026-05-08 04:16:38.409462 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:16:38.409474 | mon1 | }
2026-05-08 04:16:38.409480 | mon1 |
2026-05-08 04:16:38.409486 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:16:38.409491 | mon1 | Friday 08 May 2026  04:16:38 +0000 (0:00:00.089)       0:04:25.115 ************
2026-05-08 04:16:39.346860 | mon1 | changed: [osd1]
2026-05-08 04:16:39.346916 | mon1 |
2026-05-08 04:16:39.346947 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:16:39.346961 | mon1 | Friday 08 May 2026  04:16:39 +0000 (0:00:00.938)       0:04:26.054 ************
2026-05-08 04:16:42.324745 | mon1 | changed: [osd1]
2026-05-08 04:16:42.324849 | mon1 |
2026-05-08 04:16:42.324865 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:16:42.324875 | mon1 | Friday 08 May 2026  04:16:42 +0000 (0:00:02.978)       0:04:29.032 ************
2026-05-08 04:16:42.364023 | mon1 | skipping: [osd1]
2026-05-08 04:16:42.364100 | mon1 |
2026-05-08 04:16:42.364118 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:16:42.364385 | mon1 | Friday 08 May 2026  04:16:42 +0000 (0:00:00.039)       0:04:29.072 ************
2026-05-08 04:16:42.398842 | mon1 | skipping: [osd1]
2026-05-08 04:16:42.399229 | mon1 |
2026-05-08 04:16:42.399498 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:16:42.399746 | mon1 | Friday 08 May 2026  04:16:42 +0000 (0:00:00.035)       0:04:29.107 ************
2026-05-08 04:16:42.432630 | mon1 | skipping: [osd1]
2026-05-08 04:16:42.432972 | mon1 |
2026-05-08 04:16:42.433214 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:16:42.433488 | mon1 | Friday 08 May 2026  04:16:42 +0000 (0:00:00.033)       0:04:29.141 ************
2026-05-08 04:16:50.133061 | mon1 | changed: [osd1]
2026-05-08 04:16:50.133134 | mon1 |
2026-05-08 04:16:50.133156 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:16:50.133422 | mon1 | Friday 08 May 2026  04:16:50 +0000 (0:00:07.699)       0:04:36.841 ************
2026-05-08 04:16:50.757359 | mon1 | changed: [osd1]
2026-05-08 04:16:50.757405 | mon1 |
2026-05-08 04:16:50.757419 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:16:50.757431 | mon1 | Friday 08 May 2026  04:16:50 +0000 (0:00:00.623)       0:04:37.464 ************
2026-05-08 04:16:51.920003 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-05-08 04:16:51.920100 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:16:51.920110 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:16:51.920118 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:16:51.920125 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:16:51.920132 | mon1 |
2026-05-08 04:16:51.920139 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:16:51.920146 | mon1 | Friday 08 May 2026  04:16:51 +0000 (0:00:01.162)       0:04:38.626 ************
2026-05-08 04:16:52.647986 | mon1 | changed: [osd1]
2026-05-08 04:16:52.648117 | mon1 |
2026-05-08 04:16:52.648131 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:16:52.648145 | mon1 | Friday 08 May 2026  04:16:52 +0000 (0:00:00.717)       0:04:39.344 ************
2026-05-08 04:16:52.648166 | mon1 |
2026-05-08 04:16:52.648585 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:16:52.648681 | mon1 | Friday 08 May 2026  04:16:52 +0000 (0:00:00.009)       0:04:39.354 ************
2026-05-08 04:16:53.568022 | mon1 | ok: [osd1]
2026-05-08 04:16:53.568086 | mon1 |
2026-05-08 04:16:53.568100 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-08 04:16:53.568113 | mon1 | Friday 08 May 2026  04:16:53 +0000 (0:00:00.919)       0:04:40.274 ************
2026-05-08 04:16:54.177643 | mon1 | changed: [osd1]
2026-05-08 04:16:54.177681 | mon1 |
2026-05-08 04:16:54.177687 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:16:54.177693 | mon1 | Friday 08 May 2026  04:16:54 +0000 (0:00:00.611)       0:04:40.885 ************
2026-05-08 04:16:54.916963 | mon1 | changed: [osd1]
2026-05-08 04:16:54.917044 | mon1 |
2026-05-08 04:16:54.917060 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:16:54.917074 | mon1 | Friday 08 May 2026  04:16:54 +0000 (0:00:00.738)       0:04:41.624 ************
2026-05-08 04:16:55.176925 | mon1 | ok: [osd1]
2026-05-08 04:16:55.177025 | mon1 |
2026-05-08 04:16:55.177437 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:16:55.177489 | mon1 | Friday 08 May 2026  04:16:55 +0000 (0:00:00.260)       0:04:41.884 ************
2026-05-08 04:16:55.245242 | mon1 | ok: [osd1] => {
2026-05-08 04:16:55.245305 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:16:55.245445 | mon1 | }
2026-05-08 04:16:55.245542 | mon1 |
2026-05-08 04:16:55.245670 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:16:55.245783 | mon1 | Friday 08 May 2026  04:16:55 +0000 (0:00:00.068)       0:04:41.953 ************
2026-05-08 04:16:56.173340 | mon1 | changed: [osd1]
2026-05-08 04:16:56.173391 | mon1 |
2026-05-08 04:16:56.173405 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:16:56.173417 | mon1 | Friday 08 May 2026  04:16:56 +0000 (0:00:00.927)       0:04:42.880 ************
2026-05-08 04:17:00.889875 | mon1 | changed: [osd1]
2026-05-08 04:17:00.890014 | mon1 |
2026-05-08 04:17:00.890035 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:17:00.890050 | mon1 | Friday 08 May 2026  04:17:00 +0000 (0:00:04.716)       0:04:47.596 ************
2026-05-08 04:17:01.883324 | mon1 | ok: [osd1]
2026-05-08 04:17:01.883388 | mon1 |
2026-05-08 04:17:01.883402 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:17:01.883430 | mon1 | Friday 08 May 2026  04:17:01 +0000 (0:00:00.993)       0:04:48.590 ************
2026-05-08 04:17:02.203392 | mon1 | changed: [osd1]
2026-05-08 04:17:02.203455 | mon1 |
2026-05-08 04:17:02.203468 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:17:02.203481 | mon1 | Friday 08 May 2026  04:17:02 +0000 (0:00:00.319)       0:04:48.910 ************
2026-05-08 04:17:02.815375 | mon1 | changed: [osd1]
2026-05-08 04:17:02.815432 | mon1 |
2026-05-08 04:17:02.815445 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:17:02.815458 | mon1 | Friday 08 May 2026  04:17:02 +0000 (0:00:00.612)       0:04:49.522 ************
2026-05-08 04:17:03.562970 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-05-08 04:17:03.563029 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:17:03.563042 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:17:03.563055 | mon1 |
2026-05-08 04:17:03.563067 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:17:03.563079 | mon1 | Friday 08 May 2026  04:17:03 +0000 (0:00:00.745)       0:04:50.268 ************
2026-05-08 04:17:04.153400 | mon1 | changed: [osd1]
2026-05-08 04:17:04.153461 | mon1 |
2026-05-08 04:17:04.153474 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:17:04.153487 | mon1 | Friday 08 May 2026  04:17:04 +0000 (0:00:00.592)       0:04:50.860 ************
2026-05-08 04:17:04.742178 | mon1 | changed: [osd1]
2026-05-08 04:17:04.742229 | mon1 |
2026-05-08 04:17:04.742243 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:17:04.742255 | mon1 | Friday 08 May 2026  04:17:04 +0000 (0:00:00.580)       0:04:51.440 ************
2026-05-08 04:17:04.742267 | mon1 |
2026-05-08 04:17:04.742278 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:17:04.742290 | mon1 | Friday 08 May 2026  04:17:04 +0000 (0:00:00.007)       0:04:51.448 ************
2026-05-08 04:17:05.658926 | mon1 | ok: [osd1]
2026-05-08 04:17:05.658963 | mon1 |
2026-05-08 04:17:05.658969 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-08 04:17:05.658975 | mon1 | Friday 08 May 2026  04:17:05 +0000 (0:00:00.917)       0:04:52.366 ************
2026-05-08 04:17:06.686984 | mon1 | changed: [osd1]
2026-05-08 04:17:06.687138 | mon1 |
2026-05-08 04:17:06.687391 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:17:06.687637 | mon1 | Friday 08 May 2026  04:17:06 +0000 (0:00:01.028)       0:04:53.395 ************
2026-05-08 04:17:07.382538 | mon1 | changed: [osd1]
2026-05-08 04:17:07.382737 | mon1 |
2026-05-08 04:17:07.383034 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:17:07.383287 | mon1 | Friday 08 May 2026  04:17:07 +0000 (0:00:00.695)       0:04:54.091 ************
2026-05-08 04:17:07.439832 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-08 04:17:07.440014 | mon1 |
2026-05-08 04:17:07.440268 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:17:07.440509 | mon1 | Friday 08 May 2026  04:17:07 +0000 (0:00:00.057)       0:04:54.148 ************
2026-05-08 04:17:08.419218 | mon1 | ok: [osd1]
2026-05-08 04:17:08.419393 | mon1 |
2026-05-08 04:17:08.419716 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:17:08.420008 | mon1 | Friday 08 May 2026  04:17:08 +0000 (0:00:00.979)       0:04:55.127 ************
2026-05-08 04:17:09.231046 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-05-08 04:17:09.231288 | mon1 | ok: [osd1] => (item=ssh)
2026-05-08 04:17:09.231527 | mon1 |
2026-05-08 04:17:09.231808 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:17:09.232093 | mon1 | Friday 08 May 2026  04:17:09 +0000 (0:00:00.811)       0:04:55.939 ************
2026-05-08 04:17:09.866991 | mon1 | changed: [osd1]
2026-05-08 04:17:09.867044 | mon1 |
2026-05-08 04:17:09.867382 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:17:09.867406 | mon1 | Friday 08 May 2026  04:17:09 +0000 (0:00:00.635)       0:04:56.575 ************
2026-05-08 04:17:10.109181 | mon1 | ok: [osd1]
2026-05-08 04:17:10.109213 | mon1 |
2026-05-08 04:17:10.109274 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:17:10.109285 | mon1 | Friday 08 May 2026  04:17:10 +0000 (0:00:00.240)       0:04:56.816 ************
2026-05-08 04:17:10.491265 | mon1 | changed: [osd1]
2026-05-08 04:17:10.491313 | mon1 |
2026-05-08 04:17:10.491323 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:17:10.491333 | mon1 | Friday 08 May 2026  04:17:10 +0000 (0:00:00.382)       0:04:57.198 ************
2026-05-08 04:17:10.772237 | mon1 | changed: [osd1]
2026-05-08 04:17:10.772282 | mon1 |
2026-05-08 04:17:10.772293 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-08 04:17:10.772302 | mon1 | Friday 08 May 2026  04:17:10 +0000 (0:00:00.281)       0:04:57.480 ************
2026-05-08 04:17:11.041828 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-08 04:17:11.041876 | mon1 |
2026-05-08 04:17:11.041885 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-08 04:17:11.041895 | mon1 | Friday 08 May 2026  04:17:11 +0000 (0:00:00.269)       0:04:57.750 ************
2026-05-08 04:17:11.094896 | mon1 | ok: [osd1]
2026-05-08 04:17:11.094955 | mon1 |
2026-05-08 04:17:11.094976 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:17:11.095179 | mon1 | Friday 08 May 2026  04:17:11 +0000 (0:00:00.052)       0:04:57.802 ************
2026-05-08 04:17:11.162433 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-08 04:17:11.162489 | mon1 |
2026-05-08 04:17:11.162501 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:17:11.162511 | mon1 | Friday 08 May 2026  04:17:11 +0000 (0:00:00.066)       0:04:57.869 ************
2026-05-08 04:17:17.397525 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:17:17.397567 | mon1 |
2026-05-08 04:17:17.397573 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:17:17.397579 | mon1 | Friday 08 May 2026  04:17:17 +0000 (0:00:06.233)       0:05:04.103 ************
2026-05-08 04:17:17.448400 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:17:17.448464 | mon1 |
2026-05-08 04:17:17.448477 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:17:17.448491 | mon1 | Friday 08 May 2026  04:17:17 +0000 (0:00:00.052)       0:05:04.155 ************
2026-05-08 04:17:17.768331 | mon1 | changed: [osd1]
2026-05-08 04:17:17.768390 | mon1 |
2026-05-08 04:17:17.768400 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:17:17.768409 | mon1 | Friday 08 May 2026  04:17:17 +0000 (0:00:00.319)       0:05:04.475 ************
2026-05-08 04:17:27.178427 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:17:27.178497 | mon1 |
2026-05-08 04:17:27.178511 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-08 04:17:27.178523 | mon1 | Friday 08 May 2026  04:17:27 +0000 (0:00:09.409)       0:05:13.885 ************
2026-05-08 04:17:28.844585 | mon1 | ok: [osd1]
2026-05-08 04:17:28.844640 | mon1 |
2026-05-08 04:17:28.844654 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-08 04:17:28.844667 | mon1 | Friday 08 May 2026  04:17:28 +0000 (0:00:01.666)       0:05:15.551 ************
2026-05-08 04:18:11.158585 | mon1 | ok: [osd1]
2026-05-08 04:18:11.158653 | mon1 |
2026-05-08 04:18:11.158667 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-08 04:18:11.158681 | mon1 | Friday 08 May 2026  04:18:11 +0000 (0:00:42.313)       0:05:57.865 ************
2026-05-08 04:19:45.478083 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-05-08 04:19:45.478121 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-05-08 04:19:45.478127 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-05-08 04:19:45.478133 | mon1 |
2026-05-08 04:19:45.478138 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-08 04:19:45.478148 | mon1 | Friday 08 May 2026  04:19:45 +0000 (0:01:34.319)       0:07:32.185 ************
2026-05-08 04:19:51.834313 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:19:51.834396 | mon1 |
2026-05-08 04:19:51.834649 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-08 04:19:51.834687 | mon1 | Friday 08 May 2026  04:19:51 +0000 (0:00:06.357)       0:07:38.542 ************
2026-05-08 04:19:58.109504 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:19:58.109547 | mon1 |
2026-05-08 04:19:58.109554 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-08 04:19:58.109560 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:06.273)       0:07:44.816 ************
2026-05-08 04:19:58.189223 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-08 04:19:58.189556 | mon1 |
2026-05-08 04:19:58.190318 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-08 04:19:58.190350 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:00.080)       0:07:44.896 ************
2026-05-08 04:19:58.223682 | mon1 | ok: [osd1]
2026-05-08 04:19:58.223730 | mon1 |
2026-05-08 04:19:58.223743 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-08 04:19:58.223756 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:00.035)       0:07:44.931 ************
2026-05-08 04:20:04.475736 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:20:04.475842 | mon1 |
2026-05-08 04:20:04.476102 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-08 04:20:04.476349 | mon1 | Friday 08 May 2026  04:20:04 +0000 (0:00:06.251)       0:07:51.182 ************
2026-05-08 04:20:04.524375 | mon1 | ok: [osd1]
2026-05-08 04:20:04.524554 | mon1 |
2026-05-08 04:20:04.524839 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-08 04:20:04.525086 | mon1 | Friday 08 May 2026  04:20:04 +0000 (0:00:00.050)       0:07:51.232 ************
2026-05-08 04:20:04.564692 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:20:04.564958 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:20:04.565204 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:20:04.565443 | mon1 | skipping: [osd1]
2026-05-08 04:20:04.565666 | mon1 |
2026-05-08 04:20:04.565951 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-08 04:20:04.566189 | mon1 | Friday 08 May 2026  04:20:04 +0000 (0:00:00.040)       0:07:51.273 ************
2026-05-08 04:20:04.602779 | mon1 | skipping: [osd1]
2026-05-08 04:20:04.603025 | mon1 |
2026-05-08 04:20:04.603263 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:20:04.603529 | mon1 | mon1                       : ok=59   changed=29   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-05-08 04:20:04.603788 | mon1 | osd1                       : ok=53   changed=23   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-05-08 04:20:04.604040 | mon1 |
2026-05-08 04:20:04.604256 | mon1 |
2026-05-08 04:20:04.604495 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:20:04.604755 | mon1 | Friday 08 May 2026  04:20:04 +0000 (0:00:00.038)       0:07:51.312 ************
2026-05-08 04:20:04.605018 | mon1 | ===============================================================================
2026-05-08 04:20:04.605261 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 94.32s
2026-05-08 04:20:04.605500 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 91.56s
2026-05-08 04:20:04.605744 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 46.28s
2026-05-08 04:20:04.606018 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.31s
2026-05-08 04:20:04.606259 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 18.17s
2026-05-08 04:20:04.606552 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.31s
2026-05-08 04:20:04.606831 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.76s
2026-05-08 04:20:04.607092 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 9.41s
2026-05-08 04:20:04.607337 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.11s
2026-05-08 04:20:04.607578 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.02s
2026-05-08 04:20:04.607832 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 7.70s
2026-05-08 04:20:04.608098 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.89s
2026-05-08 04:20:04.608339 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.75s
2026-05-08 04:20:04.608592 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.73s
2026-05-08 04:20:04.608866 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.36s
2026-05-08 04:20:04.609107 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.28s
2026-05-08 04:20:04.609355 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.27s
2026-05-08 04:20:04.609582 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.25s
2026-05-08 04:20:04.609847 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.23s
2026-05-08 04:20:04.610100 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 5.61s
2026-05-08 04:20:04.699129 | mon1 | INFO     [default > converge] Executed: Successful
2026-05-08 04:20:04.710060 | mon1 | INFO     [default > idempotence] Executing
2026-05-08 04:20:05.625824 | mon1 |
2026-05-08 04:20:05.626074 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-08 04:20:05.626300 | mon1 |
2026-05-08 04:20:05.626547 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:20:05.626845 | mon1 | Friday 08 May 2026  04:20:05 +0000 (0:00:00.051)       0:00:00.051 ************
2026-05-08 04:20:06.823592 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:20:06.823761 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:20:06.824101 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:20:06.824333 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:20:06.824581 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:20:06.839139 | mon1 | ok: [mon1]
2026-05-08 04:20:06.839360 | mon1 |
2026-05-08 04:20:06.839609 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:20:06.839908 | mon1 | Friday 08 May 2026  04:20:06 +0000 (0:00:01.213)       0:00:01.264 ************
2026-05-08 04:20:07.173607 | mon1 | ok: [mon1]
2026-05-08 04:20:07.173733 | mon1 |
2026-05-08 04:20:07.174046 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:20:07.174303 | mon1 | Friday 08 May 2026  04:20:07 +0000 (0:00:00.334)       0:00:01.599 ************
2026-05-08 04:20:07.215042 | mon1 | skipping: [mon1]
2026-05-08 04:20:07.215275 | mon1 |
2026-05-08 04:20:07.215545 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:20:07.215826 | mon1 | Friday 08 May 2026  04:20:07 +0000 (0:00:00.041)       0:00:01.641 ************
2026-05-08 04:20:07.559379 | mon1 | ok: [mon1]
2026-05-08 04:20:07.559566 | mon1 |
2026-05-08 04:20:07.559837 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:20:07.560148 | mon1 | Friday 08 May 2026  04:20:07 +0000 (0:00:00.344)       0:00:01.985 ************
2026-05-08 04:20:07.635754 | mon1 | ok: [mon1] => {
2026-05-08 04:20:07.636031 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:20:07.636326 | mon1 | }
2026-05-08 04:20:07.636568 | mon1 |
2026-05-08 04:20:07.636845 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:20:07.637093 | mon1 | Friday 08 May 2026  04:20:07 +0000 (0:00:00.076)       0:00:02.061 ************
2026-05-08 04:20:08.113426 | mon1 | ok: [mon1]
2026-05-08 04:20:08.113619 | mon1 |
2026-05-08 04:20:08.113908 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:20:08.114163 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.477)       0:00:02.539 ************
2026-05-08 04:20:08.164433 | mon1 | skipping: [mon1]
2026-05-08 04:20:08.164663 | mon1 |
2026-05-08 04:20:08.164954 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:20:08.165199 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.051)       0:00:02.590 ************
2026-05-08 04:20:08.212070 | mon1 | skipping: [mon1]
2026-05-08 04:20:08.212283 | mon1 |
2026-05-08 04:20:08.212571 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:20:08.212833 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.047)       0:00:02.638 ************
2026-05-08 04:20:08.464396 | mon1 | ok: [mon1]
2026-05-08 04:20:08.464642 | mon1 |
2026-05-08 04:20:08.464928 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:20:08.465174 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.251)       0:00:02.890 ************
2026-05-08 04:20:09.547957 | mon1 | ok: [mon1]
2026-05-08 04:20:09.548002 | mon1 |
2026-05-08 04:20:09.548449 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:20:09.548490 | mon1 | Friday 08 May 2026  04:20:09 +0000 (0:00:01.083)       0:00:03.973 ************
2026-05-08 04:20:09.730379 | mon1 | ok: [mon1] => {
2026-05-08 04:20:09.730434 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:20:09.730444 | mon1 | }
2026-05-08 04:20:09.730453 | mon1 |
2026-05-08 04:20:09.730462 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:20:09.730472 | mon1 | Friday 08 May 2026  04:20:09 +0000 (0:00:00.181)       0:00:04.154 ************
2026-05-08 04:20:10.241337 | mon1 | ok: [mon1]
2026-05-08 04:20:10.241400 | mon1 |
2026-05-08 04:20:10.241413 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:20:10.241426 | mon1 | Friday 08 May 2026  04:20:10 +0000 (0:00:00.510)       0:00:04.665 ************
2026-05-08 04:20:13.652942 | mon1 | ok: [mon1]
2026-05-08 04:20:13.653001 | mon1 |
2026-05-08 04:20:13.653461 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:20:13.653541 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:03.412)       0:00:08.078 ************
2026-05-08 04:20:13.688253 | mon1 | skipping: [mon1]
2026-05-08 04:20:13.688314 | mon1 |
2026-05-08 04:20:13.688440 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:20:13.688552 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.035)       0:00:08.113 ************
2026-05-08 04:20:13.722339 | mon1 | skipping: [mon1]
2026-05-08 04:20:13.722371 | mon1 |
2026-05-08 04:20:13.722382 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:20:13.722391 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.033)       0:00:08.147 ************
2026-05-08 04:20:13.758376 | mon1 | skipping: [mon1]
2026-05-08 04:20:13.758436 | mon1 |
2026-05-08 04:20:13.758447 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:20:13.758457 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.035)       0:00:08.182 ************
2026-05-08 04:20:14.761149 | mon1 | ok: [mon1]
2026-05-08 04:20:14.761234 | mon1 |
2026-05-08 04:20:14.761244 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:20:14.761254 | mon1 | Friday 08 May 2026  04:20:14 +0000 (0:00:01.002)       0:00:09.185 ************
2026-05-08 04:20:15.312290 | mon1 | ok: [mon1]
2026-05-08 04:20:15.312338 | mon1 |
2026-05-08 04:20:15.312349 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:20:15.312359 | mon1 | Friday 08 May 2026  04:20:15 +0000 (0:00:00.551)       0:00:09.736 ************
2026-05-08 04:20:16.400933 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-08 04:20:16.401053 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:20:16.402466 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:20:16.402527 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:20:16.402542 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:20:16.402555 | mon1 |
2026-05-08 04:20:16.402568 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:20:16.402595 | mon1 | Friday 08 May 2026  04:20:16 +0000 (0:00:01.089)       0:00:10.826 ************
2026-05-08 04:20:17.061900 | mon1 | ok: [mon1]
2026-05-08 04:20:17.061969 | mon1 |
2026-05-08 04:20:17.063244 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:20:17.063302 | mon1 | Friday 08 May 2026  04:20:17 +0000 (0:00:00.652)       0:00:11.478 ************
2026-05-08 04:20:17.063319 | mon1 |
2026-05-08 04:20:17.063335 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:20:17.063349 | mon1 | Friday 08 May 2026  04:20:17 +0000 (0:00:00.007)       0:00:11.486 ************
2026-05-08 04:20:17.737692 | mon1 | ok: [mon1]
2026-05-08 04:20:17.737748 | mon1 |
2026-05-08 04:20:17.737761 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:20:17.737774 | mon1 | Friday 08 May 2026  04:20:17 +0000 (0:00:00.676)       0:00:12.162 ************
2026-05-08 04:20:17.986834 | mon1 | ok: [mon1]
2026-05-08 04:20:17.986881 | mon1 |
2026-05-08 04:20:17.986895 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:20:17.986907 | mon1 | Friday 08 May 2026  04:20:17 +0000 (0:00:00.249)       0:00:12.411 ************
2026-05-08 04:20:18.063966 | mon1 | ok: [mon1] => {
2026-05-08 04:20:18.064026 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:20:18.064047 | mon1 | }
2026-05-08 04:20:18.064276 | mon1 |
2026-05-08 04:20:18.064522 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:20:18.064777 | mon1 | Friday 08 May 2026  04:20:18 +0000 (0:00:00.077)       0:00:12.489 ************
2026-05-08 04:20:18.489932 | mon1 | ok: [mon1]
2026-05-08 04:20:18.490242 | mon1 |
2026-05-08 04:20:18.490606 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:20:18.490999 | mon1 | Friday 08 May 2026  04:20:18 +0000 (0:00:00.426)       0:00:12.915 ************
2026-05-08 04:20:21.797511 | mon1 | ok: [mon1]
2026-05-08 04:20:21.797574 | mon1 |
2026-05-08 04:20:21.797585 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:20:21.797596 | mon1 | Friday 08 May 2026  04:20:21 +0000 (0:00:03.306)       0:00:16.222 ************
2026-05-08 04:20:22.812900 | mon1 | ok: [mon1]
2026-05-08 04:20:22.812979 | mon1 |
2026-05-08 04:20:22.813458 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:20:22.813504 | mon1 | Friday 08 May 2026  04:20:22 +0000 (0:00:01.015)       0:00:17.237 ************
2026-05-08 04:20:23.133571 | mon1 | ok: [mon1]
2026-05-08 04:20:23.133607 | mon1 |
2026-05-08 04:20:23.133612 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:20:23.133616 | mon1 | Friday 08 May 2026  04:20:23 +0000 (0:00:00.321)       0:00:17.558 ************
2026-05-08 04:20:23.668841 | mon1 | ok: [mon1]
2026-05-08 04:20:23.668872 | mon1 |
2026-05-08 04:20:23.669225 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:20:23.669248 | mon1 | Friday 08 May 2026  04:20:23 +0000 (0:00:00.533)       0:00:18.092 ************
2026-05-08 04:20:24.325690 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-08 04:20:24.325734 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:20:24.325744 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:20:24.325754 | mon1 |
2026-05-08 04:20:24.325763 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:20:24.325773 | mon1 | Friday 08 May 2026  04:20:24 +0000 (0:00:00.657)       0:00:18.750 ************
2026-05-08 04:20:24.851880 | mon1 | ok: [mon1]
2026-05-08 04:20:24.851929 | mon1 |
2026-05-08 04:20:24.852367 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:20:24.852409 | mon1 | Friday 08 May 2026  04:20:24 +0000 (0:00:00.527)       0:00:19.277 ************
2026-05-08 04:20:25.384934 | mon1 | ok: [mon1]
2026-05-08 04:20:25.384989 | mon1 |
2026-05-08 04:20:25.385000 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:20:25.385009 | mon1 | Friday 08 May 2026  04:20:25 +0000 (0:00:00.524)       0:00:19.802 ************
2026-05-08 04:20:25.385018 | mon1 |
2026-05-08 04:20:25.385027 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:20:25.385036 | mon1 | Friday 08 May 2026  04:20:25 +0000 (0:00:00.007)       0:00:19.809 ************
2026-05-08 04:20:25.819359 | mon1 | ok: [mon1]
2026-05-08 04:20:25.819411 | mon1 |
2026-05-08 04:20:25.819425 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:20:25.819437 | mon1 | Friday 08 May 2026  04:20:25 +0000 (0:00:00.434)       0:00:20.243 ************
2026-05-08 04:20:25.870548 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-08 04:20:25.870615 | mon1 |
2026-05-08 04:20:25.870634 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:20:25.870650 | mon1 | Friday 08 May 2026  04:20:25 +0000 (0:00:00.051)       0:00:20.295 ************
2026-05-08 04:20:26.816912 | mon1 | ok: [mon1]
2026-05-08 04:20:26.816970 | mon1 |
2026-05-08 04:20:26.816979 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:20:26.816987 | mon1 | Friday 08 May 2026  04:20:26 +0000 (0:00:00.946)       0:00:21.241 ************
2026-05-08 04:20:27.610237 | mon1 | ok: [mon1] => (item=systemd-timesyncd)
2026-05-08 04:20:27.610311 | mon1 | ok: [mon1] => (item=ssh)
2026-05-08 04:20:27.610405 | mon1 |
2026-05-08 04:20:27.610517 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:20:27.610650 | mon1 | Friday 08 May 2026  04:20:27 +0000 (0:00:00.793)       0:00:22.035 ************
2026-05-08 04:20:27.982898 | mon1 | ok: [mon1]
2026-05-08 04:20:27.982956 | mon1 |
2026-05-08 04:20:27.983433 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:20:27.983509 | mon1 | Friday 08 May 2026  04:20:27 +0000 (0:00:00.372)       0:00:22.408 ************
2026-05-08 04:20:28.218338 | mon1 | ok: [mon1]
2026-05-08 04:20:28.218450 | mon1 |
2026-05-08 04:20:28.218613 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:20:28.218768 | mon1 | Friday 08 May 2026  04:20:28 +0000 (0:00:00.235)       0:00:22.643 ************
2026-05-08 04:20:28.660015 | mon1 | ok: [mon1]
2026-05-08 04:20:28.660085 | mon1 |
2026-05-08 04:20:28.660104 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:20:28.660445 | mon1 | Friday 08 May 2026  04:20:28 +0000 (0:00:00.440)       0:00:23.084 ************
2026-05-08 04:20:29.023878 | mon1 | ok: [mon1]
2026-05-08 04:20:29.023923 | mon1 |
2026-05-08 04:20:29.024373 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-08 04:20:29.024417 | mon1 | Friday 08 May 2026  04:20:29 +0000 (0:00:00.365)       0:00:23.449 ************
2026-05-08 04:20:29.101247 | mon1 | ok: [mon1]
2026-05-08 04:20:29.101322 | mon1 |
2026-05-08 04:20:29.104226 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-08 04:20:29.104256 | mon1 | Friday 08 May 2026  04:20:29 +0000 (0:00:00.076)       0:00:23.526 ************
2026-05-08 04:20:29.376656 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:20:29.376688 | mon1 |
2026-05-08 04:20:29.376693 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-08 04:20:29.376698 | mon1 | Friday 08 May 2026  04:20:29 +0000 (0:00:00.275)       0:00:23.801 ************
2026-05-08 04:20:29.435350 | mon1 | ok: [mon1]
2026-05-08 04:20:29.435389 | mon1 |
2026-05-08 04:20:29.435394 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-08 04:20:29.435398 | mon1 | Friday 08 May 2026  04:20:29 +0000 (0:00:00.057)       0:00:23.859 ************
2026-05-08 04:20:29.481202 | mon1 | skipping: [mon1]
2026-05-08 04:20:29.481250 | mon1 |
2026-05-08 04:20:29.481261 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:20:29.481270 | mon1 | Friday 08 May 2026  04:20:29 +0000 (0:00:00.045)       0:00:23.905 ************
2026-05-08 04:20:29.561190 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:20:29.561232 | mon1 |
2026-05-08 04:20:29.561243 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:20:29.561252 | mon1 | Friday 08 May 2026  04:20:29 +0000 (0:00:00.080)       0:00:23.986 ************
2026-05-08 04:20:35.923770 | mon1 | ok: [mon1]
2026-05-08 04:20:35.923839 | mon1 |
2026-05-08 04:20:35.923851 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:20:35.923859 | mon1 | Friday 08 May 2026  04:20:35 +0000 (0:00:06.362)       0:00:30.349 ************
2026-05-08 04:20:35.981634 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:20:35.981676 | mon1 |
2026-05-08 04:20:35.981682 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:20:35.981688 | mon1 | Friday 08 May 2026  04:20:35 +0000 (0:00:00.057)       0:00:30.406 ************
2026-05-08 04:20:36.440200 | mon1 | ok: [mon1]
2026-05-08 04:20:36.440260 | mon1 |
2026-05-08 04:20:36.440378 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:20:36.440506 | mon1 | Friday 08 May 2026  04:20:36 +0000 (0:00:00.457)       0:00:30.864 ************
2026-05-08 04:20:43.230366 | mon1 | ok: [mon1]
2026-05-08 04:20:43.230443 | mon1 |
2026-05-08 04:20:43.230455 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-08 04:20:43.230592 | mon1 | Friday 08 May 2026  04:20:43 +0000 (0:00:06.791)       0:00:37.656 ************
2026-05-08 04:20:49.832935 | mon1 | ok: [mon1]
2026-05-08 04:20:49.833036 | mon1 |
2026-05-08 04:20:49.833051 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-08 04:20:49.833063 | mon1 | Friday 08 May 2026  04:20:49 +0000 (0:00:06.602)       0:00:44.258 ************
2026-05-08 04:21:04.202725 | mon1 | ok: [mon1]
2026-05-08 04:21:04.203004 | mon1 |
2026-05-08 04:21:04.203259 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:21:04.203551 | mon1 | Friday 08 May 2026  04:21:04 +0000 (0:00:14.369)       0:00:58.628 ************
2026-05-08 04:21:04.276130 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:21:04.276360 | mon1 |
2026-05-08 04:21:04.276627 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:21:04.277029 | mon1 | Friday 08 May 2026  04:21:04 +0000 (0:00:00.073)       0:00:58.702 ************
2026-05-08 04:21:04.330907 | mon1 | skipping: [mon1]
2026-05-08 04:21:04.331045 | mon1 |
2026-05-08 04:21:04.331233 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:21:04.331386 | mon1 | Friday 08 May 2026  04:21:04 +0000 (0:00:00.054)       0:00:58.757 ************
2026-05-08 04:21:04.382994 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-08 04:21:04.383265 | mon1 | skipping: [mon1]
2026-05-08 04:21:04.383508 | mon1 |
2026-05-08 04:21:04.383768 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:21:04.384096 | mon1 | Friday 08 May 2026  04:21:04 +0000 (0:00:00.052)       0:00:58.809 ************
2026-05-08 04:21:04.739958 | mon1 | ok: [mon1]
2026-05-08 04:21:04.740005 | mon1 |
2026-05-08 04:21:04.740133 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:21:04.740472 | mon1 | Friday 08 May 2026  04:21:04 +0000 (0:00:00.356)       0:00:59.165 ************
2026-05-08 04:21:11.618385 | mon1 | ok: [mon1]
2026-05-08 04:21:11.618680 | mon1 |
2026-05-08 04:21:11.618975 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-08 04:21:11.619222 | mon1 | Friday 08 May 2026  04:21:11 +0000 (0:00:06.878)       0:01:06.044 ************
2026-05-08 04:21:18.205325 | mon1 | ok: [mon1]
2026-05-08 04:21:18.205582 | mon1 |
2026-05-08 04:21:18.205902 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-08 04:21:18.206164 | mon1 | Friday 08 May 2026  04:21:18 +0000 (0:00:06.586)       0:01:12.631 ************
2026-05-08 04:21:24.563394 | mon1 | ok: [mon1]
2026-05-08 04:21:24.563474 | mon1 |
2026-05-08 04:21:24.563613 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-08 04:21:24.563739 | mon1 | Friday 08 May 2026  04:21:24 +0000 (0:00:06.358)       0:01:18.989 ************
2026-05-08 04:21:32.752018 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-08 04:21:32.752082 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-08 04:21:32.752880 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-05-08 04:21:32.752978 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-08 04:21:32.752992 | mon1 |
2026-05-08 04:21:32.753101 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-08 04:21:32.753396 | mon1 |
2026-05-08 04:21:32.753709 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:21:32.754129 | mon1 | Friday 08 May 2026  04:21:32 +0000 (0:00:08.187)       0:01:27.176 ************
2026-05-08 04:21:35.065288 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-08 04:21:35.065425 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:21:35.065579 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:21:35.065736 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:21:35.065925 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:21:35.078103 | mon1 | ok: [osd1]
2026-05-08 04:21:35.078263 | mon1 |
2026-05-08 04:21:35.078392 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:21:35.078544 | mon1 | Friday 08 May 2026  04:21:35 +0000 (0:00:02.326)       0:01:29.503 ************
2026-05-08 04:21:35.341892 | mon1 | ok: [osd1]
2026-05-08 04:21:35.341947 | mon1 |
2026-05-08 04:21:35.342338 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:21:35.342441 | mon1 | Friday 08 May 2026  04:21:35 +0000 (0:00:00.263)       0:01:29.767 ************
2026-05-08 04:21:35.385426 | mon1 | skipping: [osd1]
2026-05-08 04:21:35.385492 | mon1 |
2026-05-08 04:21:35.385506 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:21:35.385610 | mon1 | Friday 08 May 2026  04:21:35 +0000 (0:00:00.042)       0:01:29.810 ************
2026-05-08 04:21:35.707251 | mon1 | ok: [osd1]
2026-05-08 04:21:35.707323 | mon1 |
2026-05-08 04:21:35.707404 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:21:35.707537 | mon1 | Friday 08 May 2026  04:21:35 +0000 (0:00:00.322)       0:01:30.132 ************
2026-05-08 04:21:35.784858 | mon1 | ok: [osd1] => {
2026-05-08 04:21:35.784918 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:21:35.784928 | mon1 | }
2026-05-08 04:21:35.784937 | mon1 |
2026-05-08 04:21:35.784946 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:21:35.784955 | mon1 | Friday 08 May 2026  04:21:35 +0000 (0:00:00.076)       0:01:30.208 ************
2026-05-08 04:21:36.180407 | mon1 | ok: [osd1]
2026-05-08 04:21:36.180468 | mon1 |
2026-05-08 04:21:36.180479 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:21:36.180488 | mon1 | Friday 08 May 2026  04:21:36 +0000 (0:00:00.395)       0:01:30.604 ************
2026-05-08 04:21:36.225212 | mon1 | skipping: [osd1]
2026-05-08 04:21:36.225245 | mon1 |
2026-05-08 04:21:36.225256 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:21:36.225266 | mon1 | Friday 08 May 2026  04:21:36 +0000 (0:00:00.045)       0:01:30.650 ************
2026-05-08 04:21:36.272860 | mon1 | skipping: [osd1]
2026-05-08 04:21:36.272891 | mon1 |
2026-05-08 04:21:36.272986 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:21:36.273327 | mon1 | Friday 08 May 2026  04:21:36 +0000 (0:00:00.047)       0:01:30.697 ************
2026-05-08 04:21:36.535527 | mon1 | ok: [osd1]
2026-05-08 04:21:36.535903 | mon1 |
2026-05-08 04:21:36.536231 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:21:36.536539 | mon1 | Friday 08 May 2026  04:21:36 +0000 (0:00:00.263)       0:01:30.960 ************
2026-05-08 04:21:37.799596 | mon1 | ok: [osd1]
2026-05-08 04:21:37.800669 | mon1 |
2026-05-08 04:21:37.800689 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:21:37.800699 | mon1 | Friday 08 May 2026  04:21:37 +0000 (0:00:01.263)       0:01:32.224 ************
2026-05-08 04:21:37.991071 | mon1 | ok: [osd1] => {
2026-05-08 04:21:37.991142 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:21:37.991156 | mon1 | }
2026-05-08 04:21:37.991168 | mon1 |
2026-05-08 04:21:37.991181 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:21:37.991193 | mon1 | Friday 08 May 2026  04:21:37 +0000 (0:00:00.189)       0:01:32.414 ************
2026-05-08 04:21:38.538881 | mon1 | ok: [osd1]
2026-05-08 04:21:38.538931 | mon1 |
2026-05-08 04:21:38.539423 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:21:38.539483 | mon1 | Friday 08 May 2026  04:21:38 +0000 (0:00:00.549)       0:01:32.963 ************
2026-05-08 04:21:40.832262 | mon1 | ok: [osd1]
2026-05-08 04:21:40.832325 | mon1 |
2026-05-08 04:21:40.832339 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:21:40.832351 | mon1 | Friday 08 May 2026  04:21:40 +0000 (0:00:02.293)       0:01:35.256 ************
2026-05-08 04:21:40.867734 | mon1 | skipping: [osd1]
2026-05-08 04:21:40.867773 | mon1 |
2026-05-08 04:21:40.867781 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:21:40.867789 | mon1 | Friday 08 May 2026  04:21:40 +0000 (0:00:00.036)       0:01:35.293 ************
2026-05-08 04:21:40.903339 | mon1 | skipping: [osd1]
2026-05-08 04:21:40.903406 | mon1 |
2026-05-08 04:21:40.903420 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:21:40.903433 | mon1 | Friday 08 May 2026  04:21:40 +0000 (0:00:00.034)       0:01:35.327 ************
2026-05-08 04:21:40.939031 | mon1 | skipping: [osd1]
2026-05-08 04:21:40.939062 | mon1 |
2026-05-08 04:21:40.939104 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:21:40.939113 | mon1 | Friday 08 May 2026  04:21:40 +0000 (0:00:00.035)       0:01:35.363 ************
2026-05-08 04:21:42.247328 | mon1 | ok: [osd1]
2026-05-08 04:21:42.247388 | mon1 |
2026-05-08 04:21:42.247399 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:21:42.247408 | mon1 | Friday 08 May 2026  04:21:42 +0000 (0:00:01.307)       0:01:36.671 ************
2026-05-08 04:21:42.830420 | mon1 | ok: [osd1]
2026-05-08 04:21:42.830480 | mon1 |
2026-05-08 04:21:42.830491 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:21:42.830500 | mon1 | Friday 08 May 2026  04:21:42 +0000 (0:00:00.582)       0:01:37.254 ************
2026-05-08 04:21:44.006705 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-05-08 04:21:44.006781 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:21:44.006830 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:21:44.006847 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:21:44.006861 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:21:44.006874 | mon1 |
2026-05-08 04:21:44.006909 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:21:44.006923 | mon1 | Friday 08 May 2026  04:21:44 +0000 (0:00:01.175)       0:01:38.429 ************
2026-05-08 04:21:44.677986 | mon1 | ok: [osd1]
2026-05-08 04:21:44.678067 | mon1 |
2026-05-08 04:21:44.678089 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:21:44.678230 | mon1 | Friday 08 May 2026  04:21:44 +0000 (0:00:00.667)       0:01:39.097 ************
2026-05-08 04:21:44.678451 | mon1 |
2026-05-08 04:21:44.678693 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:21:44.678969 | mon1 | Friday 08 May 2026  04:21:44 +0000 (0:00:00.005)       0:01:39.103 ************
2026-05-08 04:21:45.125548 | mon1 | ok: [osd1]
2026-05-08 04:21:45.125716 | mon1 |
2026-05-08 04:21:45.126017 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:21:45.126262 | mon1 | Friday 08 May 2026  04:21:45 +0000 (0:00:00.448)       0:01:39.551 ************
2026-05-08 04:21:45.377138 | mon1 | ok: [osd1]
2026-05-08 04:21:45.377349 | mon1 |
2026-05-08 04:21:45.377604 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:21:45.377876 | mon1 | Friday 08 May 2026  04:21:45 +0000 (0:00:00.251)       0:01:39.803 ************
2026-05-08 04:21:45.450654 | mon1 | ok: [osd1] => {
2026-05-08 04:21:45.450937 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:21:45.451171 | mon1 | }
2026-05-08 04:21:45.451390 | mon1 |
2026-05-08 04:21:45.451653 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:21:45.451930 | mon1 | Friday 08 May 2026  04:21:45 +0000 (0:00:00.073)       0:01:39.876 ************
2026-05-08 04:21:45.887684 | mon1 | ok: [osd1]
2026-05-08 04:21:45.887913 | mon1 |
2026-05-08 04:21:45.888167 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:21:45.888427 | mon1 | Friday 08 May 2026  04:21:45 +0000 (0:00:00.436)       0:01:40.313 ************
2026-05-08 04:21:49.163887 | mon1 | ok: [osd1]
2026-05-08 04:21:49.163961 | mon1 |
2026-05-08 04:21:49.163975 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:21:49.163994 | mon1 | Friday 08 May 2026  04:21:49 +0000 (0:00:03.275)       0:01:43.589 ************
2026-05-08 04:21:50.391866 | mon1 | ok: [osd1]
2026-05-08 04:21:50.392190 | mon1 |
2026-05-08 04:21:50.392474 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:21:50.392837 | mon1 | Friday 08 May 2026  04:21:50 +0000 (0:00:01.228)       0:01:44.817 ************
2026-05-08 04:21:50.642214 | mon1 | ok: [osd1]
2026-05-08 04:21:50.642363 | mon1 |
2026-05-08 04:21:50.642669 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:21:50.642944 | mon1 | Friday 08 May 2026  04:21:50 +0000 (0:00:00.250)       0:01:45.067 ************
2026-05-08 04:21:51.189591 | mon1 | ok: [osd1]
2026-05-08 04:21:51.189753 | mon1 |
2026-05-08 04:21:51.190107 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:21:51.190400 | mon1 | Friday 08 May 2026  04:21:51 +0000 (0:00:00.547)       0:01:45.615 ************
2026-05-08 04:21:51.901709 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-05-08 04:21:51.903029 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:21:51.903097 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:21:51.903120 | mon1 |
2026-05-08 04:21:51.903132 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:21:51.903153 | mon1 | Friday 08 May 2026  04:21:51 +0000 (0:00:00.712)       0:01:46.327 ************
2026-05-08 04:21:52.452387 | mon1 | ok: [osd1]
2026-05-08 04:21:52.452722 | mon1 |
2026-05-08 04:21:52.453177 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:21:52.453552 | mon1 | Friday 08 May 2026  04:21:52 +0000 (0:00:00.550)       0:01:46.877 ************
2026-05-08 04:21:53.024530 | mon1 | ok: [osd1]
2026-05-08 04:21:53.024703 | mon1 |
2026-05-08 04:21:53.025034 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:21:53.025285 | mon1 | Friday 08 May 2026  04:21:53 +0000 (0:00:00.563)       0:01:47.441 ************
2026-05-08 04:21:53.025500 | mon1 |
2026-05-08 04:21:53.025749 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:21:53.026183 | mon1 | Friday 08 May 2026  04:21:53 +0000 (0:00:00.008)       0:01:47.450 ************
2026-05-08 04:21:53.490391 | mon1 | ok: [osd1]
2026-05-08 04:21:53.490569 | mon1 |
2026-05-08 04:21:53.490825 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:21:53.491104 | mon1 | Friday 08 May 2026  04:21:53 +0000 (0:00:00.465)       0:01:47.916 ************
2026-05-08 04:21:53.542683 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml)
2026-05-08 04:21:53.542933 | mon1 |
2026-05-08 04:21:53.543182 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:21:53.543427 | mon1 | Friday 08 May 2026  04:21:53 +0000 (0:00:00.052)       0:01:47.968 ************
2026-05-08 04:21:54.853390 | mon1 | ok: [osd1]
2026-05-08 04:21:54.853444 | mon1 |
2026-05-08 04:21:54.853453 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:21:54.853461 | mon1 | Friday 08 May 2026  04:21:54 +0000 (0:00:01.309)       0:01:49.278 ************
2026-05-08 04:21:55.652659 | mon1 | ok: [osd1] => (item=systemd-timesyncd)
2026-05-08 04:21:55.652721 | mon1 | ok: [osd1] => (item=ssh)
2026-05-08 04:21:55.652735 | mon1 |
2026-05-08 04:21:55.652748 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:21:55.652760 | mon1 | Friday 08 May 2026  04:21:55 +0000 (0:00:00.798)       0:01:50.077 ************
2026-05-08 04:21:56.033258 | mon1 | ok: [osd1]
2026-05-08 04:21:56.033313 | mon1 |
2026-05-08 04:21:56.033327 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:21:56.033340 | mon1 | Friday 08 May 2026  04:21:56 +0000 (0:00:00.381)       0:01:50.458 ************
2026-05-08 04:21:56.278453 | mon1 | ok: [osd1]
2026-05-08 04:21:56.278539 | mon1 |
2026-05-08 04:21:56.278624 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:21:56.278739 | mon1 | Friday 08 May 2026  04:21:56 +0000 (0:00:00.244)       0:01:50.702 ************
2026-05-08 04:21:56.589275 | mon1 | ok: [osd1]
2026-05-08 04:21:56.589357 | mon1 |
2026-05-08 04:21:56.589454 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:21:56.589569 | mon1 | Friday 08 May 2026  04:21:56 +0000 (0:00:00.312)       0:01:51.014 ************
2026-05-08 04:21:56.853465 | mon1 | ok: [osd1]
2026-05-08 04:21:56.853566 | mon1 |
2026-05-08 04:21:56.853577 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-08 04:21:56.853588 | mon1 | Friday 08 May 2026  04:21:56 +0000 (0:00:00.263)       0:01:51.278 ************
2026-05-08 04:21:57.125971 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-08 04:21:57.126027 | mon1 |
2026-05-08 04:21:57.126038 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-08 04:21:57.126047 | mon1 | Friday 08 May 2026  04:21:57 +0000 (0:00:00.272)       0:01:51.551 ************
2026-05-08 04:21:57.178996 | mon1 | ok: [osd1]
2026-05-08 04:21:57.179098 | mon1 |
2026-05-08 04:21:57.179584 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:21:57.179650 | mon1 | Friday 08 May 2026  04:21:57 +0000 (0:00:00.052)       0:01:51.603 ************
2026-05-08 04:21:57.240661 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-08 04:21:57.240696 | mon1 |
2026-05-08 04:21:57.240703 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:21:57.240709 | mon1 | Friday 08 May 2026  04:21:57 +0000 (0:00:00.061)       0:01:51.665 ************
2026-05-08 04:22:03.497234 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:03.497382 | mon1 |
2026-05-08 04:22:03.497441 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:22:03.497558 | mon1 | Friday 08 May 2026  04:22:03 +0000 (0:00:06.257)       0:01:57.922 ************
2026-05-08 04:22:03.553308 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:22:03.553359 | mon1 |
2026-05-08 04:22:03.553372 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:22:03.553385 | mon1 | Friday 08 May 2026  04:22:03 +0000 (0:00:00.055)       0:01:57.978 ************
2026-05-08 04:22:03.881376 | mon1 | ok: [osd1]
2026-05-08 04:22:03.881428 | mon1 |
2026-05-08 04:22:03.881442 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:22:03.881454 | mon1 | Friday 08 May 2026  04:22:03 +0000 (0:00:00.327)       0:01:58.305 ************
2026-05-08 04:22:10.681215 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:10.681267 | mon1 |
2026-05-08 04:22:10.681274 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-08 04:22:10.681280 | mon1 | Friday 08 May 2026  04:22:10 +0000 (0:00:06.797)       0:02:05.103 ************
2026-05-08 04:22:16.245962 | mon1 | ok: [osd1]
2026-05-08 04:22:16.246032 | mon1 |
2026-05-08 04:22:16.246512 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-08 04:22:16.246569 | mon1 | Friday 08 May 2026  04:22:16 +0000 (0:00:05.568)       0:02:10.671 ************
2026-05-08 04:22:38.561197 | mon1 | ok: [osd1]
2026-05-08 04:22:38.561277 | mon1 |
2026-05-08 04:22:38.561396 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-08 04:22:38.561511 | mon1 | Friday 08 May 2026  04:22:38 +0000 (0:00:22.315)       0:02:32.987 ************
2026-05-08 04:22:38.639945 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-05-08 04:22:38.640002 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-05-08 04:22:38.640016 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-05-08 04:22:38.640028 | mon1 | skipping: [osd1]
2026-05-08 04:22:38.640042 | mon1 |
2026-05-08 04:22:38.640055 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-08 04:22:38.640075 | mon1 | Friday 08 May 2026  04:22:38 +0000 (0:00:00.077)       0:02:33.064 ************
2026-05-08 04:22:45.075336 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:45.075434 | mon1 |
2026-05-08 04:22:45.075765 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-08 04:22:45.075838 | mon1 | Friday 08 May 2026  04:22:45 +0000 (0:00:06.436)       0:02:39.500 ************
2026-05-08 04:22:51.317263 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:51.317347 | mon1 |
2026-05-08 04:22:51.320828 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-08 04:22:51.320880 | mon1 | Friday 08 May 2026  04:22:51 +0000 (0:00:06.242)       0:02:45.742 ************
2026-05-08 04:22:51.382423 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-08 04:22:51.382642 | mon1 |
2026-05-08 04:22:51.382894 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-08 04:22:51.383107 | mon1 | Friday 08 May 2026  04:22:51 +0000 (0:00:00.064)       0:02:45.807 ************
2026-05-08 04:22:51.430406 | mon1 | ok: [osd1]
2026-05-08 04:22:51.430853 | mon1 |
2026-05-08 04:22:51.431276 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-08 04:22:51.431689 | mon1 | Friday 08 May 2026  04:22:51 +0000 (0:00:00.047)       0:02:45.855 ************
2026-05-08 04:22:57.741570 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:57.742004 | mon1 |
2026-05-08 04:22:57.742359 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-08 04:22:57.742766 | mon1 | Friday 08 May 2026  04:22:57 +0000 (0:00:06.312)       0:02:52.167 ************
2026-05-08 04:22:57.793750 | mon1 | ok: [osd1]
2026-05-08 04:22:57.794098 | mon1 |
2026-05-08 04:22:57.794419 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-08 04:22:57.794768 | mon1 | Friday 08 May 2026  04:22:57 +0000 (0:00:00.052)       0:02:52.219 ************
2026-05-08 04:22:57.841519 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:22:57.842114 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:22:57.842597 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:22:57.842983 | mon1 | skipping: [osd1]
2026-05-08 04:22:57.843238 | mon1 |
2026-05-08 04:22:57.843544 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-08 04:22:57.843867 | mon1 | Friday 08 May 2026  04:22:57 +0000 (0:00:00.047)       0:02:52.267 ************
2026-05-08 04:22:57.884443 | mon1 | skipping: [osd1]
2026-05-08 04:22:57.884774 | mon1 |
2026-05-08 04:22:57.885167 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:22:57.885520 | mon1 | mon1                       : ok=49   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-05-08 04:22:57.885908 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-05-08 04:22:57.886220 | mon1 |
2026-05-08 04:22:57.886577 | mon1 |
2026-05-08 04:22:57.886996 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:22:57.887329 | mon1 | Friday 08 May 2026  04:22:57 +0000 (0:00:00.043)       0:02:52.310 ************
2026-05-08 04:22:57.887632 | mon1 | ===============================================================================
2026-05-08 04:22:57.888003 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.32s
2026-05-08 04:22:57.888327 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.37s
2026-05-08 04:22:57.888642 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.19s
2026-05-08 04:22:57.889014 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.88s
2026-05-08 04:22:57.889336 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.80s
2026-05-08 04:22:57.889662 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.79s
2026-05-08 04:22:57.890023 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.60s
2026-05-08 04:22:57.890344 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.59s
2026-05-08 04:22:57.890725 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.44s
2026-05-08 04:22:57.891120 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.36s
2026-05-08 04:22:57.891438 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.36s
2026-05-08 04:22:57.891823 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 6.31s
2026-05-08 04:22:57.892169 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.26s
2026-05-08 04:22:57.892502 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 6.24s
2026-05-08 04:22:57.892851 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.57s
2026-05-08 04:22:57.893243 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.41s
2026-05-08 04:22:57.893532 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.31s
2026-05-08 04:22:57.893843 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.28s
2026-05-08 04:22:57.893979 | mon1 | Gathering Facts --------------------------------------------------------- 2.33s
2026-05-08 04:22:57.894108 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.29s
2026-05-08 04:22:57.997199 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-05-08 04:22:58.008739 | mon1 | INFO     [default > side_effect] Executing
2026-05-08 04:22:58.009070 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:22:58.014666 | mon1 | INFO     [default > verify] Executing
2026-05-08 04:22:58.759133 | mon1 |
2026-05-08 04:22:58.759216 | mon1 | PLAY [Verify] ******************************************************************
2026-05-08 04:22:58.759321 | mon1 |
2026-05-08 04:22:58.759456 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:22:58.759589 | mon1 | Friday 08 May 2026  04:22:58 +0000 (0:00:00.008)       0:00:00.008 ************
2026-05-08 04:22:59.952013 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:22:59.952218 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python
2026-05-08 04:22:59.952460 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:22:59.952697 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:22:59.952981 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:22:59.960683 | mon1 | ok: [mon1]
2026-05-08 04:22:59.960980 | mon1 |
2026-05-08 04:22:59.961234 | mon1 | TASK [Get cluster health status] ***********************************************
2026-05-08 04:22:59.961482 | mon1 | Friday 08 May 2026  04:22:59 +0000 (0:00:01.200)       0:00:01.209 ************
2026-05-08 04:23:10.560288 | mon1 | ok: [mon1]
2026-05-08 04:23:10.560488 | mon1 |
2026-05-08 04:23:10.560774 | mon1 | TASK [Print cluster health status] *********************************************
2026-05-08 04:23:10.561061 | mon1 | Friday 08 May 2026  04:23:10 +0000 (0:00:10.599)       0:00:11.808 ************
2026-05-08 04:23:10.596469 | mon1 | ok: [mon1] => {
2026-05-08 04:23:10.596730 | mon1 |     "_ceph_health": {
2026-05-08 04:23:10.597030 | mon1 |         "changed": false,
2026-05-08 04:23:10.597268 | mon1 |         "cmd": [
2026-05-08 04:23:10.597502 | mon1 |             "cephadm",
2026-05-08 04:23:10.597732 | mon1 |             "shell",
2026-05-08 04:23:10.597985 | mon1 |             "--",
2026-05-08 04:23:10.598212 | mon1 |             "ceph",
2026-05-08 04:23:10.598438 | mon1 |             "health"
2026-05-08 04:23:10.598665 | mon1 |         ],
2026-05-08 04:23:10.598933 | mon1 |         "delta": "0:00:10.273076",
2026-05-08 04:23:10.599173 | mon1 |         "end": "2026-05-08 04:23:10.515233",
2026-05-08 04:23:10.599401 | mon1 |         "failed": false,
2026-05-08 04:23:10.599627 | mon1 |         "msg": "",
2026-05-08 04:23:10.599880 | mon1 |         "rc": 0,
2026-05-08 04:23:10.600115 | mon1 |         "start": "2026-05-08 04:23:00.242157",
2026-05-08 04:23:10.600422 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-05-08 04:23:10.600710 | mon1 |         "stderr_lines": [
2026-05-08 04:23:10.600992 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-05-08 04:23:10.601254 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-05-08 04:23:10.601450 | mon1 |         ],
2026-05-08 04:23:10.601599 | mon1 |         "stdout": "HEALTH_OK",
2026-05-08 04:23:10.601745 | mon1 |         "stdout_lines": [
2026-05-08 04:23:10.601925 | mon1 |             "HEALTH_OK"
2026-05-08 04:23:10.602044 | mon1 |         ]
2026-05-08 04:23:10.602191 | mon1 |     }
2026-05-08 04:23:10.602321 | mon1 | }
2026-05-08 04:23:10.602460 | mon1 |
2026-05-08 04:23:10.602610 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-05-08 04:23:10.602759 | mon1 | Friday 08 May 2026  04:23:10 +0000 (0:00:00.036)       0:00:11.845 ************
2026-05-08 04:23:10.626129 | mon1 | ok: [mon1] => {
2026-05-08 04:23:10.626264 | mon1 |     "changed": false,
2026-05-08 04:23:10.626410 | mon1 |     "msg": "All assertions passed"
2026-05-08 04:23:10.626554 | mon1 | }
2026-05-08 04:23:10.626692 | mon1 |
2026-05-08 04:23:10.626862 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-05-08 04:23:10.627014 | mon1 | Friday 08 May 2026  04:23:10 +0000 (0:00:00.029)       0:00:11.875 ************
2026-05-08 04:23:17.586100 | mon1 | changed: [mon1]
2026-05-08 04:23:17.586179 | mon1 |
2026-05-08 04:23:17.586955 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-05-08 04:23:17.587024 | mon1 | Friday 08 May 2026  04:23:17 +0000 (0:00:06.959)       0:00:18.834 ************
2026-05-08 04:23:20.424340 | mon1 | changed: [mon1]
2026-05-08 04:23:20.424562 | mon1 |
2026-05-08 04:23:20.424884 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-05-08 04:23:20.425140 | mon1 | Friday 08 May 2026  04:23:20 +0000 (0:00:02.838)       0:00:21.672 ************
2026-05-08 04:23:21.812884 | mon1 | ok: [mon1]
2026-05-08 04:23:21.812948 | mon1 |
2026-05-08 04:23:21.812964 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-05-08 04:23:21.812977 | mon1 | Friday 08 May 2026  04:23:21 +0000 (0:00:01.387)       0:00:23.060 ************
2026-05-08 04:23:21.848487 | mon1 | ok: [mon1] => {
2026-05-08 04:23:21.848728 | mon1 |     "changed": false,
2026-05-08 04:23:21.849022 | mon1 |     "msg": "All assertions passed"
2026-05-08 04:23:21.849323 | mon1 | }
2026-05-08 04:23:21.849543 | mon1 |
2026-05-08 04:23:21.849701 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:23:21.849907 | mon1 | mon1                       : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-08 04:23:21.850059 | mon1 |
2026-05-08 04:23:21.850202 | mon1 |
2026-05-08 04:23:21.850355 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:23:21.850515 | mon1 | Friday 08 May 2026  04:23:21 +0000 (0:00:00.036)       0:00:23.097 ************
2026-05-08 04:23:21.850679 | mon1 | ===============================================================================
2026-05-08 04:23:21.851965 | mon1 | Get cluster health status ---------------------------------------------- 10.60s
2026-05-08 04:23:21.852040 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.96s
2026-05-08 04:23:21.852054 | mon1 | Create a test Ceph key -------------------------------------------------- 2.84s
2026-05-08 04:23:21.852065 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.39s
2026-05-08 04:23:21.852077 | mon1 | Gathering Facts --------------------------------------------------------- 1.20s
2026-05-08 04:23:21.852088 | mon1 | Print cluster health status --------------------------------------------- 0.04s
2026-05-08 04:23:21.852099 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-05-08 04:23:21.852117 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-05-08 04:23:21.919935 | mon1 | INFO     [default > verify] Executed: Successful
2026-05-08 04:23:21.931165 | mon1 | INFO     [default > cleanup] Executing
2026-05-08 04:23:21.931441 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:23:21.937216 | mon1 | INFO     [default > destroy] Executing
2026-05-08 04:23:21.937249 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-08 04:23:21.937350 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-08 04:23:21.937622 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-05-08 04:23:32.325039 | mon1 | ok: Runtime: 0:12:35.621633
2026-05-08 04:23:32.344345 | 
2026-05-08 04:23:32.344449 | PLAY RECAP
2026-05-08 04:23:32.344541 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:23:32.344590 | 
2026-05-08 04:23:32.462758 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-08 04:23:32.467712 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-08 04:23:33.061756 | 
2026-05-08 04:23:33.061881 | PLAY [all]
2026-05-08 04:23:33.074027 | 
2026-05-08 04:23:33.074104 | TASK [fetch-output : Set log path for multiple nodes]
2026-05-08 04:23:33.126694 | mon1 | ok
2026-05-08 04:23:33.132905 | osd1 | ok
2026-05-08 04:23:33.137685 | 
2026-05-08 04:23:33.137761 | TASK [fetch-output : Set log path for single node]
2026-05-08 04:23:33.162394 | mon1 | skipping: Conditional result was False
2026-05-08 04:23:33.173656 | osd1 | skipping: Conditional result was False
2026-05-08 04:23:33.183814 | 
2026-05-08 04:23:33.183907 | LOOP [fetch-output : Ensure local output dirs]
2026-05-08 04:23:33.549441 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/logs/mon1"
2026-05-08 04:23:33.553282 | osd1 -> localhost | changed: "/var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/logs/osd1"
2026-05-08 04:23:33.747237 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/artifacts"
2026-05-08 04:23:33.770974 | osd1 -> localhost | ok: "/var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/artifacts"
2026-05-08 04:23:33.950320 | mon1 -> localhost | changed: "/var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/docs"
2026-05-08 04:23:33.967783 | osd1 -> localhost | ok: "/var/lib/zuul/builds/8ed541c1e12f4e4fb80a51c885acfc7d/work/docs"
2026-05-08 04:23:33.967955 | osd1 -> localhost | changed: All items complete
2026-05-08 04:23:33.968036 | 
2026-05-08 04:23:33.989459 | 
2026-05-08 04:23:33.989594 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-05-08 04:23:34.617174 | osd1 | changed: .d..t...... ./
2026-05-08 04:23:34.622744 | mon1 | changed: .d..t...... ./
2026-05-08 04:23:35.068613 | osd1 | changed: .d..t...... ./
2026-05-08 04:23:35.078804 | mon1 | ok
2026-05-08 04:23:35.535826 | osd1 | changed: .d..t...... ./
2026-05-08 04:23:35.541065 | mon1 | ok
2026-05-08 04:23:35.563900 | 
2026-05-08 04:23:35.564032 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-05-08 04:23:35.968937 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007333
2026-05-08 04:23:35.969248 | mon1 -> localhost | changed: All items complete
2026-05-08 04:23:35.969278 | 
2026-05-08 04:23:36.185818 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007013
2026-05-08 04:23:36.210788 | 
2026-05-08 04:23:36.210918 | PLAY [all]
2026-05-08 04:23:36.217318 | 
2026-05-08 04:23:36.217380 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-05-08 04:23:36.689005 | mon1 | changed
2026-05-08 04:23:36.933240 | osd1 | changed
2026-05-08 04:23:36.944349 | 
2026-05-08 04:23:36.944394 | PLAY RECAP
2026-05-08 04:23:36.944440 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-08 04:23:36.944468 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-08 04:23:36.944487 | 
2026-05-08 04:23:37.074680 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-08 04:23:37.080112 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-05-08 04:23:37.643791 | 
2026-05-08 04:23:37.643913 | PLAY [localhost]
2026-05-08 04:23:37.653434 | 
2026-05-08 04:23:37.653504 | TASK [Generate Zuul manifest]
2026-05-08 04:23:37.674160 | localhost | ok
2026-05-08 04:23:37.691516 | 
2026-05-08 04:23:37.691592 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-05-08 04:23:38.058718 | localhost | changed
2026-05-08 04:23:38.071754 | 
2026-05-08 04:23:38.071832 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-05-08 04:23:38.102400 | localhost | ok
2026-05-08 04:23:38.110522 | 
2026-05-08 04:23:38.110587 | TASK [Upload logs]
2026-05-08 04:23:38.132398 | localhost | ok
2026-05-08 04:23:38.191226 | 
2026-05-08 04:23:38.191324 | TASK [Set zuul-log-path fact]
2026-05-08 04:23:38.212926 | localhost | ok
2026-05-08 04:23:38.226047 | 
2026-05-08 04:23:38.226108 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-08 04:23:38.257349 | localhost | ok
2026-05-08 04:23:38.266046 | 
2026-05-08 04:23:38.266112 | TASK [upload-logs : Create log directories]
2026-05-08 04:23:38.643012 | localhost | changed
2026-05-08 04:23:38.649391 | 
2026-05-08 04:23:38.649459 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-05-08 04:23:39.054643 | localhost -> localhost | ok: Runtime: 0:00:00.005964
2026-05-08 04:23:39.061262 | 
2026-05-08 04:23:39.061341 | TASK [upload-logs : Upload logs to log server]
2026-05-08 04:23:39.500116 | localhost | Output suppressed because no_log was given
2026-05-08 04:23:39.504086 | 
2026-05-08 04:23:39.504224 | LOOP [upload-logs : Compress console log and json output]
2026-05-08 04:23:39.593301 | localhost | skipping: Conditional result was False
2026-05-08 04:23:39.601888 | localhost | skipping: Conditional result was False
2026-05-08 04:23:39.621146 | 
2026-05-08 04:23:39.621217 | LOOP [upload-logs : Upload compressed console log and json output]
2026-05-08 04:23:39.698265 | localhost | skipping: Conditional result was False
2026-05-08 04:23:39.698566 | 
2026-05-08 04:23:39.702528 | localhost | skipping: Conditional result was False
2026-05-08 04:23:39.748590 | 
2026-05-08 04:23:39.748728 | LOOP [upload-logs : Upload console log and json output]