2026-05-28 02:32:16.795478 | Job console starting
2026-05-28 02:32:16.810583 | Updating git repos
2026-05-28 02:32:16.836259 | Cloning repos into workspace
2026-05-28 02:32:17.549580 | Restoring repo states
2026-05-28 02:32:17.556618 | Merging changes
2026-05-28 02:32:17.878366 | Checking out repos
2026-05-28 02:32:17.996203 | Preparing playbooks
2026-05-28 02:32:20.411918 | Running Ansible setup
2026-05-28 02:32:24.611112 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-28 02:32:25.210734 | 
2026-05-28 02:32:25.211179 | PLAY [localhost]
2026-05-28 02:32:25.218570 | 
2026-05-28 02:32:25.218637 | TASK [Gathering Facts]
2026-05-28 02:32:26.077244 | localhost | ok
2026-05-28 02:32:26.087908 | 
2026-05-28 02:32:26.088011 | TASK [Setup log path fact]
2026-05-28 02:32:26.108783 | localhost | ok
2026-05-28 02:32:26.124692 | 
2026-05-28 02:32:26.124757 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-28 02:32:26.156339 | localhost | ok
2026-05-28 02:32:26.163904 | 
2026-05-28 02:32:26.163982 | TASK [emit-job-header : Print job information]
2026-05-28 02:32:26.206435 | # Job Information
2026-05-28 02:32:26.206679 | Ansible Version: 2.16.18
2026-05-28 02:32:26.206748 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-05-28 02:32:26.206796 | Pipeline: check
2026-05-28 02:32:26.206841 | Executor: 2d72f0692154
2026-05-28 02:32:26.206883 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/111
2026-05-28 02:32:26.206931 | Event ID: 56944ae0-5a3d-11f1-9e87-3bf9ff3e74e6
2026-05-28 02:32:26.211296 | 
2026-05-28 02:32:26.211386 | LOOP [emit-job-header : Print node information]
2026-05-28 02:32:26.306267 | localhost | ok:
2026-05-28 02:32:26.306627 | localhost | # Node Information
2026-05-28 02:32:26.306692 | localhost | Inventory Hostname: mon1
2026-05-28 02:32:26.306741 | localhost | Hostname: np0000177146
2026-05-28 02:32:26.306785 | localhost | Username: zuul
2026-05-28 02:32:26.306834 | localhost | Distro: Ubuntu 22.04
2026-05-28 02:32:26.306877 | localhost | Provider: yul1
2026-05-28 02:32:26.306919 | localhost | Region: ca-ymq-1
2026-05-28 02:32:26.306960 | localhost | Label: ubuntu-jammy
2026-05-28 02:32:26.307000 | localhost | Product Name: OpenStack Nova
2026-05-28 02:32:26.307040 | localhost | Interface IP: 199.19.213.52
2026-05-28 02:32:26.346566 | localhost | ok:
2026-05-28 02:32:26.346679 | localhost | # Node Information
2026-05-28 02:32:26.346739 | localhost | Inventory Hostname: osd1
2026-05-28 02:32:26.346788 | localhost | Hostname: np0000177147
2026-05-28 02:32:26.346834 | localhost | Username: zuul
2026-05-28 02:32:26.346879 | localhost | Distro: Ubuntu 22.04
2026-05-28 02:32:26.346924 | localhost | Provider: yul1
2026-05-28 02:32:26.346968 | localhost | Region: ca-ymq-1
2026-05-28 02:32:26.347012 | localhost | Label: ubuntu-jammy
2026-05-28 02:32:26.347055 | localhost | Product Name: OpenStack Nova
2026-05-28 02:32:26.347100 | localhost | Interface IP: 199.19.213.163
2026-05-28 02:32:26.366739 | 
2026-05-28 02:32:26.366921 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-05-28 02:32:26.808761 | localhost -> localhost | changed
2026-05-28 02:32:26.816522 | 
2026-05-28 02:32:26.816871 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-05-28 02:32:27.632850 | localhost -> localhost | changed
2026-05-28 02:32:27.642846 | 
2026-05-28 02:32:27.642905 | PLAY [all]
2026-05-28 02:32:27.650580 | 
2026-05-28 02:32:27.650649 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-05-28 02:32:27.878275 | mon1 -> localhost | ok
2026-05-28 02:32:27.888606 | 
2026-05-28 02:32:27.888693 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-05-28 02:32:27.922423 | mon1 | ok
2026-05-28 02:32:27.929441 | osd1 | ok
2026-05-28 02:32:27.947989 | mon1 | included: /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-28 02:32:27.948043 | osd1 | included: /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-28 02:32:27.953751 | 
2026-05-28 02:32:27.953811 | TASK [add-build-sshkey : Create Temp SSH key]
2026-05-28 02:32:28.953238 | mon1 -> localhost | Generating public/private rsa key pair.
2026-05-28 02:32:28.953607 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/487845e3033a45d69500c148e739155e_id_rsa
2026-05-28 02:32:28.953691 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/487845e3033a45d69500c148e739155e_id_rsa.pub
2026-05-28 02:32:28.953759 | mon1 -> localhost | The key fingerprint is:
2026-05-28 02:32:28.953872 | mon1 -> localhost | SHA256:SQVyoAMasWYyOo51rfJj5SdEVe2di7hpCVeEOxgigsg zuul-build-sshkey
2026-05-28 02:32:28.953930 | mon1 -> localhost | The key's randomart image is:
2026-05-28 02:32:28.953978 | mon1 -> localhost | +---[RSA 3072]----+
2026-05-28 02:32:28.954067 | mon1 -> localhost | |=o.   o.oooo     |
2026-05-28 02:32:28.954162 | mon1 -> localhost | |oE.....oo.. o    |
2026-05-28 02:32:28.954214 | mon1 -> localhost | |=o .o. o.o + . . |
2026-05-28 02:32:28.954277 | mon1 -> localhost | |=.   o....o o o  |
2026-05-28 02:32:28.954342 | mon1 -> localhost | |o . ... S  + . . |
2026-05-28 02:32:28.954400 | mon1 -> localhost | |oo . .o . o . .  |
2026-05-28 02:32:28.954493 | mon1 -> localhost | |... .+   o +     |
2026-05-28 02:32:28.954558 | mon1 -> localhost | |   oo o . =      |
2026-05-28 02:32:28.954607 | mon1 -> localhost | |   ... o .       |
2026-05-28 02:32:28.954651 | mon1 -> localhost | +----[SHA256]-----+
2026-05-28 02:32:28.954775 | mon1 -> localhost | ok: Runtime: 0:00:00.591824
2026-05-28 02:32:28.961292 | 
2026-05-28 02:32:28.961371 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-05-28 02:32:29.012001 | mon1 | ok
2026-05-28 02:32:29.017687 | osd1 | ok
2026-05-28 02:32:29.030974 | mon1 | included: /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-28 02:32:29.031032 | osd1 | included: /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-28 02:32:29.041684 | 
2026-05-28 02:32:29.041753 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-05-28 02:32:29.068223 | mon1 | skipping: Conditional result was False
2026-05-28 02:32:29.079893 | osd1 | skipping: Conditional result was False
2026-05-28 02:32:29.093667 | 
2026-05-28 02:32:29.093847 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-05-28 02:32:29.780227 | osd1 | changed
2026-05-28 02:32:29.819471 | mon1 | changed
2026-05-28 02:32:29.824995 | 
2026-05-28 02:32:29.825077 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-05-28 02:32:30.014099 | mon1 | ok
2026-05-28 02:32:30.036831 | osd1 | ok
2026-05-28 02:32:30.042298 | 
2026-05-28 02:32:30.042400 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-05-28 02:32:30.529057 | mon1 | changed
2026-05-28 02:32:30.533313 | osd1 | changed
2026-05-28 02:32:30.537884 | 
2026-05-28 02:32:30.537941 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-05-28 02:32:31.015169 | mon1 | changed
2026-05-28 02:32:31.019360 | osd1 | changed
2026-05-28 02:32:31.023853 | 
2026-05-28 02:32:31.023909 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-05-28 02:32:31.046648 | mon1 | skipping: Conditional result was False
2026-05-28 02:32:31.057528 | osd1 | skipping: Conditional result was False
2026-05-28 02:32:31.064466 | 
2026-05-28 02:32:31.064550 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-05-28 02:32:31.361969 | mon1 -> localhost | changed
2026-05-28 02:32:31.380816 | 
2026-05-28 02:32:31.380875 | TASK [add-build-sshkey : Add back temp key]
2026-05-28 02:32:31.637174 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/487845e3033a45d69500c148e739155e_id_rsa (zuul-build-sshkey)
2026-05-28 02:32:31.637558 | mon1 -> localhost | ok: Runtime: 0:00:00.011580
2026-05-28 02:32:31.643183 | 
2026-05-28 02:32:31.643241 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-05-28 02:32:31.905856 | mon1 | ok
2026-05-28 02:32:31.946573 | osd1 | ok
2026-05-28 02:32:31.952844 | 
2026-05-28 02:32:31.952931 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-05-28 02:32:31.981648 | mon1 | skipping: Conditional result was False
2026-05-28 02:32:31.993584 | osd1 | skipping: Conditional result was False
2026-05-28 02:32:32.014311 | 
2026-05-28 02:32:32.014409 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-05-28 02:32:32.289591 | osd1 | ok
2026-05-28 02:32:32.294077 | mon1 | ok
2026-05-28 02:32:32.299701 | 
2026-05-28 02:32:32.299762 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-05-28 02:32:32.959623 | mon1 | Output suppressed because no_log was given
2026-05-28 02:32:32.968216 | osd1 | Output suppressed because no_log was given
2026-05-28 02:32:32.981758 | 
2026-05-28 02:32:32.981888 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-05-28 02:32:33.158798 | mon1 | ok: "logs"
2026-05-28 02:32:33.159514 | mon1 | ok: All items complete
2026-05-28 02:32:33.159581 | 
2026-05-28 02:32:33.165315 | osd1 | ok: "logs"
2026-05-28 02:32:33.328653 | osd1 | ok: "artifacts"
2026-05-28 02:32:33.334210 | mon1 | ok: "artifacts"
2026-05-28 02:32:33.478487 | osd1 | ok: "docs"
2026-05-28 02:32:33.498091 | mon1 | ok: "docs"
2026-05-28 02:32:33.516680 | 
2026-05-28 02:32:33.516882 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-05-28 02:32:33.700510 | mon1 | changed: "logs"
2026-05-28 02:32:33.701268 | mon1 | ok: All items complete
2026-05-28 02:32:33.701358 | 
2026-05-28 02:32:33.711521 | osd1 | changed: "logs"
2026-05-28 02:32:33.846131 | mon1 | changed: "artifacts"
2026-05-28 02:32:33.867492 | osd1 | changed: "artifacts"
2026-05-28 02:32:33.996920 | mon1 | changed: "docs"
2026-05-28 02:32:34.009774 | osd1 | changed: "docs"
2026-05-28 02:32:34.039452 | 
2026-05-28 02:32:34.039520 | PLAY RECAP
2026-05-28 02:32:34.039582 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:32:34.039624 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-28 02:32:34.039660 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-28 02:32:34.039686 | 
2026-05-28 02:32:34.220706 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-28 02:32:34.226222 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-28 02:32:34.800243 | 
2026-05-28 02:32:34.800373 | PLAY [all]
2026-05-28 02:32:34.810903 | 
2026-05-28 02:32:34.810985 | TASK [setup-uv : Extract archive]
2026-05-28 02:32:37.014954 | mon1 | changed
2026-05-28 02:32:37.032814 | osd1 | changed
2026-05-28 02:32:37.040834 | 
2026-05-28 02:32:37.040913 | TASK [setup-uv : Print version]
2026-05-28 02:32:37.096771 | osd1 | uv 0.8.13
2026-05-28 02:32:35.984199 | mon1 | uv 0.8.13
2026-05-28 02:32:37.603332 | mon1 | ok: Runtime: 0:00:00.012580
2026-05-28 02:32:37.611621 | osd1 | ok: Runtime: 0:00:00.012388
2026-05-28 02:32:37.624510 | 
2026-05-28 02:32:37.624575 | TASK [Install Ansible collection siblings]
2026-05-28 02:32:37.982567 | mon1 | ok:
2026-05-28 02:32:37.982808 | mon1 | Skipping community.general: no checked-out sibling
2026-05-28 02:32:37.982873 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-05-28 02:32:37.982922 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-05-28 02:32:37.985542 | 
2026-05-28 02:32:37.985591 | PLAY RECAP
2026-05-28 02:32:37.985635 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:32:37.985677 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:32:37.985698 | 
2026-05-28 02:32:38.098492 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-28 02:32:38.103483 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-28 02:32:38.685222 | 
2026-05-28 02:32:38.685346 | PLAY [all]
2026-05-28 02:32:38.696068 | 
2026-05-28 02:32:38.696139 | TASK [Copy inventory file for Zuul]
2026-05-28 02:32:39.509985 | mon1 | changed
2026-05-28 02:32:39.517024 | 
2026-05-28 02:32:39.517095 | TASK [Switch "ansible_host" to private IP]
2026-05-28 02:32:39.823964 | mon1 | changed: 2 replacements made
2026-05-28 02:32:39.828890 | 
2026-05-28 02:32:39.828971 | TASK [Run Molecule scenario]
2026-05-28 02:32:40.401596 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-05-28 02:32:41.129476 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-05-28 02:32:41.328669 | mon1 | Using CPython 3.13.7
2026-05-28 02:32:41.328883 | mon1 | Creating virtual environment at: .venv
2026-05-28 02:32:41.567298 | mon1 | Downloading cryptography (4.3MiB)
2026-05-28 02:32:41.570134 | mon1 | Downloading netaddr (2.2MiB)
2026-05-28 02:32:41.570420 | mon1 | Downloading ansible-core (2.1MiB)
2026-05-28 02:32:41.571109 | mon1 | Downloading pygments (1.2MiB)
2026-05-28 02:32:41.742390 | mon1 |  Downloading netaddr
2026-05-28 02:32:41.751043 | mon1 |  Downloading cryptography
2026-05-28 02:32:41.797196 | mon1 |  Downloading pygments
2026-05-28 02:32:41.934430 | mon1 |  Downloading ansible-core
2026-05-28 02:32:41.970147 | mon1 | Installed 36 packages in 34ms
2026-05-28 02:32:43.058756 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-05-28 02:32:43.058844 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-05-28 02:32:43.720238 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-05-28 02:32:43.720339 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-05-28 02:32:59.946160 | mon1 | INFO     [default > dependency] Executing
2026-05-28 02:32:59.946384 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-05-28 02:32:59.946626 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-05-28 02:32:59.946860 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-05-28 02:33:00.038660 | mon1 | INFO     [default > cleanup] Executing
2026-05-28 02:33:00.524620 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:33:00.533939 | mon1 | INFO     [default > destroy] Executing
2026-05-28 02:33:00.533981 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-28 02:33:00.534087 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-28 02:33:00.773237 | mon1 | INFO     [default > syntax] Executing
2026-05-28 02:33:01.784068 | mon1 |
2026-05-28 02:33:01.784273 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-05-28 02:33:01.871317 | mon1 | INFO     [default > syntax] Executed: Successful
2026-05-28 02:33:01.880781 | mon1 | INFO     [default > create] Executing
2026-05-28 02:33:01.882174 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:33:01.887208 | mon1 | INFO     [default > prepare] Executing
2026-05-28 02:33:02.580633 | mon1 |
2026-05-28 02:33:02.580905 | mon1 | PLAY [Prepare] *****************************************************************
2026-05-28 02:33:02.581194 | mon1 |
2026-05-28 02:33:02.581503 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:33:02.581894 | mon1 | Thursday 28 May 2026  02:33:02 +0000 (0:00:00.031)       0:00:00.031 **********
2026-05-28 02:33:03.730543 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:33:03.730727 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:33:03.730953 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:33:03.731169 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:33:03.731394 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:33:03.808212 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-28 02:33:03.808392 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:33:03.808588 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:33:03.808784 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:33:03.808987 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:33:03.816440 | mon1 | ok: [mon1]
2026-05-28 02:33:03.816624 | mon1 | ok: [osd1]
2026-05-28 02:33:03.816803 | mon1 |
2026-05-28 02:33:03.817003 | mon1 | TASK [Configure short hostname] ************************************************
2026-05-28 02:33:03.817200 | mon1 | Thursday 28 May 2026  02:33:03 +0000 (0:00:01.236)       0:00:01.268 **********
2026-05-28 02:33:04.505932 | mon1 | changed: [mon1]
2026-05-28 02:33:04.506053 | mon1 | changed: [osd1]
2026-05-28 02:33:04.506245 | mon1 |
2026-05-28 02:33:04.506444 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-05-28 02:33:04.506650 | mon1 | Thursday 28 May 2026  02:33:04 +0000 (0:00:00.689)       0:00:01.957 **********
2026-05-28 02:33:04.786363 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-05-28 02:33:04.786519 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-05-28 02:33:04.786736 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-05-28 02:33:04.797701 | mon1 | changed: [osd1]
2026-05-28 02:33:04.797947 | mon1 | changed: [mon1]
2026-05-28 02:33:04.798170 | mon1 |
2026-05-28 02:33:04.798383 | mon1 | TASK [Update apt cache] ********************************************************
2026-05-28 02:33:04.798603 | mon1 | Thursday 28 May 2026  02:33:04 +0000 (0:00:00.291)       0:00:02.249 **********
2026-05-28 02:33:41.648490 | mon1 | changed: [osd1]
2026-05-28 02:33:41.648642 | mon1 | changed: [mon1]
2026-05-28 02:33:41.648822 | mon1 |
2026-05-28 02:33:41.649045 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-05-28 02:33:41.649204 | mon1 |
2026-05-28 02:33:41.649425 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:33:41.649617 | mon1 | Thursday 28 May 2026  02:33:41 +0000 (0:00:36.850)       0:00:39.100 **********
2026-05-28 02:33:42.372090 | mon1 | ok: [osd1]
2026-05-28 02:33:42.372195 | mon1 |
2026-05-28 02:33:42.372392 | mon1 | TASK [Install depedencies] *****************************************************
2026-05-28 02:33:42.372600 | mon1 | Thursday 28 May 2026  02:33:42 +0000 (0:00:00.723)       0:00:39.823 **********
2026-05-28 02:34:03.962618 | mon1 | changed: [osd1]
2026-05-28 02:34:03.962703 | mon1 |
2026-05-28 02:34:03.962824 | mon1 | TASK [Start up service] ********************************************************
2026-05-28 02:34:03.963143 | mon1 | Thursday 28 May 2026  02:34:03 +0000 (0:00:21.588)       0:01:01.411 **********
2026-05-28 02:34:04.511396 | mon1 | ok: [osd1]
2026-05-28 02:34:04.511553 | mon1 |
2026-05-28 02:34:04.511763 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-05-28 02:34:04.511971 | mon1 | Thursday 28 May 2026  02:34:04 +0000 (0:00:00.550)       0:01:01.962 **********
2026-05-28 02:34:04.817803 | mon1 | ok: [osd1]
2026-05-28 02:34:04.817967 | mon1 |
2026-05-28 02:34:04.818191 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-05-28 02:34:04.818448 | mon1 | Thursday 28 May 2026  02:34:04 +0000 (0:00:00.306)       0:01:02.269 **********
2026-05-28 02:34:05.467237 | mon1 | changed: [osd1]
2026-05-28 02:34:05.467381 | mon1 |
2026-05-28 02:34:05.467588 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-05-28 02:34:05.467785 | mon1 | Thursday 28 May 2026  02:34:05 +0000 (0:00:00.649)       0:01:02.918 **********
2026-05-28 02:34:05.662894 | mon1 | ok: [osd1]
2026-05-28 02:34:05.663077 | mon1 |
2026-05-28 02:34:05.663289 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-05-28 02:34:05.663521 | mon1 | Thursday 28 May 2026  02:34:05 +0000 (0:00:00.195)       0:01:03.114 **********
2026-05-28 02:34:05.683520 | mon1 | skipping: [osd1]
2026-05-28 02:34:05.683674 | mon1 |
2026-05-28 02:34:05.683875 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-05-28 02:34:05.684089 | mon1 | Thursday 28 May 2026  02:34:05 +0000 (0:00:00.021)       0:01:03.135 **********
2026-05-28 02:34:07.248603 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:34:07.248652 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:34:07.248658 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:34:07.248662 | mon1 |
2026-05-28 02:34:07.248667 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-05-28 02:34:07.248671 | mon1 | Thursday 28 May 2026  02:34:07 +0000 (0:00:01.561)       0:01:04.697 **********
2026-05-28 02:34:07.885527 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:34:07.885726 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:34:07.885939 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:34:07.886129 | mon1 |
2026-05-28 02:34:07.886342 | mon1 | TASK [Start loop devices] ******************************************************
2026-05-28 02:34:07.886580 | mon1 | Thursday 28 May 2026  02:34:07 +0000 (0:00:00.639)       0:01:05.337 **********
2026-05-28 02:34:08.589584 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:34:08.589808 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:34:08.590041 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:34:08.590264 | mon1 |
2026-05-28 02:34:08.590501 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-05-28 02:34:08.590720 | mon1 | Thursday 28 May 2026  02:34:08 +0000 (0:00:00.703)       0:01:06.040 **********
2026-05-28 02:34:12.017086 | mon1 | changed: [osd1] => (item=osd0)
2026-05-28 02:34:12.017261 | mon1 | changed: [osd1] => (item=osd1)
2026-05-28 02:34:12.017618 | mon1 | changed: [osd1] => (item=osd2)
2026-05-28 02:34:12.017878 | mon1 |
2026-05-28 02:34:12.018087 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-05-28 02:34:12.018293 | mon1 | Thursday 28 May 2026  02:34:12 +0000 (0:00:03.427)       0:01:09.468 **********
2026-05-28 02:34:13.818330 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-05-28 02:34:13.818556 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-05-28 02:34:13.818759 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-05-28 02:34:13.818946 | mon1 |
2026-05-28 02:34:13.819189 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:34:13.819419 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-28 02:34:13.819709 | mon1 | osd1                       : ok=15   changed=10   unreachable=0    failed=0    skipped=1    rescued=0    ignored=0
2026-05-28 02:34:13.819899 | mon1 |
2026-05-28 02:34:13.820068 | mon1 |
2026-05-28 02:34:13.820262 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:34:13.820454 | mon1 | Thursday 28 May 2026  02:34:13 +0000 (0:00:01.801)       0:01:11.270 **********
2026-05-28 02:34:13.820639 | mon1 | ===============================================================================
2026-05-28 02:34:13.820833 | mon1 | Update apt cache ------------------------------------------------------- 36.85s
2026-05-28 02:34:13.821022 | mon1 | Install depedencies ---------------------------------------------------- 21.59s
2026-05-28 02:34:13.821212 | mon1 | Create a volume group for each loop device ------------------------------ 3.43s
2026-05-28 02:34:13.821409 | mon1 | Create a logical volume for each loop device ---------------------------- 1.80s
2026-05-28 02:34:13.821598 | mon1 | Create devices for Ceph ------------------------------------------------- 1.56s
2026-05-28 02:34:13.821783 | mon1 | Gathering Facts --------------------------------------------------------- 1.24s
2026-05-28 02:34:13.821968 | mon1 | Gathering Facts --------------------------------------------------------- 0.72s
2026-05-28 02:34:13.822161 | mon1 | Start loop devices ------------------------------------------------------ 0.70s
2026-05-28 02:34:13.822352 | mon1 | Configure short hostname ------------------------------------------------ 0.69s
2026-05-28 02:34:13.822540 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.65s
2026-05-28 02:34:13.822734 | mon1 | Set permissions on loopback devices ------------------------------------- 0.64s
2026-05-28 02:34:13.822926 | mon1 | Start up service -------------------------------------------------------- 0.55s
2026-05-28 02:34:13.823146 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.31s
2026-05-28 02:34:13.823338 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.29s
2026-05-28 02:34:13.823538 | mon1 | Get list of all loopback devices ---------------------------------------- 0.20s
2026-05-28 02:34:13.823768 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.02s
2026-05-28 02:34:13.899642 | mon1 | INFO     [default > prepare] Executed: Successful
2026-05-28 02:34:13.909034 | mon1 | INFO     [default > converge] Executing
2026-05-28 02:34:14.810651 | mon1 |
2026-05-28 02:34:14.810888 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-28 02:34:14.811197 | mon1 |
2026-05-28 02:34:14.811474 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:34:14.811772 | mon1 | Thursday 28 May 2026  02:34:14 +0000 (0:00:00.048)       0:00:00.048 **********
2026-05-28 02:34:15.775376 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:34:15.775639 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:34:15.775899 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:34:15.776154 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:34:15.776429 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:34:15.787246 | mon1 | ok: [mon1]
2026-05-28 02:34:15.787477 | mon1 |
2026-05-28 02:34:15.787731 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:34:15.787973 | mon1 | Thursday 28 May 2026  02:34:15 +0000 (0:00:00.976)       0:00:01.025 **********
2026-05-28 02:34:16.069717 | mon1 | ok: [mon1]
2026-05-28 02:34:16.069886 | mon1 |
2026-05-28 02:34:16.070103 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:34:16.070313 | mon1 | Thursday 28 May 2026  02:34:16 +0000 (0:00:00.282)       0:00:01.307 **********
2026-05-28 02:34:16.102645 | mon1 | skipping: [mon1]
2026-05-28 02:34:16.102840 | mon1 |
2026-05-28 02:34:16.103104 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:34:16.103312 | mon1 | Thursday 28 May 2026  02:34:16 +0000 (0:00:00.033)       0:00:01.341 **********
2026-05-28 02:34:16.393232 | mon1 | changed: [mon1]
2026-05-28 02:34:16.393424 | mon1 |
2026-05-28 02:34:16.393645 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:34:16.393845 | mon1 | Thursday 28 May 2026  02:34:16 +0000 (0:00:00.290)       0:00:01.631 **********
2026-05-28 02:34:16.488061 | mon1 | ok: [mon1] => {
2026-05-28 02:34:16.488255 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:34:16.488459 | mon1 | }
2026-05-28 02:34:16.488636 | mon1 |
2026-05-28 02:34:16.488842 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:34:16.489041 | mon1 | Thursday 28 May 2026  02:34:16 +0000 (0:00:00.095)       0:00:01.726 **********
2026-05-28 02:34:17.104173 | mon1 | changed: [mon1]
2026-05-28 02:34:17.104372 | mon1 |
2026-05-28 02:34:17.104685 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:34:17.104898 | mon1 | Thursday 28 May 2026  02:34:17 +0000 (0:00:00.615)       0:00:02.341 **********
2026-05-28 02:34:17.154191 | mon1 | skipping: [mon1]
2026-05-28 02:34:17.154355 | mon1 |
2026-05-28 02:34:17.154565 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:34:17.154782 | mon1 | Thursday 28 May 2026  02:34:17 +0000 (0:00:00.050)       0:00:02.392 **********
2026-05-28 02:34:17.194007 | mon1 | skipping: [mon1]
2026-05-28 02:34:17.194199 | mon1 |
2026-05-28 02:34:17.194428 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:34:17.194665 | mon1 | Thursday 28 May 2026  02:34:17 +0000 (0:00:00.039)       0:00:02.432 **********
2026-05-28 02:34:17.385466 | mon1 | ok: [mon1]
2026-05-28 02:34:17.385610 | mon1 |
2026-05-28 02:34:17.385826 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:34:17.386035 | mon1 | Thursday 28 May 2026  02:34:17 +0000 (0:00:00.191)       0:00:02.623 **********
2026-05-28 02:34:18.810666 | mon1 | ok: [mon1]
2026-05-28 02:34:18.810873 | mon1 |
2026-05-28 02:34:18.811181 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:34:18.811420 | mon1 | Thursday 28 May 2026  02:34:18 +0000 (0:00:01.425)       0:00:04.048 **********
2026-05-28 02:34:18.886535 | mon1 | ok: [mon1] => {
2026-05-28 02:34:18.886792 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:34:18.887127 | mon1 | }
2026-05-28 02:34:18.887359 | mon1 |
2026-05-28 02:34:18.887648 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:34:18.887977 | mon1 | Thursday 28 May 2026  02:34:18 +0000 (0:00:00.076)       0:00:04.124 **********
2026-05-28 02:34:20.339537 | mon1 | changed: [mon1]
2026-05-28 02:34:20.339589 | mon1 |
2026-05-28 02:34:20.339596 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:34:20.339608 | mon1 | Thursday 28 May 2026  02:34:20 +0000 (0:00:01.452)       0:00:05.576 **********
2026-05-28 02:34:23.332029 | mon1 | changed: [mon1]
2026-05-28 02:34:23.332100 | mon1 |
2026-05-28 02:34:23.332134 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:34:23.332290 | mon1 | Thursday 28 May 2026  02:34:23 +0000 (0:00:02.993)       0:00:08.570 **********
2026-05-28 02:34:23.356968 | mon1 | skipping: [mon1]
2026-05-28 02:34:23.357031 | mon1 |
2026-05-28 02:34:23.357265 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:34:23.357454 | mon1 | Thursday 28 May 2026  02:34:23 +0000 (0:00:00.024)       0:00:08.595 **********
2026-05-28 02:34:23.380318 | mon1 | skipping: [mon1]
2026-05-28 02:34:23.380384 | mon1 |
2026-05-28 02:34:23.380560 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:34:23.380593 | mon1 | Thursday 28 May 2026  02:34:23 +0000 (0:00:00.023)       0:00:08.618 **********
2026-05-28 02:34:23.409211 | mon1 | skipping: [mon1]
2026-05-28 02:34:23.409287 | mon1 |
2026-05-28 02:34:23.409385 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:34:23.409479 | mon1 | Thursday 28 May 2026  02:34:23 +0000 (0:00:00.029)       0:00:08.648 **********
2026-05-28 02:34:29.380198 | mon1 | changed: [mon1]
2026-05-28 02:34:29.380277 | mon1 |
2026-05-28 02:34:29.380332 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:34:29.380452 | mon1 | Thursday 28 May 2026  02:34:29 +0000 (0:00:05.970)       0:00:14.618 **********
2026-05-28 02:34:29.921344 | mon1 | changed: [mon1]
2026-05-28 02:34:29.921417 | mon1 |
2026-05-28 02:34:29.921487 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:34:29.921605 | mon1 | Thursday 28 May 2026  02:34:29 +0000 (0:00:00.541)       0:00:15.159 **********
2026-05-28 02:34:30.808227 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:34:30.808304 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:34:30.808359 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:34:30.808846 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:34:30.808886 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:34:30.808892 | mon1 |
2026-05-28 02:34:30.808897 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:34:30.808902 | mon1 | Thursday 28 May 2026  02:34:30 +0000 (0:00:00.886)       0:00:16.046 **********
2026-05-28 02:34:31.446622 | mon1 | changed: [mon1]
2026-05-28 02:34:31.446691 | mon1 |
2026-05-28 02:34:31.446760 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:34:31.447050 | mon1 | Thursday 28 May 2026  02:34:31 +0000 (0:00:00.632)       0:00:16.679 **********
2026-05-28 02:34:31.447308 | mon1 |
2026-05-28 02:34:31.447334 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:34:31.447345 | mon1 | Thursday 28 May 2026  02:34:31 +0000 (0:00:00.005)       0:00:16.685 **********
2026-05-28 02:34:32.287348 | mon1 | ok: [mon1]
2026-05-28 02:34:32.287412 | mon1 |
2026-05-28 02:34:32.287504 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-28 02:34:32.287649 | mon1 | Thursday 28 May 2026  02:34:32 +0000 (0:00:00.840)       0:00:17.525 **********
2026-05-28 02:34:32.750292 | mon1 | changed: [mon1]
2026-05-28 02:34:32.750416 | mon1 |
2026-05-28 02:34:32.750425 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:34:32.750542 | mon1 | Thursday 28 May 2026  02:34:32 +0000 (0:00:00.462)       0:00:17.988 **********
2026-05-28 02:34:33.304897 | mon1 | changed: [mon1]
2026-05-28 02:34:33.304937 | mon1 |
2026-05-28 02:34:33.304944 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:34:33.304949 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.554)       0:00:18.543 **********
2026-05-28 02:34:33.500545 | mon1 | ok: [mon1]
2026-05-28 02:34:33.500624 | mon1 |
2026-05-28 02:34:33.500823 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:34:33.500866 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.195)       0:00:18.738 **********
2026-05-28 02:34:33.567157 | mon1 | ok: [mon1] => {
2026-05-28 02:34:33.567266 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:34:33.567637 | mon1 | }
2026-05-28 02:34:33.567685 | mon1 |
2026-05-28 02:34:33.567692 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:34:33.567697 | mon1 | Thursday 28 May 2026  02:34:33 +0000 (0:00:00.066)       0:00:18.805 **********
2026-05-28 02:34:34.505907 | mon1 | changed: [mon1]
2026-05-28 02:34:34.505981 | mon1 |
2026-05-28 02:34:34.506038 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:34:34.506169 | mon1 | Thursday 28 May 2026  02:34:34 +0000 (0:00:00.938)       0:00:19.744 **********
2026-05-28 02:34:38.860285 | mon1 | changed: [mon1]
2026-05-28 02:34:38.860362 | mon1 |
2026-05-28 02:34:38.860426 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:34:38.860562 | mon1 | Thursday 28 May 2026  02:34:38 +0000 (0:00:04.354)       0:00:24.098 **********
2026-05-28 02:34:39.856534 | mon1 | ok: [mon1]
2026-05-28 02:34:39.856600 | mon1 |
2026-05-28 02:34:39.856686 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:34:39.856823 | mon1 | Thursday 28 May 2026  02:34:39 +0000 (0:00:00.996)       0:00:25.094 **********
2026-05-28 02:34:40.196561 | mon1 | changed: [mon1]
2026-05-28 02:34:40.196630 | mon1 |
2026-05-28 02:34:40.196832 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:34:40.196877 | mon1 | Thursday 28 May 2026  02:34:40 +0000 (0:00:00.339)       0:00:25.434 **********
2026-05-28 02:34:40.650568 | mon1 | changed: [mon1]
2026-05-28 02:34:40.650654 | mon1 |
2026-05-28 02:34:40.650728 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:34:40.650847 | mon1 | Thursday 28 May 2026  02:34:40 +0000 (0:00:00.454)       0:00:25.889 **********
2026-05-28 02:34:41.210887 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:34:41.211009 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:34:41.211433 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:34:41.211500 | mon1 |
2026-05-28 02:34:41.211507 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:34:41.211512 | mon1 | Thursday 28 May 2026  02:34:41 +0000 (0:00:00.560)       0:00:26.449 **********
2026-05-28 02:34:41.668872 | mon1 | changed: [mon1]
2026-05-28 02:34:41.668961 | mon1 |
2026-05-28 02:34:41.668975 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:34:41.669093 | mon1 | Thursday 28 May 2026  02:34:41 +0000 (0:00:00.457)       0:00:26.906 **********
2026-05-28 02:34:42.119340 | mon1 | changed: [mon1]
2026-05-28 02:34:42.119410 | mon1 |
2026-05-28 02:34:42.119904 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:34:42.119971 | mon1 | Thursday 28 May 2026  02:34:42 +0000 (0:00:00.444)       0:00:27.351 **********
2026-05-28 02:34:42.119977 | mon1 |
2026-05-28 02:34:42.119982 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:34:42.119999 | mon1 | Thursday 28 May 2026  02:34:42 +0000 (0:00:00.006)       0:00:27.357 **********
2026-05-28 02:34:42.773267 | mon1 | ok: [mon1]
2026-05-28 02:34:42.773380 | mon1 |
2026-05-28 02:34:42.773397 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-28 02:34:42.773533 | mon1 | Thursday 28 May 2026  02:34:42 +0000 (0:00:00.654)       0:00:28.011 **********
2026-05-28 02:34:44.440237 | mon1 | changed: [mon1]
2026-05-28 02:34:44.440318 | mon1 |
2026-05-28 02:34:44.440652 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:34:44.440703 | mon1 | Thursday 28 May 2026  02:34:44 +0000 (0:00:01.666)       0:00:29.678 **********
2026-05-28 02:34:44.969062 | mon1 | changed: [mon1]
2026-05-28 02:34:44.969135 | mon1 |
2026-05-28 02:34:44.969211 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:34:44.969344 | mon1 | Thursday 28 May 2026  02:34:44 +0000 (0:00:00.529)       0:00:30.207 **********
2026-05-28 02:34:45.015603 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-28 02:34:45.015992 | mon1 |
2026-05-28 02:34:45.016015 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:34:45.016021 | mon1 | Thursday 28 May 2026  02:34:45 +0000 (0:00:00.046)       0:00:30.253 **********
2026-05-28 02:35:24.024384 | mon1 | changed: [mon1]
2026-05-28 02:35:24.024464 | mon1 |
2026-05-28 02:35:24.024736 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:35:24.024757 | mon1 | Thursday 28 May 2026  02:35:24 +0000 (0:00:39.009)       0:01:09.262 **********
2026-05-28 02:35:24.648093 | mon1 | ok: [mon1] => (item=chronyd)
2026-05-28 02:35:24.648159 | mon1 | ok: [mon1] => (item=sshd)
2026-05-28 02:35:24.648253 | mon1 |
2026-05-28 02:35:24.648507 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:35:24.648656 | mon1 | Thursday 28 May 2026  02:35:24 +0000 (0:00:00.623)       0:01:09.886 **********
2026-05-28 02:35:24.937404 | mon1 | changed: [mon1]
2026-05-28 02:35:24.937479 | mon1 |
2026-05-28 02:35:24.937538 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:35:24.937655 | mon1 | Thursday 28 May 2026  02:35:24 +0000 (0:00:00.289)       0:01:10.175 **********
2026-05-28 02:35:25.130302 | mon1 | ok: [mon1]
2026-05-28 02:35:25.130371 | mon1 |
2026-05-28 02:35:25.130564 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:35:25.130742 | mon1 | Thursday 28 May 2026  02:35:25 +0000 (0:00:00.192)       0:01:10.368 **********
2026-05-28 02:35:26.036069 | mon1 | changed: [mon1]
2026-05-28 02:35:26.036142 | mon1 |
2026-05-28 02:35:26.036207 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:35:26.036307 | mon1 | Thursday 28 May 2026  02:35:26 +0000 (0:00:00.905)       0:01:11.274 **********
2026-05-28 02:35:26.338646 | mon1 | changed: [mon1]
2026-05-28 02:35:26.338720 | mon1 |
2026-05-28 02:35:26.338782 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-28 02:35:26.338925 | mon1 | Thursday 28 May 2026  02:35:26 +0000 (0:00:00.302)       0:01:11.577 **********
2026-05-28 02:35:26.454554 | mon1 | ok: [mon1]
2026-05-28 02:35:26.454632 | mon1 |
2026-05-28 02:35:26.454921 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-28 02:35:26.454973 | mon1 | Thursday 28 May 2026  02:35:26 +0000 (0:00:00.115)       0:01:11.692 **********
2026-05-28 02:35:26.665158 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:35:26.665209 | mon1 |
2026-05-28 02:35:26.665216 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-28 02:35:26.665223 | mon1 | Thursday 28 May 2026  02:35:26 +0000 (0:00:00.210)       0:01:11.902 **********
2026-05-28 02:35:26.706880 | mon1 | ok: [mon1]
2026-05-28 02:35:26.706957 | mon1 |
2026-05-28 02:35:26.706967 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-28 02:35:26.706976 | mon1 | Thursday 28 May 2026  02:35:26 +0000 (0:00:00.041)       0:01:11.944 **********
2026-05-28 02:35:26.780105 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-05-28 02:35:26.780189 | mon1 |
2026-05-28 02:35:26.780201 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-05-28 02:35:26.780309 | mon1 | Thursday 28 May 2026  02:35:26 +0000 (0:00:00.073)       0:01:12.018 **********
2026-05-28 02:35:27.051843 | mon1 | changed: [mon1]
2026-05-28 02:35:27.051900 | mon1 |
2026-05-28 02:35:27.051999 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-05-28 02:35:27.052129 | mon1 | Thursday 28 May 2026  02:35:27 +0000 (0:00:00.271)       0:01:12.290 **********
2026-05-28 02:35:27.716611 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-05-28 02:35:27.716671 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-05-28 02:35:27.716790 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-05-28 02:35:27.717072 | mon1 |
2026-05-28 02:35:27.717089 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-05-28 02:35:27.717094 | mon1 | Thursday 28 May 2026  02:35:27 +0000 (0:00:00.664)       0:01:12.955 **********
2026-05-28 02:36:56.540209 | mon1 | ok: [mon1]
2026-05-28 02:36:56.540309 | mon1 |
2026-05-28 02:36:56.540459 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-05-28 02:36:56.540595 | mon1 | Thursday 28 May 2026  02:36:56 +0000 (0:01:28.823)       0:02:41.778 **********
2026-05-28 02:36:56.738755 | mon1 | changed: [mon1]
2026-05-28 02:36:56.738826 | mon1 |
2026-05-28 02:36:56.738965 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-05-28 02:36:56.739099 | mon1 | Thursday 28 May 2026  02:36:56 +0000 (0:00:00.198)       0:02:41.977 **********
2026-05-28 02:36:56.776262 | mon1 | ok: [mon1]
2026-05-28 02:36:56.776382 | mon1 |
2026-05-28 02:36:56.776693 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:36:56.776738 | mon1 | Thursday 28 May 2026  02:36:56 +0000 (0:00:00.037)       0:02:42.014 **********
2026-05-28 02:36:56.838034 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:36:56.838075 | mon1 |
2026-05-28 02:36:56.838210 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:36:56.838339 | mon1 | Thursday 28 May 2026  02:36:56 +0000 (0:00:00.061)       0:02:42.076 **********
2026-05-28 02:37:02.395193 | mon1 | ok: [mon1]
2026-05-28 02:37:02.395264 | mon1 |
2026-05-28 02:37:02.395491 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:37:02.395778 | mon1 | Thursday 28 May 2026  02:37:02 +0000 (0:00:05.557)       0:02:47.633 **********
2026-05-28 02:37:02.443785 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:37:02.443863 | mon1 |
2026-05-28 02:37:02.444078 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:37:02.444097 | mon1 | Thursday 28 May 2026  02:37:02 +0000 (0:00:00.048)       0:02:47.682 **********
2026-05-28 02:37:02.794449 | mon1 | ok: [mon1]
2026-05-28 02:37:02.794488 | mon1 |
2026-05-28 02:37:02.794493 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:37:02.794498 | mon1 | Thursday 28 May 2026  02:37:02 +0000 (0:00:00.350)       0:02:48.032 **********
2026-05-28 02:37:10.236113 | mon1 | ok: [mon1]
2026-05-28 02:37:10.236190 | mon1 |
2026-05-28 02:37:10.236243 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-28 02:37:10.236371 | mon1 | Thursday 28 May 2026  02:37:10 +0000 (0:00:07.441)       0:02:55.474 **********
2026-05-28 02:37:22.367617 | mon1 | changed: [mon1]
2026-05-28 02:37:22.367692 | mon1 |
2026-05-28 02:37:22.367908 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-28 02:37:22.367951 | mon1 | Thursday 28 May 2026  02:37:22 +0000 (0:00:12.131)       0:03:07.605 **********
2026-05-28 02:37:36.460135 | mon1 | ok: [mon1]
2026-05-28 02:37:36.460202 | mon1 |
2026-05-28 02:37:36.460284 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:37:36.460364 | mon1 | Thursday 28 May 2026  02:37:36 +0000 (0:00:14.092)       0:03:21.698 **********
2026-05-28 02:37:36.521675 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:37:36.521724 | mon1 |
2026-05-28 02:37:36.521827 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:37:36.521915 | mon1 | Thursday 28 May 2026  02:37:36 +0000 (0:00:00.061)       0:03:21.760 **********
2026-05-28 02:37:36.561800 | mon1 | skipping: [mon1]
2026-05-28 02:37:36.561876 | mon1 |
2026-05-28 02:37:36.561984 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:37:36.562091 | mon1 | Thursday 28 May 2026  02:37:36 +0000 (0:00:00.040)       0:03:21.800 **********
2026-05-28 02:37:36.597988 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-28 02:37:36.598041 | mon1 | skipping: [mon1]
2026-05-28 02:37:36.598368 | mon1 |
2026-05-28 02:37:36.598416 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:37:36.598422 | mon1 | Thursday 28 May 2026  02:37:36 +0000 (0:00:00.035)       0:03:21.836 **********
2026-05-28 02:37:36.841075 | mon1 | ok: [mon1]
2026-05-28 02:37:36.841140 | mon1 |
2026-05-28 02:37:36.841345 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:37:36.841393 | mon1 | Thursday 28 May 2026  02:37:36 +0000 (0:00:00.243)       0:03:22.079 **********
2026-05-28 02:37:43.197096 | mon1 | ok: [mon1]
2026-05-28 02:37:43.197168 | mon1 |
2026-05-28 02:37:43.197291 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-28 02:37:43.197404 | mon1 | Thursday 28 May 2026  02:37:43 +0000 (0:00:06.356)       0:03:28.435 **********
2026-05-28 02:37:54.924020 | mon1 | changed: [mon1]
2026-05-28 02:37:54.924106 | mon1 |
2026-05-28 02:37:54.924122 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-28 02:37:54.924280 | mon1 | Thursday 28 May 2026  02:37:54 +0000 (0:00:11.726)       0:03:40.161 **********
2026-05-28 02:38:00.965688 | mon1 | ok: [mon1]
2026-05-28 02:38:00.965752 | mon1 |
2026-05-28 02:38:00.965967 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-28 02:38:00.966012 | mon1 | Thursday 28 May 2026  02:38:00 +0000 (0:00:06.042)       0:03:46.204 **********
2026-05-28 02:38:05.370745 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-28 02:38:05.370929 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-28 02:38:05.370946 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-05-28 02:38:05.371079 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-28 02:38:05.371212 | mon1 |
2026-05-28 02:38:05.371362 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-28 02:38:05.371500 | mon1 |
2026-05-28 02:38:05.371651 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:38:05.371783 | mon1 | Thursday 28 May 2026  02:38:05 +0000 (0:00:04.404)       0:03:50.609 **********
2026-05-28 02:38:06.453980 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-28 02:38:06.454135 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:38:06.454381 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:38:06.454576 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:38:06.454811 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:38:06.466716 | mon1 | ok: [osd1]
2026-05-28 02:38:06.466760 | mon1 |
2026-05-28 02:38:06.466863 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:38:06.466979 | mon1 | Thursday 28 May 2026  02:38:06 +0000 (0:00:01.096)       0:03:51.705 **********
2026-05-28 02:38:06.669550 | mon1 | ok: [osd1]
2026-05-28 02:38:06.669619 | mon1 |
2026-05-28 02:38:06.669708 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:38:06.669827 | mon1 | Thursday 28 May 2026  02:38:06 +0000 (0:00:00.202)       0:03:51.907 **********
2026-05-28 02:38:06.702803 | mon1 | skipping: [osd1]
2026-05-28 02:38:06.702853 | mon1 |
2026-05-28 02:38:06.702991 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:38:06.703081 | mon1 | Thursday 28 May 2026  02:38:06 +0000 (0:00:00.033)       0:03:51.941 **********
2026-05-28 02:38:06.921851 | mon1 | changed: [osd1]
2026-05-28 02:38:06.921918 | mon1 |
2026-05-28 02:38:06.922012 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:38:06.922131 | mon1 | Thursday 28 May 2026  02:38:06 +0000 (0:00:00.218)       0:03:52.159 **********
2026-05-28 02:38:06.971818 | mon1 | ok: [osd1] => {
2026-05-28 02:38:06.971944 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:38:06.972059 | mon1 | }
2026-05-28 02:38:06.972176 | mon1 |
2026-05-28 02:38:06.972311 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:38:06.972437 | mon1 | Thursday 28 May 2026  02:38:06 +0000 (0:00:00.050)       0:03:52.210 **********
2026-05-28 02:38:07.537732 | mon1 | changed: [osd1]
2026-05-28 02:38:07.537799 | mon1 |
2026-05-28 02:38:07.537956 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:38:07.538087 | mon1 | Thursday 28 May 2026  02:38:07 +0000 (0:00:00.565)       0:03:52.776 **********
2026-05-28 02:38:07.572635 | mon1 | skipping: [osd1]
2026-05-28 02:38:07.572703 | mon1 |
2026-05-28 02:38:07.572749 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:38:07.572863 | mon1 | Thursday 28 May 2026  02:38:07 +0000 (0:00:00.035)       0:03:52.811 **********
2026-05-28 02:38:07.609732 | mon1 | skipping: [osd1]
2026-05-28 02:38:07.609792 | mon1 |
2026-05-28 02:38:07.609886 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:38:07.609970 | mon1 | Thursday 28 May 2026  02:38:07 +0000 (0:00:00.037)       0:03:52.848 **********
2026-05-28 02:38:07.812768 | mon1 | ok: [osd1]
2026-05-28 02:38:07.812813 | mon1 |
2026-05-28 02:38:07.812819 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:38:07.812825 | mon1 | Thursday 28 May 2026  02:38:07 +0000 (0:00:00.202)       0:03:53.050 **********
2026-05-28 02:38:08.997394 | mon1 | ok: [osd1]
2026-05-28 02:38:08.997436 | mon1 |
2026-05-28 02:38:08.997441 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:38:08.997446 | mon1 | Thursday 28 May 2026  02:38:08 +0000 (0:00:01.184)       0:03:54.235 **********
2026-05-28 02:38:09.064702 | mon1 | ok: [osd1] => {
2026-05-28 02:38:09.064743 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:38:09.064749 | mon1 | }
2026-05-28 02:38:09.064754 | mon1 |
2026-05-28 02:38:09.064758 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:38:09.064763 | mon1 | Thursday 28 May 2026  02:38:09 +0000 (0:00:00.066)       0:03:54.302 **********
2026-05-28 02:38:09.809792 | mon1 | changed: [osd1]
2026-05-28 02:38:09.809852 | mon1 |
2026-05-28 02:38:09.809859 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:38:09.809865 | mon1 | Thursday 28 May 2026  02:38:09 +0000 (0:00:00.745)       0:03:55.048 **********
2026-05-28 02:38:12.531394 | mon1 | changed: [osd1]
2026-05-28 02:38:12.531430 | mon1 |
2026-05-28 02:38:12.531436 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:38:12.531441 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:02.721)       0:03:57.769 **********
2026-05-28 02:38:12.558722 | mon1 | skipping: [osd1]
2026-05-28 02:38:12.558747 | mon1 |
2026-05-28 02:38:12.558755 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:38:12.558761 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:00.027)       0:03:57.796 **********
2026-05-28 02:38:12.584258 | mon1 | skipping: [osd1]
2026-05-28 02:38:12.584297 | mon1 |
2026-05-28 02:38:12.584304 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:38:12.584311 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:00.025)       0:03:57.822 **********
2026-05-28 02:38:12.612585 | mon1 | skipping: [osd1]
2026-05-28 02:38:12.612617 | mon1 |
2026-05-28 02:38:12.612624 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:38:12.612630 | mon1 | Thursday 28 May 2026  02:38:12 +0000 (0:00:00.028)       0:03:57.850 **********
2026-05-28 02:38:19.232584 | mon1 | changed: [osd1]
2026-05-28 02:38:19.232655 | mon1 |
2026-05-28 02:38:19.232790 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:38:19.232922 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:06.619)       0:04:04.470 **********
2026-05-28 02:38:19.693081 | mon1 | changed: [osd1]
2026-05-28 02:38:19.693182 | mon1 |
2026-05-28 02:38:19.693453 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:38:19.693475 | mon1 | Thursday 28 May 2026  02:38:19 +0000 (0:00:00.460)       0:04:04.931 **********
2026-05-28 02:38:20.589813 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-05-28 02:38:20.590709 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:38:20.590731 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:38:20.590738 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:38:20.590744 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:38:20.590750 | mon1 |
2026-05-28 02:38:20.590756 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:38:20.590762 | mon1 | Thursday 28 May 2026  02:38:20 +0000 (0:00:00.896)       0:04:05.827 **********
2026-05-28 02:38:21.138445 | mon1 | changed: [osd1]
2026-05-28 02:38:21.138510 | mon1 |
2026-05-28 02:38:21.138586 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:38:21.138997 | mon1 | Thursday 28 May 2026  02:38:21 +0000 (0:00:00.542)       0:04:06.370 **********
2026-05-28 02:38:21.139042 | mon1 |
2026-05-28 02:38:21.139048 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:38:21.139053 | mon1 | Thursday 28 May 2026  02:38:21 +0000 (0:00:00.006)       0:04:06.376 **********
2026-05-28 02:38:21.851179 | mon1 | ok: [osd1]
2026-05-28 02:38:21.851265 | mon1 |
2026-05-28 02:38:21.851543 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-28 02:38:21.851598 | mon1 | Thursday 28 May 2026  02:38:21 +0000 (0:00:00.712)       0:04:07.089 **********
2026-05-28 02:38:22.320458 | mon1 | changed: [osd1]
2026-05-28 02:38:22.320538 | mon1 |
2026-05-28 02:38:22.320550 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:38:22.320662 | mon1 | Thursday 28 May 2026  02:38:22 +0000 (0:00:00.469)       0:04:07.558 **********
2026-05-28 02:38:22.894968 | mon1 | changed: [osd1]
2026-05-28 02:38:22.895033 | mon1 |
2026-05-28 02:38:22.895191 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:38:22.895213 | mon1 | Thursday 28 May 2026  02:38:22 +0000 (0:00:00.574)       0:04:08.133 **********
2026-05-28 02:38:23.094096 | mon1 | ok: [osd1]
2026-05-28 02:38:23.094159 | mon1 |
2026-05-28 02:38:23.094248 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:38:23.094356 | mon1 | Thursday 28 May 2026  02:38:23 +0000 (0:00:00.199)       0:04:08.332 **********
2026-05-28 02:38:23.147855 | mon1 | ok: [osd1] => {
2026-05-28 02:38:23.147919 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:38:23.148275 | mon1 | }
2026-05-28 02:38:23.148304 | mon1 |
2026-05-28 02:38:23.148328 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:38:23.148333 | mon1 | Thursday 28 May 2026  02:38:23 +0000 (0:00:00.053)       0:04:08.386 **********
2026-05-28 02:38:24.020205 | mon1 | changed: [osd1]
2026-05-28 02:38:24.020260 | mon1 |
2026-05-28 02:38:24.020511 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:38:24.020585 | mon1 | Thursday 28 May 2026  02:38:24 +0000 (0:00:00.872)       0:04:09.258 **********
2026-05-28 02:38:28.478660 | mon1 | changed: [osd1]
2026-05-28 02:38:28.478755 | mon1 |
2026-05-28 02:38:28.478769 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:38:28.478915 | mon1 | Thursday 28 May 2026  02:38:28 +0000 (0:00:04.458)       0:04:13.716 **********
2026-05-28 02:38:29.660133 | mon1 | ok: [osd1]
2026-05-28 02:38:29.660209 | mon1 |
2026-05-28 02:38:29.660270 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:38:29.660383 | mon1 | Thursday 28 May 2026  02:38:29 +0000 (0:00:01.181)       0:04:14.898 **********
2026-05-28 02:38:29.891715 | mon1 | changed: [osd1]
2026-05-28 02:38:29.891785 | mon1 |
2026-05-28 02:38:29.892060 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:38:29.892110 | mon1 | Thursday 28 May 2026  02:38:29 +0000 (0:00:00.231)       0:04:15.129 **********
2026-05-28 02:38:30.338066 | mon1 | changed: [osd1]
2026-05-28 02:38:30.338146 | mon1 |
2026-05-28 02:38:30.338427 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:38:30.338480 | mon1 | Thursday 28 May 2026  02:38:30 +0000 (0:00:00.446)       0:04:15.576 **********
2026-05-28 02:38:30.881399 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-05-28 02:38:30.881470 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:38:30.881490 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:38:30.881551 | mon1 |
2026-05-28 02:38:30.881754 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:38:30.881797 | mon1 | Thursday 28 May 2026  02:38:30 +0000 (0:00:00.543)       0:04:16.119 **********
2026-05-28 02:38:31.350155 | mon1 | changed: [osd1]
2026-05-28 02:38:31.350226 | mon1 |
2026-05-28 02:38:31.350499 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:38:31.350546 | mon1 | Thursday 28 May 2026  02:38:31 +0000 (0:00:00.468)       0:04:16.588 **********
2026-05-28 02:38:31.827823 | mon1 | changed: [osd1]
2026-05-28 02:38:31.827890 | mon1 |
2026-05-28 02:38:31.827966 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:38:31.828362 | mon1 | Thursday 28 May 2026  02:38:31 +0000 (0:00:00.471)       0:04:17.060 **********
2026-05-28 02:38:31.828424 | mon1 |
2026-05-28 02:38:31.828430 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-28 02:38:31.828435 | mon1 | Thursday 28 May 2026  02:38:31 +0000 (0:00:00.005)       0:04:17.066 **********
2026-05-28 02:38:32.527848 | mon1 | ok: [osd1]
2026-05-28 02:38:32.527927 | mon1 |
2026-05-28 02:38:32.527939 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-28 02:38:32.528091 | mon1 | Thursday 28 May 2026  02:38:32 +0000 (0:00:00.699)       0:04:17.766 **********
2026-05-28 02:38:33.469509 | mon1 | changed: [osd1]
2026-05-28 02:38:33.469580 | mon1 |
2026-05-28 02:38:33.469860 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:38:33.469909 | mon1 | Thursday 28 May 2026  02:38:33 +0000 (0:00:00.941)       0:04:18.707 **********
2026-05-28 02:38:34.005968 | mon1 | changed: [osd1]
2026-05-28 02:38:34.006044 | mon1 |
2026-05-28 02:38:34.006057 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:38:34.006176 | mon1 | Thursday 28 May 2026  02:38:34 +0000 (0:00:00.536)       0:04:19.244 **********
2026-05-28 02:38:34.047215 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-28 02:38:34.047253 | mon1 |
2026-05-28 02:38:34.047529 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:38:34.047569 | mon1 | Thursday 28 May 2026  02:38:34 +0000 (0:00:00.041)       0:04:19.285 **********
2026-05-28 02:38:39.261644 | mon1 | changed: [osd1]
2026-05-28 02:38:39.261712 | mon1 |
2026-05-28 02:38:39.261941 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:38:39.261962 | mon1 | Thursday 28 May 2026  02:38:39 +0000 (0:00:05.214)       0:04:24.499 **********
2026-05-28 02:38:39.907354 | mon1 | ok: [osd1] => (item=chronyd)
2026-05-28 02:38:39.907426 | mon1 | ok: [osd1] => (item=sshd)
2026-05-28 02:38:39.907847 | mon1 |
2026-05-28 02:38:39.907895 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:38:39.907903 | mon1 | Thursday 28 May 2026  02:38:39 +0000 (0:00:00.645)       0:04:25.145 **********
2026-05-28 02:38:40.222402 | mon1 | changed: [osd1]
2026-05-28 02:38:40.222446 | mon1 |
2026-05-28 02:38:40.222641 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:38:40.222685 | mon1 | Thursday 28 May 2026  02:38:40 +0000 (0:00:00.314)       0:04:25.460 **********
2026-05-28 02:38:40.440881 | mon1 | ok: [osd1]
2026-05-28 02:38:40.440963 | mon1 |
2026-05-28 02:38:40.441686 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:38:40.441737 | mon1 | Thursday 28 May 2026  02:38:40 +0000 (0:00:00.218)       0:04:25.679 **********
2026-05-28 02:38:40.762766 | mon1 | changed: [osd1]
2026-05-28 02:38:40.762837 | mon1 |
2026-05-28 02:38:40.762935 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:38:40.763034 | mon1 | Thursday 28 May 2026  02:38:40 +0000 (0:00:00.322)       0:04:26.001 **********
2026-05-28 02:38:40.993412 | mon1 | changed: [osd1]
2026-05-28 02:38:40.993471 | mon1 |
2026-05-28 02:38:40.993712 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-28 02:38:40.993759 | mon1 | Thursday 28 May 2026  02:38:40 +0000 (0:00:00.230)       0:04:26.231 **********
2026-05-28 02:38:41.207301 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-28 02:38:41.207392 | mon1 |
2026-05-28 02:38:41.207733 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-28 02:38:41.207780 | mon1 | Thursday 28 May 2026  02:38:41 +0000 (0:00:00.213)       0:04:26.445 **********
2026-05-28 02:38:41.254089 | mon1 | ok: [osd1]
2026-05-28 02:38:41.260185 | mon1 |
2026-05-28 02:38:41.260214 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:38:41.260226 | mon1 | Thursday 28 May 2026  02:38:41 +0000 (0:00:00.046)       0:04:26.492 **********
2026-05-28 02:38:41.311627 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-28 02:38:41.311655 | mon1 |
2026-05-28 02:38:41.311661 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:38:41.311666 | mon1 | Thursday 28 May 2026  02:38:41 +0000 (0:00:00.057)       0:04:26.549 **********
2026-05-28 02:38:47.277195 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:38:47.277322 | mon1 |
2026-05-28 02:38:47.277634 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:38:47.277684 | mon1 | Thursday 28 May 2026  02:38:47 +0000 (0:00:05.965)       0:04:32.515 **********
2026-05-28 02:38:47.318232 | mon1 | ok: [osd1] => (item=osd1)
2026-05-28 02:38:47.318293 | mon1 |
2026-05-28 02:38:47.318493 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:38:47.318511 | mon1 | Thursday 28 May 2026  02:38:47 +0000 (0:00:00.041)       0:04:32.556 **********
2026-05-28 02:38:47.576926 | mon1 | changed: [osd1]
2026-05-28 02:38:47.576984 | mon1 |
2026-05-28 02:38:47.577310 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:38:47.577355 | mon1 | Thursday 28 May 2026  02:38:47 +0000 (0:00:00.258)       0:04:32.815 **********
2026-05-28 02:38:58.394329 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:38:58.394411 | mon1 |
2026-05-28 02:38:58.394474 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-28 02:38:58.394598 | mon1 | Thursday 28 May 2026  02:38:58 +0000 (0:00:10.817)       0:04:43.632 **********
2026-05-28 02:38:59.932929 | mon1 | ok: [osd1]
2026-05-28 02:38:59.933059 | mon1 |
2026-05-28 02:38:59.933553 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-28 02:38:59.933616 | mon1 | Thursday 28 May 2026  02:38:59 +0000 (0:00:01.537)       0:04:45.170 **********
2026-05-28 02:39:42.527692 | mon1 | ok: [osd1]
2026-05-28 02:39:42.527780 | mon1 |
2026-05-28 02:39:42.527841 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-28 02:39:42.528010 | mon1 | Thursday 28 May 2026  02:39:42 +0000 (0:00:42.594)       0:05:27.765 **********
2026-05-28 02:41:24.538209 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-05-28 02:41:24.538281 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-05-28 02:41:24.538650 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-05-28 02:41:24.538666 | mon1 |
2026-05-28 02:41:24.538671 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-28 02:41:24.538675 | mon1 | Thursday 28 May 2026  02:41:24 +0000 (0:01:42.011)       0:07:09.776 **********
2026-05-28 02:41:30.639228 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:41:30.639288 | mon1 |
2026-05-28 02:41:30.639486 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-28 02:41:30.639528 | mon1 | Thursday 28 May 2026  02:41:30 +0000 (0:00:06.100)       0:07:15.877 **********
2026-05-28 02:41:36.604028 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:41:36.604116 | mon1 |
2026-05-28 02:41:36.604176 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-28 02:41:36.604292 | mon1 | Thursday 28 May 2026  02:41:36 +0000 (0:00:05.964)       0:07:21.842 **********
2026-05-28 02:41:36.655133 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-28 02:41:36.655197 | mon1 |
2026-05-28 02:41:36.655385 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-28 02:41:36.655423 | mon1 | Thursday 28 May 2026  02:41:36 +0000 (0:00:00.051)       0:07:21.893 **********
2026-05-28 02:41:36.701431 | mon1 | ok: [osd1]
2026-05-28 02:41:36.701781 | mon1 |
2026-05-28 02:41:36.701829 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-28 02:41:36.701997 | mon1 | Thursday 28 May 2026  02:41:36 +0000 (0:00:00.046)       0:07:21.939 **********
2026-05-28 02:41:42.673886 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:41:42.673950 | mon1 |
2026-05-28 02:41:42.673969 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-28 02:41:42.674129 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:05.971)       0:07:27.911 **********
2026-05-28 02:41:42.703547 | mon1 | ok: [osd1]
2026-05-28 02:41:42.703730 | mon1 |
2026-05-28 02:41:42.703958 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-28 02:41:42.704174 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.030)       0:07:27.941 **********
2026-05-28 02:41:42.742111 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:41:42.742227 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:41:42.742357 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:41:42.742484 | mon1 | skipping: [osd1]
2026-05-28 02:41:42.742605 | mon1 |
2026-05-28 02:41:42.742760 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-28 02:41:42.742886 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.038)       0:07:27.980 **********
2026-05-28 02:41:42.795126 | mon1 | skipping: [osd1]
2026-05-28 02:41:42.795294 | mon1 |
2026-05-28 02:41:42.795502 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-05-28 02:41:42.795687 | mon1 |
2026-05-28 02:41:42.795895 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:41:42.796094 | mon1 | Thursday 28 May 2026  02:41:42 +0000 (0:00:00.053)       0:07:28.033 **********
2026-05-28 02:41:43.644858 | mon1 | ok: [mon1]
2026-05-28 02:41:43.645033 | mon1 |
2026-05-28 02:41:43.645268 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:41:43.645494 | mon1 | Thursday 28 May 2026  02:41:43 +0000 (0:00:00.849)       0:07:28.882 **********
2026-05-28 02:41:43.840616 | mon1 | ok: [mon1]
2026-05-28 02:41:43.840708 | mon1 |
2026-05-28 02:41:43.840720 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:41:43.840730 | mon1 | Thursday 28 May 2026  02:41:43 +0000 (0:00:00.195)       0:07:29.077 **********
2026-05-28 02:41:43.871815 | mon1 | skipping: [mon1]
2026-05-28 02:41:43.871882 | mon1 |
2026-05-28 02:41:43.872116 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:41:43.872164 | mon1 | Thursday 28 May 2026  02:41:43 +0000 (0:00:00.032)       0:07:29.110 **********
2026-05-28 02:41:44.062641 | mon1 | ok: [mon1]
2026-05-28 02:41:44.062723 | mon1 |
2026-05-28 02:41:44.062922 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:41:44.062967 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.190)       0:07:29.301 **********
2026-05-28 02:41:44.121314 | mon1 | ok: [mon1] => {
2026-05-28 02:41:44.121375 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:41:44.121767 | mon1 | }
2026-05-28 02:41:44.121789 | mon1 |
2026-05-28 02:41:44.121795 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:41:44.121800 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.058)       0:07:29.359 **********
2026-05-28 02:41:44.413461 | mon1 | ok: [mon1]
2026-05-28 02:41:44.413532 | mon1 |
2026-05-28 02:41:44.413611 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:41:44.413747 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.292)       0:07:29.651 **********
2026-05-28 02:41:44.447467 | mon1 | skipping: [mon1]
2026-05-28 02:41:44.447529 | mon1 |
2026-05-28 02:41:44.447645 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:41:44.447795 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.033)       0:07:29.685 **********
2026-05-28 02:41:44.486157 | mon1 | skipping: [mon1]
2026-05-28 02:41:44.486233 | mon1 |
2026-05-28 02:41:44.486413 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:41:44.486441 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.038)       0:07:29.724 **********
2026-05-28 02:41:44.683390 | mon1 | ok: [mon1]
2026-05-28 02:41:44.683464 | mon1 |
2026-05-28 02:41:44.683686 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:41:44.683741 | mon1 | Thursday 28 May 2026  02:41:44 +0000 (0:00:00.197)       0:07:29.921 **********
2026-05-28 02:41:45.679949 | mon1 | ok: [mon1]
2026-05-28 02:41:45.680023 | mon1 |
2026-05-28 02:41:45.680088 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:41:45.680184 | mon1 | Thursday 28 May 2026  02:41:45 +0000 (0:00:00.996)       0:07:30.918 **********
2026-05-28 02:41:45.742640 | mon1 | ok: [mon1] => {
2026-05-28 02:41:45.742871 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:41:45.743108 | mon1 | }
2026-05-28 02:41:45.743305 | mon1 |
2026-05-28 02:41:45.743530 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:41:45.743747 | mon1 | Thursday 28 May 2026  02:41:45 +0000 (0:00:00.062)       0:07:30.980 **********
2026-05-28 02:41:46.063240 | mon1 | ok: [mon1]
2026-05-28 02:41:46.063430 | mon1 |
2026-05-28 02:41:46.063653 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:41:46.063878 | mon1 | Thursday 28 May 2026  02:41:46 +0000 (0:00:00.320)       0:07:31.301 **********
2026-05-28 02:41:48.004642 | mon1 | ok: [mon1]
2026-05-28 02:41:48.004836 | mon1 |
2026-05-28 02:41:48.005101 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:41:48.005344 | mon1 | Thursday 28 May 2026  02:41:48 +0000 (0:00:01.941)       0:07:33.242 **********
2026-05-28 02:41:48.030194 | mon1 | skipping: [mon1]
2026-05-28 02:41:48.030382 | mon1 |
2026-05-28 02:41:48.030600 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:41:48.030811 | mon1 | Thursday 28 May 2026  02:41:48 +0000 (0:00:00.025)       0:07:33.268 **********
2026-05-28 02:41:48.056083 | mon1 | skipping: [mon1]
2026-05-28 02:41:48.056248 | mon1 |
2026-05-28 02:41:48.056466 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:41:48.056675 | mon1 | Thursday 28 May 2026  02:41:48 +0000 (0:00:00.026)       0:07:33.294 **********
2026-05-28 02:41:48.079884 | mon1 | skipping: [mon1]
2026-05-28 02:41:48.080054 | mon1 |
2026-05-28 02:41:48.080301 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:41:48.080517 | mon1 | Thursday 28 May 2026  02:41:48 +0000 (0:00:00.023)       0:07:33.318 **********
2026-05-28 02:41:49.079030 | mon1 | ok: [mon1]
2026-05-28 02:41:49.079093 | mon1 |
2026-05-28 02:41:49.079527 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:41:49.079564 | mon1 | Thursday 28 May 2026  02:41:49 +0000 (0:00:00.998)       0:07:34.316 **********
2026-05-28 02:41:49.479731 | mon1 | ok: [mon1]
2026-05-28 02:41:49.479843 | mon1 |
2026-05-28 02:41:49.480182 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:41:49.480365 | mon1 | Thursday 28 May 2026  02:41:49 +0000 (0:00:00.401)       0:07:34.717 **********
2026-05-28 02:41:50.342521 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:41:50.342591 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:41:50.343005 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:41:50.343071 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:41:50.343083 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:41:50.343102 | mon1 |
2026-05-28 02:41:50.343112 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:41:50.343218 | mon1 | Thursday 28 May 2026  02:41:50 +0000 (0:00:00.863)       0:07:35.580 **********
2026-05-28 02:41:50.846008 | mon1 | ok: [mon1]
2026-05-28 02:41:50.846082 | mon1 |
2026-05-28 02:41:50.846585 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:41:50.846625 | mon1 | Thursday 28 May 2026  02:41:50 +0000 (0:00:00.498)       0:07:36.079 **********
2026-05-28 02:41:50.846631 | mon1 |
2026-05-28 02:41:50.846636 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:41:50.846640 | mon1 | Thursday 28 May 2026  02:41:50 +0000 (0:00:00.004)       0:07:36.084 **********
2026-05-28 02:41:51.194740 | mon1 | ok: [mon1]
2026-05-28 02:41:51.194814 | mon1 |
2026-05-28 02:41:51.195243 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:41:51.195293 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.348)       0:07:36.432 **********
2026-05-28 02:41:51.387498 | mon1 | ok: [mon1]
2026-05-28 02:41:51.387572 | mon1 |
2026-05-28 02:41:51.387769 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:41:51.387811 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.192)       0:07:36.625 **********
2026-05-28 02:41:51.442124 | mon1 | ok: [mon1] => {
2026-05-28 02:41:51.442861 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:41:51.442931 | mon1 | }
2026-05-28 02:41:51.442941 | mon1 |
2026-05-28 02:41:51.442948 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:41:51.442954 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.054)       0:07:36.680 **********
2026-05-28 02:41:51.774988 | mon1 | ok: [mon1]
2026-05-28 02:41:51.775452 | mon1 |
2026-05-28 02:41:51.775499 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:41:51.775507 | mon1 | Thursday 28 May 2026  02:41:51 +0000 (0:00:00.333)       0:07:37.013 **********
2026-05-28 02:41:54.773175 | mon1 | ok: [mon1]
2026-05-28 02:41:54.773249 | mon1 |
2026-05-28 02:41:54.773467 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:41:54.773515 | mon1 | Thursday 28 May 2026  02:41:54 +0000 (0:00:02.998)       0:07:40.011 **********
2026-05-28 02:41:55.767693 | mon1 | ok: [mon1]
2026-05-28 02:41:55.768175 | mon1 |
2026-05-28 02:41:55.768230 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:41:55.768239 | mon1 | Thursday 28 May 2026  02:41:55 +0000 (0:00:00.994)       0:07:41.005 **********
2026-05-28 02:41:55.954514 | mon1 | ok: [mon1]
2026-05-28 02:41:55.954587 | mon1 |
2026-05-28 02:41:55.954679 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:41:55.954808 | mon1 | Thursday 28 May 2026  02:41:55 +0000 (0:00:00.187)       0:07:41.193 **********
2026-05-28 02:41:56.368041 | mon1 | ok: [mon1]
2026-05-28 02:41:56.368126 | mon1 |
2026-05-28 02:41:56.368442 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:41:56.368493 | mon1 | Thursday 28 May 2026  02:41:56 +0000 (0:00:00.413)       0:07:41.606 **********
2026-05-28 02:41:56.898025 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:41:56.898133 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:41:56.898725 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:41:56.898766 | mon1 |
2026-05-28 02:41:56.898774 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:41:56.898781 | mon1 | Thursday 28 May 2026  02:41:56 +0000 (0:00:00.530)       0:07:42.136 **********
2026-05-28 02:41:57.305539 | mon1 | ok: [mon1]
2026-05-28 02:41:57.305626 | mon1 |
2026-05-28 02:41:57.305700 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:41:57.305817 | mon1 | Thursday 28 May 2026  02:41:57 +0000 (0:00:00.407)       0:07:42.543 **********
2026-05-28 02:41:57.727151 | mon1 | ok: [mon1]
2026-05-28 02:41:57.727219 | mon1 |
2026-05-28 02:41:57.727297 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:41:57.727699 | mon1 | Thursday 28 May 2026  02:41:57 +0000 (0:00:00.417)       0:07:42.961 **********
2026-05-28 02:41:57.727741 | mon1 |
2026-05-28 02:41:57.727747 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:41:57.727751 | mon1 | Thursday 28 May 2026  02:41:57 +0000 (0:00:00.004)       0:07:42.965 **********
2026-05-28 02:41:58.084114 | mon1 | ok: [mon1]
2026-05-28 02:41:58.084168 | mon1 |
2026-05-28 02:41:58.084284 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:41:58.084424 | mon1 | Thursday 28 May 2026  02:41:58 +0000 (0:00:00.356)       0:07:43.322 **********
2026-05-28 02:41:58.123822 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-28 02:41:58.123897 | mon1 |
2026-05-28 02:41:58.124003 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:41:58.124145 | mon1 | Thursday 28 May 2026  02:41:58 +0000 (0:00:00.039)       0:07:43.362 **********
2026-05-28 02:41:59.105600 | mon1 | ok: [mon1]
2026-05-28 02:41:59.105838 | mon1 |
2026-05-28 02:41:59.105851 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:41:59.105862 | mon1 | Thursday 28 May 2026  02:41:59 +0000 (0:00:00.981)       0:07:44.343 **********
2026-05-28 02:41:59.752217 | mon1 | ok: [mon1] => (item=chronyd)
2026-05-28 02:41:59.752284 | mon1 | ok: [mon1] => (item=sshd)
2026-05-28 02:41:59.752702 | mon1 |
2026-05-28 02:41:59.752799 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:41:59.752806 | mon1 | Thursday 28 May 2026  02:41:59 +0000 (0:00:00.646)       0:07:44.990 **********
2026-05-28 02:42:00.069029 | mon1 | ok: [mon1]
2026-05-28 02:42:00.069104 | mon1 |
2026-05-28 02:42:00.069304 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:42:00.069343 | mon1 | Thursday 28 May 2026  02:42:00 +0000 (0:00:00.317)       0:07:45.307 **********
2026-05-28 02:42:00.256436 | mon1 | ok: [mon1]
2026-05-28 02:42:00.256513 | mon1 |
2026-05-28 02:42:00.256782 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:42:00.256828 | mon1 | Thursday 28 May 2026  02:42:00 +0000 (0:00:00.187)       0:07:45.494 **********
2026-05-28 02:42:00.510031 | mon1 | ok: [mon1]
2026-05-28 02:42:00.510156 | mon1 |
2026-05-28 02:42:00.510168 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:42:00.510234 | mon1 | Thursday 28 May 2026  02:42:00 +0000 (0:00:00.253)       0:07:45.748 **********
2026-05-28 02:42:00.703624 | mon1 | ok: [mon1]
2026-05-28 02:42:00.703730 | mon1 |
2026-05-28 02:42:00.703743 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-05-28 02:42:00.703881 | mon1 | Thursday 28 May 2026  02:42:00 +0000 (0:00:00.193)       0:07:45.941 **********
2026-05-28 02:42:12.327073 | mon1 | changed: [mon1]
2026-05-28 02:42:12.327154 | mon1 |
2026-05-28 02:42:12.327210 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist] *************
2026-05-28 02:42:12.327305 | mon1 | Thursday 28 May 2026  02:42:12 +0000 (0:00:11.622)       0:07:57.564 **********
2026-05-28 02:42:19.371988 | mon1 | ok: [mon1]
2026-05-28 02:42:19.372068 | mon1 |
2026-05-28 02:42:19.372157 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:42:19.372476 | mon1 | mon1                       : ok=94   changed=30   unreachable=0    failed=0    skipped=14   rescued=0    ignored=0
2026-05-28 02:42:19.372548 | mon1 | osd1                       : ok=53   changed=24   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-05-28 02:42:19.372567 | mon1 |
2026-05-28 02:42:19.372580 | mon1 |
2026-05-28 02:42:19.372887 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:42:19.372943 | mon1 | Thursday 28 May 2026  02:42:19 +0000 (0:00:07.045)       0:08:04.610 **********
2026-05-28 02:42:19.372956 | mon1 | ===============================================================================
2026-05-28 02:42:19.373063 | mon1 | vexxhost.ceph.osd : Install OSDs -------------------------------------- 102.01s
2026-05-28 02:42:19.373221 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 88.82s
2026-05-28 02:42:19.374925 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.59s
2026-05-28 02:42:19.374939 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 39.01s
2026-05-28 02:42:19.374944 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.09s
2026-05-28 02:42:19.374950 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 12.13s
2026-05-28 02:42:19.374966 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 11.73s
2026-05-28 02:42:19.374972 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ---------- 11.62s
2026-05-28 02:42:19.374978 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ---------------------- 10.82s
2026-05-28 02:42:19.374984 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 7.44s
2026-05-28 02:42:19.374989 | mon1 | vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist ------------- 7.05s
2026-05-28 02:42:19.374995 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 6.62s
2026-05-28 02:42:19.375001 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.36s
2026-05-28 02:42:19.375006 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.10s
2026-05-28 02:42:19.375012 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 6.04s
2026-05-28 02:42:19.375017 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.97s
2026-05-28 02:42:19.375023 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.97s
2026-05-28 02:42:19.375028 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.97s
2026-05-28 02:42:19.375034 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.96s
2026-05-28 02:42:19.375042 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.56s
2026-05-28 02:42:19.463850 | mon1 | INFO     [default > converge] Executed: Successful
2026-05-28 02:42:19.471825 | mon1 | INFO     [default > idempotence] Executing
2026-05-28 02:42:20.344858 | mon1 |
2026-05-28 02:42:20.345012 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-28 02:42:20.345130 | mon1 |
2026-05-28 02:42:20.345260 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:42:20.345392 | mon1 | Thursday 28 May 2026  02:42:20 +0000 (0:00:00.047)       0:00:00.047 **********
2026-05-28 02:42:21.537306 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:42:21.537491 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:42:21.537694 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:42:21.537897 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:42:21.538103 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:42:21.545625 | mon1 | ok: [mon1]
2026-05-28 02:42:21.545803 | mon1 |
2026-05-28 02:42:21.546002 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:42:21.546230 | mon1 | Thursday 28 May 2026  02:42:21 +0000 (0:00:01.200)       0:00:01.248 **********
2026-05-28 02:42:21.827123 | mon1 | ok: [mon1]
2026-05-28 02:42:21.827279 | mon1 |
2026-05-28 02:42:21.827495 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:42:21.827702 | mon1 | Thursday 28 May 2026  02:42:21 +0000 (0:00:00.281)       0:00:01.529 **********
2026-05-28 02:42:21.859969 | mon1 | skipping: [mon1]
2026-05-28 02:42:21.860116 | mon1 |
2026-05-28 02:42:21.860323 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:42:21.860522 | mon1 | Thursday 28 May 2026  02:42:21 +0000 (0:00:00.033)       0:00:01.562 **********
2026-05-28 02:42:22.149575 | mon1 | ok: [mon1]
2026-05-28 02:42:22.149792 | mon1 |
2026-05-28 02:42:22.150057 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:42:22.150285 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:00.289)       0:00:01.851 **********
2026-05-28 02:42:22.220427 | mon1 | ok: [mon1] => {
2026-05-28 02:42:22.220610 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:42:22.220827 | mon1 | }
2026-05-28 02:42:22.221004 | mon1 |
2026-05-28 02:42:22.221210 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:42:22.221410 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:00.070)       0:00:01.922 **********
2026-05-28 02:42:22.667408 | mon1 | ok: [mon1]
2026-05-28 02:42:22.667500 | mon1 |
2026-05-28 02:42:22.667645 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:42:22.667783 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:00.446)       0:00:02.369 **********
2026-05-28 02:42:22.706452 | mon1 | skipping: [mon1]
2026-05-28 02:42:22.706696 | mon1 |
2026-05-28 02:42:22.706932 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:42:22.707164 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:00.039)       0:00:02.408 **********
2026-05-28 02:42:22.748582 | mon1 | skipping: [mon1]
2026-05-28 02:42:22.748767 | mon1 |
2026-05-28 02:42:22.748973 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:42:22.749178 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:00.042)       0:00:02.451 **********
2026-05-28 02:42:22.938480 | mon1 | ok: [mon1]
2026-05-28 02:42:22.938561 | mon1 |
2026-05-28 02:42:22.938709 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:42:22.938826 | mon1 | Thursday 28 May 2026  02:42:22 +0000 (0:00:00.189)       0:00:02.640 **********
2026-05-28 02:42:24.091240 | mon1 | ok: [mon1]
2026-05-28 02:42:24.091286 | mon1 |
2026-05-28 02:42:24.091296 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:42:24.091485 | mon1 | Thursday 28 May 2026  02:42:24 +0000 (0:00:01.152)       0:00:03.793 **********
2026-05-28 02:42:24.156949 | mon1 | ok: [mon1] => {
2026-05-28 02:42:24.157017 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:42:24.157393 | mon1 | }
2026-05-28 02:42:24.157446 | mon1 |
2026-05-28 02:42:24.157451 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:42:24.157456 | mon1 | Thursday 28 May 2026  02:42:24 +0000 (0:00:00.066)       0:00:03.859 **********
2026-05-28 02:42:24.505186 | mon1 | ok: [mon1]
2026-05-28 02:42:24.505295 | mon1 |
2026-05-28 02:42:24.505603 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:42:24.505651 | mon1 | Thursday 28 May 2026  02:42:24 +0000 (0:00:00.347)       0:00:04.207 **********
2026-05-28 02:42:26.676782 | mon1 | ok: [mon1]
2026-05-28 02:42:26.676868 | mon1 |
2026-05-28 02:42:26.676932 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:42:26.677044 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:02.171)       0:00:06.379 **********
2026-05-28 02:42:26.705284 | mon1 | skipping: [mon1]
2026-05-28 02:42:26.705345 | mon1 |
2026-05-28 02:42:26.705563 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:42:26.705611 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.028)       0:00:06.407 **********
2026-05-28 02:42:26.736304 | mon1 | skipping: [mon1]
2026-05-28 02:42:26.736411 | mon1 |
2026-05-28 02:42:26.736709 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:42:26.736758 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.030)       0:00:06.438 **********
2026-05-28 02:42:26.764924 | mon1 | skipping: [mon1]
2026-05-28 02:42:26.764981 | mon1 |
2026-05-28 02:42:26.765220 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:42:26.765264 | mon1 | Thursday 28 May 2026  02:42:26 +0000 (0:00:00.028)       0:00:06.467 **********
2026-05-28 02:42:27.758948 | mon1 | ok: [mon1]
2026-05-28 02:42:27.759021 | mon1 |
2026-05-28 02:42:27.759359 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:42:27.759404 | mon1 | Thursday 28 May 2026  02:42:27 +0000 (0:00:00.993)       0:00:07.461 **********
2026-05-28 02:42:28.174204 | mon1 | ok: [mon1]
2026-05-28 02:42:28.174308 | mon1 |
2026-05-28 02:42:28.174610 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:42:28.174659 | mon1 | Thursday 28 May 2026  02:42:28 +0000 (0:00:00.415)       0:00:07.876 **********
2026-05-28 02:42:29.065100 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:42:29.066043 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:42:29.066066 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:42:29.066073 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:42:29.066080 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:42:29.066086 | mon1 |
2026-05-28 02:42:29.066092 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:42:29.066098 | mon1 | Thursday 28 May 2026  02:42:29 +0000 (0:00:00.890)       0:00:08.767 **********
2026-05-28 02:42:29.592856 | mon1 | ok: [mon1]
2026-05-28 02:42:29.592906 | mon1 |
2026-05-28 02:42:29.593018 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:42:29.593407 | mon1 | Thursday 28 May 2026  02:42:29 +0000 (0:00:00.521)       0:00:09.289 **********
2026-05-28 02:42:29.593510 | mon1 |
2026-05-28 02:42:29.593516 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:42:29.593520 | mon1 | Thursday 28 May 2026  02:42:29 +0000 (0:00:00.006)       0:00:09.295 **********
2026-05-28 02:42:30.192528 | mon1 | ok: [mon1]
2026-05-28 02:42:30.192590 | mon1 |
2026-05-28 02:42:30.192679 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:42:30.192783 | mon1 | Thursday 28 May 2026  02:42:30 +0000 (0:00:00.599)       0:00:09.895 **********
2026-05-28 02:42:30.388083 | mon1 | ok: [mon1]
2026-05-28 02:42:30.388146 | mon1 |
2026-05-28 02:42:30.388158 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:42:30.388274 | mon1 | Thursday 28 May 2026  02:42:30 +0000 (0:00:00.195)       0:00:10.090 **********
2026-05-28 02:42:30.457620 | mon1 | ok: [mon1] => {
2026-05-28 02:42:30.457660 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:42:30.457668 | mon1 | }
2026-05-28 02:42:30.457675 | mon1 |
2026-05-28 02:42:30.457681 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:42:30.457687 | mon1 | Thursday 28 May 2026  02:42:30 +0000 (0:00:00.068)       0:00:10.159 **********
2026-05-28 02:42:30.807316 | mon1 | ok: [mon1]
2026-05-28 02:42:30.807416 | mon1 |
2026-05-28 02:42:30.807737 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:42:30.807757 | mon1 | Thursday 28 May 2026  02:42:30 +0000 (0:00:00.350)       0:00:10.509 **********
2026-05-28 02:42:33.833563 | mon1 | ok: [mon1]
2026-05-28 02:42:33.833627 | mon1 |
2026-05-28 02:42:33.833860 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:42:33.833927 | mon1 | Thursday 28 May 2026  02:42:33 +0000 (0:00:03.026)       0:00:13.536 **********
2026-05-28 02:42:34.892687 | mon1 | ok: [mon1]
2026-05-28 02:42:34.892766 | mon1 |
2026-05-28 02:42:34.892818 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:42:34.892947 | mon1 | Thursday 28 May 2026  02:42:34 +0000 (0:00:01.059)       0:00:14.595 **********
2026-05-28 02:42:35.204504 | mon1 | ok: [mon1]
2026-05-28 02:42:35.204568 | mon1 |
2026-05-28 02:42:35.204681 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:42:35.204817 | mon1 | Thursday 28 May 2026  02:42:35 +0000 (0:00:00.311)       0:00:14.907 **********
2026-05-28 02:42:35.602102 | mon1 | ok: [mon1]
2026-05-28 02:42:35.602168 | mon1 |
2026-05-28 02:42:35.602452 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:42:35.602473 | mon1 | Thursday 28 May 2026  02:42:35 +0000 (0:00:00.397)       0:00:15.304 **********
2026-05-28 02:42:36.123120 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:42:36.123196 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:42:36.123614 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:42:36.123654 | mon1 |
2026-05-28 02:42:36.123659 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:42:36.123664 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.521)       0:00:15.825 **********
2026-05-28 02:42:36.515951 | mon1 | ok: [mon1]
2026-05-28 02:42:36.515996 | mon1 |
2026-05-28 02:42:36.516005 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:42:36.516013 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.392)       0:00:16.217 **********
2026-05-28 02:42:36.938987 | mon1 | ok: [mon1]
2026-05-28 02:42:36.939047 | mon1 |
2026-05-28 02:42:36.939057 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:42:36.939253 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.416)       0:00:16.634 **********
2026-05-28 02:42:36.939312 | mon1 |
2026-05-28 02:42:36.939326 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:42:36.939463 | mon1 | Thursday 28 May 2026  02:42:36 +0000 (0:00:00.006)       0:00:16.641 **********
2026-05-28 02:42:37.283015 | mon1 | ok: [mon1]
2026-05-28 02:42:37.283078 | mon1 |
2026-05-28 02:42:37.283090 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:42:37.283106 | mon1 | Thursday 28 May 2026  02:42:37 +0000 (0:00:00.343)       0:00:16.985 **********
2026-05-28 02:42:37.330071 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-28 02:42:37.330139 | mon1 |
2026-05-28 02:42:37.330463 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:42:37.330512 | mon1 | Thursday 28 May 2026  02:42:37 +0000 (0:00:00.047)       0:00:17.032 **********
2026-05-28 02:42:38.319080 | mon1 | ok: [mon1]
2026-05-28 02:42:38.319170 | mon1 |
2026-05-28 02:42:38.319275 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:42:38.319386 | mon1 | Thursday 28 May 2026  02:42:38 +0000 (0:00:00.989)       0:00:18.021 **********
2026-05-28 02:42:38.951892 | mon1 | ok: [mon1] => (item=chronyd)
2026-05-28 02:42:38.952091 | mon1 | ok: [mon1] => (item=sshd)
2026-05-28 02:42:38.952334 | mon1 |
2026-05-28 02:42:38.952572 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:42:38.952790 | mon1 | Thursday 28 May 2026  02:42:38 +0000 (0:00:00.632)       0:00:18.654 **********
2026-05-28 02:42:39.225186 | mon1 | ok: [mon1]
2026-05-28 02:42:39.225339 | mon1 |
2026-05-28 02:42:39.225551 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:42:39.225762 | mon1 | Thursday 28 May 2026  02:42:39 +0000 (0:00:00.273)       0:00:18.927 **********
2026-05-28 02:42:39.415743 | mon1 | ok: [mon1]
2026-05-28 02:42:39.415906 | mon1 |
2026-05-28 02:42:39.416132 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:42:39.416362 | mon1 | Thursday 28 May 2026  02:42:39 +0000 (0:00:00.190)       0:00:19.117 **********
2026-05-28 02:42:39.810958 | mon1 | ok: [mon1]
2026-05-28 02:42:39.811120 | mon1 |
2026-05-28 02:42:39.811341 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:42:39.811546 | mon1 | Thursday 28 May 2026  02:42:39 +0000 (0:00:00.395)       0:00:19.513 **********
2026-05-28 02:42:40.129448 | mon1 | ok: [mon1]
2026-05-28 02:42:40.129652 | mon1 |
2026-05-28 02:42:40.129872 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-28 02:42:40.130078 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:00.318)       0:00:19.831 **********
2026-05-28 02:42:40.229104 | mon1 | ok: [mon1]
2026-05-28 02:42:40.229278 | mon1 |
2026-05-28 02:42:40.229553 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-28 02:42:40.229795 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:00.099)       0:00:19.930 **********
2026-05-28 02:42:40.512256 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:42:40.512323 | mon1 |
2026-05-28 02:42:40.512336 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-28 02:42:40.512345 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:00.283)       0:00:20.213 **********
2026-05-28 02:42:40.551891 | mon1 | ok: [mon1]
2026-05-28 02:42:40.551971 | mon1 |
2026-05-28 02:42:40.552294 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-28 02:42:40.552346 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:00.040)       0:00:20.254 **********
2026-05-28 02:42:40.592857 | mon1 | skipping: [mon1]
2026-05-28 02:42:40.592940 | mon1 |
2026-05-28 02:42:40.593030 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:42:40.593133 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:00.041)       0:00:20.295 **********
2026-05-28 02:42:40.653822 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:42:40.653865 | mon1 |
2026-05-28 02:42:40.654094 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:42:40.654141 | mon1 | Thursday 28 May 2026  02:42:40 +0000 (0:00:00.060)       0:00:20.356 **********
2026-05-28 02:42:46.712289 | mon1 | ok: [mon1]
2026-05-28 02:42:46.712353 | mon1 |
2026-05-28 02:42:46.712650 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:42:46.712669 | mon1 | Thursday 28 May 2026  02:42:46 +0000 (0:00:06.058)       0:00:26.414 **********
2026-05-28 02:42:46.760313 | mon1 | ok: [mon1] => (item=mon1)
2026-05-28 02:42:46.760403 | mon1 |
2026-05-28 02:42:46.760715 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:42:46.760763 | mon1 | Thursday 28 May 2026  02:42:46 +0000 (0:00:00.047)       0:00:26.462 **********
2026-05-28 02:42:47.103883 | mon1 | ok: [mon1]
2026-05-28 02:42:47.103950 | mon1 |
2026-05-28 02:42:47.104266 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:42:47.104314 | mon1 | Thursday 28 May 2026  02:42:47 +0000 (0:00:00.343)       0:00:26.806 **********
2026-05-28 02:42:53.425211 | mon1 | ok: [mon1]
2026-05-28 02:42:53.425294 | mon1 |
2026-05-28 02:42:53.425489 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-28 02:42:53.425533 | mon1 | Thursday 28 May 2026  02:42:53 +0000 (0:00:06.321)       0:00:33.127 **********
2026-05-28 02:42:59.424975 | mon1 | ok: [mon1]
2026-05-28 02:42:59.425079 | mon1 |
2026-05-28 02:42:59.425390 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-28 02:42:59.425437 | mon1 | Thursday 28 May 2026  02:42:59 +0000 (0:00:05.999)       0:00:39.127 **********
2026-05-28 02:43:13.461739 | mon1 | ok: [mon1]
2026-05-28 02:43:13.461787 | mon1 |
2026-05-28 02:43:13.461792 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:43:13.461797 | mon1 | Thursday 28 May 2026  02:43:13 +0000 (0:00:14.036)       0:00:53.164 **********
2026-05-28 02:43:13.523667 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-28 02:43:13.523704 | mon1 |
2026-05-28 02:43:13.523710 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:43:13.523715 | mon1 | Thursday 28 May 2026  02:43:13 +0000 (0:00:00.061)       0:00:53.226 **********
2026-05-28 02:43:13.565009 | mon1 | skipping: [mon1]
2026-05-28 02:43:13.565031 | mon1 |
2026-05-28 02:43:13.565038 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:43:13.565044 | mon1 | Thursday 28 May 2026  02:43:13 +0000 (0:00:00.041)       0:00:53.267 **********
2026-05-28 02:43:13.602217 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-28 02:43:13.602632 | mon1 | skipping: [mon1]
2026-05-28 02:43:13.602680 | mon1 |
2026-05-28 02:43:13.602686 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:43:13.602691 | mon1 | Thursday 28 May 2026  02:43:13 +0000 (0:00:00.037)       0:00:53.304 **********
2026-05-28 02:43:13.844605 | mon1 | ok: [mon1]
2026-05-28 02:43:13.844707 | mon1 |
2026-05-28 02:43:13.844993 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:43:13.845015 | mon1 | Thursday 28 May 2026  02:43:13 +0000 (0:00:00.242)       0:00:53.547 **********
2026-05-28 02:43:20.213552 | mon1 | ok: [mon1]
2026-05-28 02:43:20.213634 | mon1 |
2026-05-28 02:43:20.213719 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-28 02:43:20.213814 | mon1 | Thursday 28 May 2026  02:43:20 +0000 (0:00:06.368)       0:00:59.915 **********
2026-05-28 02:43:26.200759 | mon1 | ok: [mon1]
2026-05-28 02:43:26.200835 | mon1 |
2026-05-28 02:43:26.201151 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-28 02:43:26.201201 | mon1 | Thursday 28 May 2026  02:43:26 +0000 (0:00:05.987)       0:01:05.903 **********
2026-05-28 02:43:32.168333 | mon1 | ok: [mon1]
2026-05-28 02:43:32.168732 | mon1 |
2026-05-28 02:43:32.168780 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-28 02:43:32.168788 | mon1 | Thursday 28 May 2026  02:43:32 +0000 (0:00:05.967)       0:01:11.870 **********
2026-05-28 02:43:36.845477 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-28 02:43:36.845543 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-28 02:43:36.845642 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-05-28 02:43:36.846217 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-28 02:43:36.846259 | mon1 |
2026-05-28 02:43:36.846269 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-28 02:43:36.846274 | mon1 |
2026-05-28 02:43:36.846278 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:43:36.846282 | mon1 | Thursday 28 May 2026  02:43:36 +0000 (0:00:04.677)       0:01:16.548 **********
2026-05-28 02:43:38.000783 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-28 02:43:38.001614 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:43:38.001676 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:43:38.001687 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:43:38.001697 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:43:38.011518 | mon1 | ok: [osd1]
2026-05-28 02:43:38.011939 | mon1 |
2026-05-28 02:43:38.011966 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:43:38.011974 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:01.165)       0:01:17.713 **********
2026-05-28 02:43:38.216520 | mon1 | ok: [osd1]
2026-05-28 02:43:38.216599 | mon1 |
2026-05-28 02:43:38.216616 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:43:38.216742 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.205)       0:01:17.918 **********
2026-05-28 02:43:38.256218 | mon1 | skipping: [osd1]
2026-05-28 02:43:38.256299 | mon1 |
2026-05-28 02:43:38.256540 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:43:38.256577 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.039)       0:01:17.958 **********
2026-05-28 02:43:38.459889 | mon1 | ok: [osd1]
2026-05-28 02:43:38.459965 | mon1 |
2026-05-28 02:43:38.460023 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:43:38.460141 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.203)       0:01:18.162 **********
2026-05-28 02:43:38.539485 | mon1 | ok: [osd1] => {
2026-05-28 02:43:38.539606 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:43:38.539734 | mon1 | }
2026-05-28 02:43:38.539927 | mon1 |
2026-05-28 02:43:38.540106 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:43:38.540282 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.079)       0:01:18.241 **********
2026-05-28 02:43:38.857951 | mon1 | ok: [osd1]
2026-05-28 02:43:38.858037 | mon1 |
2026-05-28 02:43:38.858160 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:43:38.858374 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.318)       0:01:18.560 **********
2026-05-28 02:43:38.897639 | mon1 | skipping: [osd1]
2026-05-28 02:43:38.897716 | mon1 |
2026-05-28 02:43:38.897834 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:43:38.897990 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.040)       0:01:18.600 **********
2026-05-28 02:43:38.943343 | mon1 | skipping: [osd1]
2026-05-28 02:43:38.943418 | mon1 |
2026-05-28 02:43:38.943547 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:43:38.943710 | mon1 | Thursday 28 May 2026  02:43:38 +0000 (0:00:00.043)       0:01:18.643 **********
2026-05-28 02:43:39.151331 | mon1 | ok: [osd1]
2026-05-28 02:43:39.151411 | mon1 |
2026-05-28 02:43:39.151491 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:43:39.151696 | mon1 | Thursday 28 May 2026  02:43:39 +0000 (0:00:00.206)       0:01:18.849 **********
2026-05-28 02:43:40.219571 | mon1 | ok: [osd1]
2026-05-28 02:43:40.219940 | mon1 |
2026-05-28 02:43:40.220227 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:43:40.220496 | mon1 | Thursday 28 May 2026  02:43:40 +0000 (0:00:01.071)       0:01:19.920 **********
2026-05-28 02:43:40.291771 | mon1 | ok: [osd1] => {
2026-05-28 02:43:40.292066 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:43:40.292246 | mon1 | }
2026-05-28 02:43:40.292413 | mon1 |
2026-05-28 02:43:40.292604 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:43:40.292787 | mon1 | Thursday 28 May 2026  02:43:40 +0000 (0:00:00.072)       0:01:19.993 **********
2026-05-28 02:43:40.650967 | mon1 | ok: [osd1]
2026-05-28 02:43:40.651209 | mon1 |
2026-05-28 02:43:40.651356 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:43:40.651480 | mon1 | Thursday 28 May 2026  02:43:40 +0000 (0:00:00.356)       0:01:20.350 **********
2026-05-28 02:43:42.639964 | mon1 | ok: [osd1]
2026-05-28 02:43:42.640039 | mon1 |
2026-05-28 02:43:42.640085 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:43:42.640215 | mon1 | Thursday 28 May 2026  02:43:42 +0000 (0:00:01.992)       0:01:22.342 **********
2026-05-28 02:43:42.668259 | mon1 | skipping: [osd1]
2026-05-28 02:43:42.668332 | mon1 |
2026-05-28 02:43:42.668614 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:43:42.668655 | mon1 | Thursday 28 May 2026  02:43:42 +0000 (0:00:00.028)       0:01:22.370 **********
2026-05-28 02:43:42.698890 | mon1 | skipping: [osd1]
2026-05-28 02:43:42.699295 | mon1 |
2026-05-28 02:43:42.699326 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:43:42.699333 | mon1 | Thursday 28 May 2026  02:43:42 +0000 (0:00:00.030)       0:01:22.401 **********
2026-05-28 02:43:42.731673 | mon1 | skipping: [osd1]
2026-05-28 02:43:42.731772 | mon1 |
2026-05-28 02:43:42.732061 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:43:42.732101 | mon1 | Thursday 28 May 2026  02:43:42 +0000 (0:00:00.032)       0:01:22.433 **********
2026-05-28 02:43:43.768203 | mon1 | ok: [osd1]
2026-05-28 02:43:43.768249 | mon1 |
2026-05-28 02:43:43.768256 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:43:43.768263 | mon1 | Thursday 28 May 2026  02:43:43 +0000 (0:00:01.036)       0:01:23.470 **********
2026-05-28 02:43:44.204920 | mon1 | ok: [osd1]
2026-05-28 02:43:44.204991 | mon1 |
2026-05-28 02:43:44.205257 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:43:44.205331 | mon1 | Thursday 28 May 2026  02:43:44 +0000 (0:00:00.436)       0:01:23.907 **********
2026-05-28 02:43:45.150582 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-05-28 02:43:45.150677 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:43:45.151171 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:43:45.151255 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:43:45.151297 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:43:45.151309 | mon1 |
2026-05-28 02:43:45.151539 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:43:45.151571 | mon1 | Thursday 28 May 2026  02:43:45 +0000 (0:00:00.945)       0:01:24.852 **********
2026-05-28 02:43:45.701089 | mon1 | ok: [osd1]
2026-05-28 02:43:45.701208 | mon1 |
2026-05-28 02:43:45.701221 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:43:45.701233 | mon1 | Thursday 28 May 2026  02:43:45 +0000 (0:00:00.544)       0:01:25.396 **********
2026-05-28 02:43:45.701532 | mon1 |
2026-05-28 02:43:45.701584 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:43:45.701591 | mon1 | Thursday 28 May 2026  02:43:45 +0000 (0:00:00.006)       0:01:25.403 **********
2026-05-28 02:43:46.071755 | mon1 | ok: [osd1]
2026-05-28 02:43:46.071828 | mon1 |
2026-05-28 02:43:46.071841 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:43:46.071995 | mon1 | Thursday 28 May 2026  02:43:46 +0000 (0:00:00.370)       0:01:25.773 **********
2026-05-28 02:43:46.279792 | mon1 | ok: [osd1]
2026-05-28 02:43:46.279877 | mon1 |
2026-05-28 02:43:46.280138 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:43:46.280204 | mon1 | Thursday 28 May 2026  02:43:46 +0000 (0:00:00.207)       0:01:25.981 **********
2026-05-28 02:43:46.354418 | mon1 | ok: [osd1] => {
2026-05-28 02:43:46.354976 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:43:46.355026 | mon1 | }
2026-05-28 02:43:46.355567 | mon1 |
2026-05-28 02:43:46.355633 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:43:46.355646 | mon1 | Thursday 28 May 2026  02:43:46 +0000 (0:00:00.073)       0:01:26.055 **********
2026-05-28 02:43:46.740838 | mon1 | ok: [osd1]
2026-05-28 02:43:46.740926 | mon1 |
2026-05-28 02:43:46.741195 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:43:46.741242 | mon1 | Thursday 28 May 2026  02:43:46 +0000 (0:00:00.387)       0:01:26.443 **********
2026-05-28 02:43:49.906272 | mon1 | ok: [osd1]
2026-05-28 02:43:49.906398 | mon1 |
2026-05-28 02:43:49.906410 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:43:49.906424 | mon1 | Thursday 28 May 2026  02:43:49 +0000 (0:00:03.165)       0:01:29.608 **********
2026-05-28 02:43:50.928064 | mon1 | ok: [osd1]
2026-05-28 02:43:50.928163 | mon1 |
2026-05-28 02:43:50.928431 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:43:50.928487 | mon1 | Thursday 28 May 2026  02:43:50 +0000 (0:00:01.021)       0:01:30.630 **********
2026-05-28 02:43:51.135717 | mon1 | ok: [osd1]
2026-05-28 02:43:51.135797 | mon1 |
2026-05-28 02:43:51.136077 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:43:51.136126 | mon1 | Thursday 28 May 2026  02:43:51 +0000 (0:00:00.207)       0:01:30.838 **********
2026-05-28 02:43:51.562669 | mon1 | ok: [osd1]
2026-05-28 02:43:51.562738 | mon1 |
2026-05-28 02:43:51.563082 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:43:51.563147 | mon1 | Thursday 28 May 2026  02:43:51 +0000 (0:00:00.427)       0:01:31.265 **********
2026-05-28 02:43:52.130419 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-05-28 02:43:52.130488 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:43:52.130844 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:43:52.130891 | mon1 |
2026-05-28 02:43:52.130897 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:43:52.130918 | mon1 | Thursday 28 May 2026  02:43:52 +0000 (0:00:00.567)       0:01:31.832 **********
2026-05-28 02:43:52.537012 | mon1 | ok: [osd1]
2026-05-28 02:43:52.537073 | mon1 |
2026-05-28 02:43:52.537364 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:43:52.537449 | mon1 | Thursday 28 May 2026  02:43:52 +0000 (0:00:00.406)       0:01:32.239 **********
2026-05-28 02:43:52.973567 | mon1 | ok: [osd1]
2026-05-28 02:43:52.973690 | mon1 |
2026-05-28 02:43:52.973702 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:43:52.974145 | mon1 | Thursday 28 May 2026  02:43:52 +0000 (0:00:00.430)       0:01:32.669 **********
2026-05-28 02:43:52.974203 | mon1 |
2026-05-28 02:43:52.974210 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:43:52.974215 | mon1 | Thursday 28 May 2026  02:43:52 +0000 (0:00:00.006)       0:01:32.676 **********
2026-05-28 02:43:53.325837 | mon1 | ok: [osd1]
2026-05-28 02:43:53.325917 | mon1 |
2026-05-28 02:43:53.325984 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:43:53.326136 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:00.351)       0:01:33.027 **********
2026-05-28 02:43:53.378647 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-28 02:43:53.378731 | mon1 |
2026-05-28 02:43:53.378944 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:43:53.378972 | mon1 | Thursday 28 May 2026  02:43:53 +0000 (0:00:00.053)       0:01:33.080 **********
2026-05-28 02:43:54.415877 | mon1 | ok: [osd1]
2026-05-28 02:43:54.415937 | mon1 |
2026-05-28 02:43:54.415962 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:43:54.415974 | mon1 | Thursday 28 May 2026  02:43:54 +0000 (0:00:01.036)       0:01:34.117 **********
2026-05-28 02:43:55.071393 | mon1 | ok: [osd1] => (item=chronyd)
2026-05-28 02:43:55.071490 | mon1 | ok: [osd1] => (item=sshd)
2026-05-28 02:43:55.071507 | mon1 |
2026-05-28 02:43:55.071797 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:43:55.071874 | mon1 | Thursday 28 May 2026  02:43:55 +0000 (0:00:00.655)       0:01:34.773 **********
2026-05-28 02:43:55.365943 | mon1 | ok: [osd1]
2026-05-28 02:43:55.366067 | mon1 |
2026-05-28 02:43:55.366079 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:43:55.366364 | mon1 | Thursday 28 May 2026  02:43:55 +0000 (0:00:00.294)       0:01:35.068 **********
2026-05-28 02:43:55.570558 | mon1 | ok: [osd1]
2026-05-28 02:43:55.570617 | mon1 |
2026-05-28 02:43:55.570897 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:43:55.570986 | mon1 | Thursday 28 May 2026  02:43:55 +0000 (0:00:00.204)       0:01:35.272 **********
2026-05-28 02:43:55.812807 | mon1 | ok: [osd1]
2026-05-28 02:43:55.812922 | mon1 |
2026-05-28 02:43:55.812930 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:43:55.813046 | mon1 | Thursday 28 May 2026  02:43:55 +0000 (0:00:00.242)       0:01:35.515 **********
2026-05-28 02:43:56.017345 | mon1 | ok: [osd1]
2026-05-28 02:43:56.017425 | mon1 |
2026-05-28 02:43:56.017485 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-28 02:43:56.017645 | mon1 | Thursday 28 May 2026  02:43:56 +0000 (0:00:00.204)       0:01:35.719 **********
2026-05-28 02:43:56.234055 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-28 02:43:56.234134 | mon1 |
2026-05-28 02:43:56.234348 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-28 02:43:56.234391 | mon1 | Thursday 28 May 2026  02:43:56 +0000 (0:00:00.216)       0:01:35.936 **********
2026-05-28 02:43:56.276496 | mon1 | ok: [osd1]
2026-05-28 02:43:56.276977 | mon1 |
2026-05-28 02:43:56.277028 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-28 02:43:56.277036 | mon1 | Thursday 28 May 2026  02:43:56 +0000 (0:00:00.042)       0:01:35.978 **********
2026-05-28 02:43:56.330619 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-28 02:43:56.330668 | mon1 |
2026-05-28 02:43:56.330883 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-28 02:43:56.330942 | mon1 | Thursday 28 May 2026  02:43:56 +0000 (0:00:00.054)       0:01:36.033 **********
2026-05-28 02:44:02.341453 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:02.341562 | mon1 |
2026-05-28 02:44:02.341863 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-28 02:44:02.341886 | mon1 | Thursday 28 May 2026  02:44:02 +0000 (0:00:06.010)       0:01:42.043 **********
2026-05-28 02:44:02.387900 | mon1 | ok: [osd1] => (item=osd1)
2026-05-28 02:44:02.387979 | mon1 |
2026-05-28 02:44:02.388319 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-28 02:44:02.388372 | mon1 | Thursday 28 May 2026  02:44:02 +0000 (0:00:00.046)       0:01:42.089 **********
2026-05-28 02:44:02.664586 | mon1 | ok: [osd1]
2026-05-28 02:44:02.664651 | mon1 |
2026-05-28 02:44:02.664931 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-28 02:44:02.664953 | mon1 | Thursday 28 May 2026  02:44:02 +0000 (0:00:00.276)       0:01:42.366 **********
2026-05-28 02:44:09.048059 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:09.048137 | mon1 |
2026-05-28 02:44:09.048150 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-28 02:44:09.048281 | mon1 | Thursday 28 May 2026  02:44:09 +0000 (0:00:06.383)       0:01:48.750 **********
2026-05-28 02:44:14.492960 | mon1 | ok: [osd1]
2026-05-28 02:44:14.493034 | mon1 |
2026-05-28 02:44:14.493051 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-28 02:44:14.493183 | mon1 | Thursday 28 May 2026  02:44:14 +0000 (0:00:05.444)       0:01:54.195 **********
2026-05-28 02:44:36.623083 | mon1 | ok: [osd1]
2026-05-28 02:44:36.623195 | mon1 |
2026-05-28 02:44:36.623207 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-28 02:44:36.623218 | mon1 | Thursday 28 May 2026  02:44:36 +0000 (0:00:22.129)       0:02:16.325 **********
2026-05-28 02:44:36.695538 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-05-28 02:44:36.695643 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-05-28 02:44:36.695654 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-05-28 02:44:36.696042 | mon1 | skipping: [osd1]
2026-05-28 02:44:36.696101 | mon1 |
2026-05-28 02:44:36.696107 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-28 02:44:36.696123 | mon1 | Thursday 28 May 2026  02:44:36 +0000 (0:00:00.072)       0:02:16.397 **********
2026-05-28 02:44:42.750231 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:42.750278 | mon1 |
2026-05-28 02:44:42.750315 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-28 02:44:42.750684 | mon1 | Thursday 28 May 2026  02:44:42 +0000 (0:00:06.054)       0:02:22.452 **********
2026-05-28 02:44:48.690816 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:48.690895 | mon1 |
2026-05-28 02:44:48.691300 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-28 02:44:48.691347 | mon1 | Thursday 28 May 2026  02:44:48 +0000 (0:00:05.940)       0:02:28.393 **********
2026-05-28 02:44:48.741307 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-28 02:44:48.741362 | mon1 |
2026-05-28 02:44:48.741591 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-28 02:44:48.741637 | mon1 | Thursday 28 May 2026  02:44:48 +0000 (0:00:00.050)       0:02:28.443 **********
2026-05-28 02:44:48.776445 | mon1 | ok: [osd1]
2026-05-28 02:44:48.776528 | mon1 |
2026-05-28 02:44:48.776743 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-28 02:44:48.776768 | mon1 | Thursday 28 May 2026  02:44:48 +0000 (0:00:00.035)       0:02:28.479 **********
2026-05-28 02:44:54.727746 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-28 02:44:54.727823 | mon1 |
2026-05-28 02:44:54.727893 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-28 02:44:54.728020 | mon1 | Thursday 28 May 2026  02:44:54 +0000 (0:00:05.951)       0:02:34.430 **********
2026-05-28 02:44:54.765715 | mon1 | ok: [osd1]
2026-05-28 02:44:54.765800 | mon1 |
2026-05-28 02:44:54.766033 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-28 02:44:54.766076 | mon1 | Thursday 28 May 2026  02:44:54 +0000 (0:00:00.037)       0:02:34.468 **********
2026-05-28 02:44:54.797681 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:44:54.797770 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:44:54.797865 | mon1 | skipping: [osd1] => (item=1)
2026-05-28 02:44:54.798252 | mon1 | skipping: [osd1]
2026-05-28 02:44:54.798294 | mon1 |
2026-05-28 02:44:54.798305 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-28 02:44:54.798310 | mon1 | Thursday 28 May 2026  02:44:54 +0000 (0:00:00.032)       0:02:34.500 **********
2026-05-28 02:44:54.850879 | mon1 | skipping: [osd1]
2026-05-28 02:44:54.850970 | mon1 |
2026-05-28 02:44:54.851373 | mon1 | PLAY [Deploy Ceph exporters] ***************************************************
2026-05-28 02:44:54.851420 | mon1 |
2026-05-28 02:44:54.851426 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:44:54.851430 | mon1 | Thursday 28 May 2026  02:44:54 +0000 (0:00:00.053)       0:02:34.553 **********
2026-05-28 02:44:55.722359 | mon1 | ok: [mon1]
2026-05-28 02:44:55.722435 | mon1 |
2026-05-28 02:44:55.722495 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:44:55.722614 | mon1 | Thursday 28 May 2026  02:44:55 +0000 (0:00:00.871)       0:02:35.424 **********
2026-05-28 02:44:55.922061 | mon1 | ok: [mon1]
2026-05-28 02:44:55.922124 | mon1 |
2026-05-28 02:44:55.922218 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:44:55.922356 | mon1 | Thursday 28 May 2026  02:44:55 +0000 (0:00:00.199)       0:02:35.624 **********
2026-05-28 02:44:55.953706 | mon1 | skipping: [mon1]
2026-05-28 02:44:55.953745 | mon1 |
2026-05-28 02:44:55.953964 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-28 02:44:55.954001 | mon1 | Thursday 28 May 2026  02:44:55 +0000 (0:00:00.031)       0:02:35.656 **********
2026-05-28 02:44:56.154200 | mon1 | ok: [mon1]
2026-05-28 02:44:56.154265 | mon1 |
2026-05-28 02:44:56.154348 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:44:56.154477 | mon1 | Thursday 28 May 2026  02:44:56 +0000 (0:00:00.200)       0:02:35.856 **********
2026-05-28 02:44:56.221347 | mon1 | ok: [mon1] => {
2026-05-28 02:44:56.221414 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-28 02:44:56.221831 | mon1 | }
2026-05-28 02:44:56.221873 | mon1 |
2026-05-28 02:44:56.221878 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:44:56.221883 | mon1 | Thursday 28 May 2026  02:44:56 +0000 (0:00:00.067)       0:02:35.923 **********
2026-05-28 02:44:56.524970 | mon1 | ok: [mon1]
2026-05-28 02:44:56.525048 | mon1 |
2026-05-28 02:44:56.525107 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:44:56.525229 | mon1 | Thursday 28 May 2026  02:44:56 +0000 (0:00:00.303)       0:02:36.227 **********
2026-05-28 02:44:56.561863 | mon1 | skipping: [mon1]
2026-05-28 02:44:56.561935 | mon1 |
2026-05-28 02:44:56.562161 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:44:56.562198 | mon1 | Thursday 28 May 2026  02:44:56 +0000 (0:00:00.036)       0:02:36.264 **********
2026-05-28 02:44:56.600999 | mon1 | skipping: [mon1]
2026-05-28 02:44:56.601049 | mon1 |
2026-05-28 02:44:56.601207 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:44:56.601249 | mon1 | Thursday 28 May 2026  02:44:56 +0000 (0:00:00.039)       0:02:36.303 **********
2026-05-28 02:44:56.790654 | mon1 | ok: [mon1]
2026-05-28 02:44:56.790718 | mon1 |
2026-05-28 02:44:56.790801 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-28 02:44:56.790935 | mon1 | Thursday 28 May 2026  02:44:56 +0000 (0:00:00.189)       0:02:36.493 **********
2026-05-28 02:44:57.811216 | mon1 | ok: [mon1]
2026-05-28 02:44:57.811290 | mon1 |
2026-05-28 02:44:57.811497 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:44:57.811538 | mon1 | Thursday 28 May 2026  02:44:57 +0000 (0:00:01.020)       0:02:37.513 **********
2026-05-28 02:44:57.879106 | mon1 | ok: [mon1] => {
2026-05-28 02:44:57.879174 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-28 02:44:57.879770 | mon1 | }
2026-05-28 02:44:57.879817 | mon1 |
2026-05-28 02:44:57.879824 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:44:57.879831 | mon1 | Thursday 28 May 2026  02:44:57 +0000 (0:00:00.067)       0:02:37.581 **********
2026-05-28 02:44:58.206051 | mon1 | ok: [mon1]
2026-05-28 02:44:58.206119 | mon1 |
2026-05-28 02:44:58.206449 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:44:58.206497 | mon1 | Thursday 28 May 2026  02:44:58 +0000 (0:00:00.327)       0:02:37.908 **********
2026-05-28 02:45:00.172741 | mon1 | ok: [mon1]
2026-05-28 02:45:00.172783 | mon1 |
2026-05-28 02:45:00.172789 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-28 02:45:00.172794 | mon1 | Thursday 28 May 2026  02:45:00 +0000 (0:00:01.966)       0:02:39.875 **********
2026-05-28 02:45:00.198293 | mon1 | skipping: [mon1]
2026-05-28 02:45:00.198354 | mon1 |
2026-05-28 02:45:00.198617 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-28 02:45:00.198667 | mon1 | Thursday 28 May 2026  02:45:00 +0000 (0:00:00.025)       0:02:39.900 **********
2026-05-28 02:45:00.216361 | mon1 | skipping: [mon1]
2026-05-28 02:45:00.216426 | mon1 |
2026-05-28 02:45:00.216513 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-28 02:45:00.216622 | mon1 | Thursday 28 May 2026  02:45:00 +0000 (0:00:00.018)       0:02:39.919 **********
2026-05-28 02:45:00.235559 | mon1 | skipping: [mon1]
2026-05-28 02:45:00.235735 | mon1 |
2026-05-28 02:45:00.236051 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-28 02:45:00.236092 | mon1 | Thursday 28 May 2026  02:45:00 +0000 (0:00:00.018)       0:02:39.937 **********
2026-05-28 02:45:01.230480 | mon1 | ok: [mon1]
2026-05-28 02:45:01.230542 | mon1 |
2026-05-28 02:45:01.230644 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-28 02:45:01.230807 | mon1 | Thursday 28 May 2026  02:45:01 +0000 (0:00:00.994)       0:02:40.932 **********
2026-05-28 02:45:01.655276 | mon1 | ok: [mon1]
2026-05-28 02:45:01.655345 | mon1 |
2026-05-28 02:45:01.655708 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-28 02:45:01.655755 | mon1 | Thursday 28 May 2026  02:45:01 +0000 (0:00:00.424)       0:02:41.357 **********
2026-05-28 02:45:02.538441 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-28 02:45:02.538554 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-28 02:45:02.539081 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-28 02:45:02.539144 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-28 02:45:02.539157 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-28 02:45:02.539173 | mon1 |
2026-05-28 02:45:02.539409 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-28 02:45:02.539440 | mon1 | Thursday 28 May 2026  02:45:02 +0000 (0:00:00.883)       0:02:42.241 **********
2026-05-28 02:45:03.032106 | mon1 | ok: [mon1]
2026-05-28 02:45:03.032230 | mon1 |
2026-05-28 02:45:03.032243 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-28 02:45:03.032316 | mon1 | Thursday 28 May 2026  02:45:03 +0000 (0:00:00.487)       0:02:42.728 **********
2026-05-28 02:45:03.032610 | mon1 |
2026-05-28 02:45:03.032661 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-28 02:45:03.032668 | mon1 | Thursday 28 May 2026  02:45:03 +0000 (0:00:00.006)       0:02:42.734 **********
2026-05-28 02:45:03.383124 | mon1 | ok: [mon1]
2026-05-28 02:45:03.383188 | mon1 |
2026-05-28 02:45:03.383279 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-28 02:45:03.383412 | mon1 | Thursday 28 May 2026  02:45:03 +0000 (0:00:00.350)       0:02:43.085 **********
2026-05-28 02:45:03.578555 | mon1 | ok: [mon1]
2026-05-28 02:45:03.578614 | mon1 |
2026-05-28 02:45:03.578714 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-28 02:45:03.578819 | mon1 | Thursday 28 May 2026  02:45:03 +0000 (0:00:00.195)       0:02:43.281 **********
2026-05-28 02:45:03.646553 | mon1 | ok: [mon1] => {
2026-05-28 02:45:03.646620 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-28 02:45:03.646721 | mon1 | }
2026-05-28 02:45:03.646803 | mon1 |
2026-05-28 02:45:03.647112 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-28 02:45:03.647413 | mon1 | Thursday 28 May 2026  02:45:03 +0000 (0:00:00.068)       0:02:43.349 **********
2026-05-28 02:45:04.001007 | mon1 | ok: [mon1]
2026-05-28 02:45:04.001074 | mon1 |
2026-05-28 02:45:04.001290 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-28 02:45:04.001336 | mon1 | Thursday 28 May 2026  02:45:03 +0000 (0:00:00.353)       0:02:43.703 **********
2026-05-28 02:45:07.031935 | mon1 | ok: [mon1]
2026-05-28 02:45:07.032019 | mon1 |
2026-05-28 02:45:07.032080 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-28 02:45:07.032188 | mon1 | Thursday 28 May 2026  02:45:07 +0000 (0:00:03.031)       0:02:46.734 **********
2026-05-28 02:45:08.012224 | mon1 | ok: [mon1]
2026-05-28 02:45:08.012275 | mon1 |
2026-05-28 02:45:08.012285 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-28 02:45:08.012294 | mon1 | Thursday 28 May 2026  02:45:08 +0000 (0:00:00.979)       0:02:47.713 **********
2026-05-28 02:45:08.210064 | mon1 | ok: [mon1]
2026-05-28 02:45:08.210108 | mon1 |
2026-05-28 02:45:08.210116 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-28 02:45:08.210122 | mon1 | Thursday 28 May 2026  02:45:08 +0000 (0:00:00.198)       0:02:47.912 **********
2026-05-28 02:45:08.617297 | mon1 | ok: [mon1]
2026-05-28 02:45:08.617359 | mon1 |
2026-05-28 02:45:08.617563 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-28 02:45:08.617615 | mon1 | Thursday 28 May 2026  02:45:08 +0000 (0:00:00.407)       0:02:48.319 **********
2026-05-28 02:45:09.147984 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-28 02:45:09.148026 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-28 02:45:09.148034 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-28 02:45:09.148040 | mon1 |
2026-05-28 02:45:09.148046 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-28 02:45:09.148052 | mon1 | Thursday 28 May 2026  02:45:09 +0000 (0:00:00.529)       0:02:48.849 **********
2026-05-28 02:45:09.549189 | mon1 | ok: [mon1]
2026-05-28 02:45:09.549243 | mon1 |
2026-05-28 02:45:09.549255 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-28 02:45:09.549265 | mon1 | Thursday 28 May 2026  02:45:09 +0000 (0:00:00.400)       0:02:49.250 **********
2026-05-28 02:45:09.957678 | mon1 | ok: [mon1]
2026-05-28 02:45:09.957730 | mon1 |
2026-05-28 02:45:09.957736 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-28 02:45:09.957744 | mon1 | Thursday 28 May 2026  02:45:09 +0000 (0:00:00.403)       0:02:49.654 **********
2026-05-28 02:45:09.957750 | mon1 |
2026-05-28 02:45:09.957756 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-28 02:45:09.957763 | mon1 | Thursday 28 May 2026  02:45:09 +0000 (0:00:00.004)       0:02:49.659 **********
2026-05-28 02:45:10.286609 | mon1 | ok: [mon1]
2026-05-28 02:45:10.286647 | mon1 |
2026-05-28 02:45:10.286653 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-28 02:45:10.286658 | mon1 | Thursday 28 May 2026  02:45:10 +0000 (0:00:00.329)       0:02:49.988 **********
2026-05-28 02:45:10.329972 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-28 02:45:10.330000 | mon1 |
2026-05-28 02:45:10.330007 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-28 02:45:10.330013 | mon1 | Thursday 28 May 2026  02:45:10 +0000 (0:00:00.043)       0:02:50.032 **********
2026-05-28 02:45:11.312170 | mon1 | ok: [mon1]
2026-05-28 02:45:11.312217 | mon1 |
2026-05-28 02:45:11.312224 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-28 02:45:11.312230 | mon1 | Thursday 28 May 2026  02:45:11 +0000 (0:00:00.981)       0:02:51.013 **********
2026-05-28 02:45:11.944347 | mon1 | ok: [mon1] => (item=chronyd)
2026-05-28 02:45:11.944418 | mon1 | ok: [mon1] => (item=sshd)
2026-05-28 02:45:11.944507 | mon1 |
2026-05-28 02:45:11.944743 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-28 02:45:11.944782 | mon1 | Thursday 28 May 2026  02:45:11 +0000 (0:00:00.633)       0:02:51.647 **********
2026-05-28 02:45:12.232920 | mon1 | ok: [mon1]
2026-05-28 02:45:12.233007 | mon1 |
2026-05-28 02:45:12.233025 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-28 02:45:12.233144 | mon1 | Thursday 28 May 2026  02:45:12 +0000 (0:00:00.288)       0:02:51.935 **********
2026-05-28 02:45:12.420041 | mon1 | ok: [mon1]
2026-05-28 02:45:12.420101 | mon1 |
2026-05-28 02:45:12.420180 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-28 02:45:12.420303 | mon1 | Thursday 28 May 2026  02:45:12 +0000 (0:00:00.187)       0:02:52.122 **********
2026-05-28 02:45:12.654828 | mon1 | ok: [mon1]
2026-05-28 02:45:12.654895 | mon1 |
2026-05-28 02:45:12.655153 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-28 02:45:12.655190 | mon1 | Thursday 28 May 2026  02:45:12 +0000 (0:00:00.234)       0:02:52.357 **********
2026-05-28 02:45:12.850887 | mon1 | ok: [mon1]
2026-05-28 02:45:12.850981 | mon1 |
2026-05-28 02:45:12.851184 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] ***********
2026-05-28 02:45:12.851229 | mon1 | Thursday 28 May 2026  02:45:12 +0000 (0:00:00.196)       0:02:52.553 **********
2026-05-28 02:45:18.849332 | mon1 | ok: [mon1]
2026-05-28 02:45:18.849405 | mon1 |
2026-05-28 02:45:18.849608 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist] *************
2026-05-28 02:45:18.849664 | mon1 | Thursday 28 May 2026  02:45:18 +0000 (0:00:05.998)       0:02:58.551 **********
2026-05-28 02:45:24.809435 | mon1 | ok: [mon1]
2026-05-28 02:45:24.809502 | mon1 |
2026-05-28 02:45:24.809577 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:45:24.810201 | mon1 | mon1                       : ok=84   changed=0    unreachable=0    failed=0    skipped=15   rescued=0    ignored=0
2026-05-28 02:45:24.810252 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-05-28 02:45:24.810261 | mon1 |
2026-05-28 02:45:24.810268 | mon1 |
2026-05-28 02:45:24.810274 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:45:24.810281 | mon1 | Thursday 28 May 2026  02:45:24 +0000 (0:00:05.960)       0:03:04.512 **********
2026-05-28 02:45:24.810292 | mon1 | ===============================================================================
2026-05-28 02:45:24.810298 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.13s
2026-05-28 02:45:24.810659 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.04s
2026-05-28 02:45:24.810711 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.38s
2026-05-28 02:45:24.810723 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.37s
2026-05-28 02:45:24.810740 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.32s
2026-05-28 02:45:24.810774 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.06s
2026-05-28 02:45:24.811001 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.05s
2026-05-28 02:45:24.811026 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.01s
2026-05-28 02:45:24.812049 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.00s
2026-05-28 02:45:24.812070 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 6.00s
2026-05-28 02:45:24.812075 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 5.99s
2026-05-28 02:45:24.812080 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.97s
2026-05-28 02:45:24.812083 | mon1 | vexxhost.ceph.ceph_exporter : Validate Ceph exporters exist ------------- 5.96s
2026-05-28 02:45:24.812088 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.95s
2026-05-28 02:45:24.812092 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.94s
2026-05-28 02:45:24.812095 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.44s
2026-05-28 02:45:24.812099 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 4.68s
2026-05-28 02:45:24.812103 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s
2026-05-28 02:45:24.812107 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s
2026-05-28 02:45:24.812111 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.03s
2026-05-28 02:45:24.892835 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-05-28 02:45:24.904117 | mon1 | INFO     [default > side_effect] Executing
2026-05-28 02:45:24.904462 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:45:24.909499 | mon1 | INFO     [default > verify] Executing
2026-05-28 02:45:25.494410 | mon1 |
2026-05-28 02:45:25.494757 | mon1 | PLAY [Verify] ******************************************************************
2026-05-28 02:45:25.495056 | mon1 |
2026-05-28 02:45:25.495379 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-28 02:45:25.495649 | mon1 | Thursday 28 May 2026  02:45:25 +0000 (0:00:00.006)       0:00:00.006 **********
2026-05-28 02:45:26.590974 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-28 02:45:26.591023 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-28 02:45:26.591043 | mon1 | interpreter could change the meaning of that path. See
2026-05-28 02:45:26.591048 | mon1 | https://docs.ansible.com/ansible-
2026-05-28 02:45:26.591052 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-28 02:45:26.599386 | mon1 | ok: [mon1]
2026-05-28 02:45:26.599410 | mon1 |
2026-05-28 02:45:26.599417 | mon1 | TASK [Get cluster health status] ***********************************************
2026-05-28 02:45:26.599423 | mon1 | Thursday 28 May 2026  02:45:26 +0000 (0:00:01.104)       0:00:01.111 **********
2026-05-28 02:45:36.695067 | mon1 | ok: [mon1]
2026-05-28 02:45:36.695132 | mon1 |
2026-05-28 02:45:36.695143 | mon1 | TASK [Print cluster health status] *********************************************
2026-05-28 02:45:36.695160 | mon1 | Thursday 28 May 2026  02:45:36 +0000 (0:00:10.095)       0:00:11.206 **********
2026-05-28 02:45:36.722593 | mon1 | ok: [mon1] => {
2026-05-28 02:45:36.722811 | mon1 |     "_ceph_health": {
2026-05-28 02:45:36.723071 | mon1 |         "changed": false,
2026-05-28 02:45:36.723259 | mon1 |         "cmd": [
2026-05-28 02:45:36.723455 | mon1 |             "cephadm",
2026-05-28 02:45:36.723636 | mon1 |             "shell",
2026-05-28 02:45:36.723830 | mon1 |             "--",
2026-05-28 02:45:36.724026 | mon1 |             "ceph",
2026-05-28 02:45:36.724218 | mon1 |             "health"
2026-05-28 02:45:36.724405 | mon1 |         ],
2026-05-28 02:45:36.724599 | mon1 |         "delta": "0:00:09.819915",
2026-05-28 02:45:36.724798 | mon1 |         "end": "2026-05-28 02:45:36.651698",
2026-05-28 02:45:36.724995 | mon1 |         "failed": false,
2026-05-28 02:45:36.725186 | mon1 |         "msg": "",
2026-05-28 02:45:36.725377 | mon1 |         "rc": 0,
2026-05-28 02:45:36.725575 | mon1 |         "start": "2026-05-28 02:45:26.831783",
2026-05-28 02:45:36.725844 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-05-28 02:45:36.726027 | mon1 |         "stderr_lines": [
2026-05-28 02:45:36.726229 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-05-28 02:45:36.726442 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-05-28 02:45:36.726633 | mon1 |         ],
2026-05-28 02:45:36.726831 | mon1 |         "stdout": "HEALTH_OK",
2026-05-28 02:45:36.727064 | mon1 |         "stdout_lines": [
2026-05-28 02:45:36.727265 | mon1 |             "HEALTH_OK"
2026-05-28 02:45:36.727442 | mon1 |         ]
2026-05-28 02:45:36.727629 | mon1 |     }
2026-05-28 02:45:36.727822 | mon1 | }
2026-05-28 02:45:36.728004 | mon1 |
2026-05-28 02:45:36.728207 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-05-28 02:45:36.728408 | mon1 | Thursday 28 May 2026  02:45:36 +0000 (0:00:00.028)       0:00:11.234 **********
2026-05-28 02:45:36.750000 | mon1 | ok: [mon1] => {
2026-05-28 02:45:36.750129 | mon1 |     "changed": false,
2026-05-28 02:45:36.750260 | mon1 |     "msg": "All assertions passed"
2026-05-28 02:45:36.750394 | mon1 | }
2026-05-28 02:45:36.750508 | mon1 |
2026-05-28 02:45:36.750637 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-05-28 02:45:36.750760 | mon1 | Thursday 28 May 2026  02:45:36 +0000 (0:00:00.027)       0:00:11.262 **********
2026-05-28 02:45:43.006970 | mon1 | changed: [mon1]
2026-05-28 02:45:43.007283 | mon1 |
2026-05-28 02:45:43.007554 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-05-28 02:45:43.007786 | mon1 | Thursday 28 May 2026  02:45:43 +0000 (0:00:06.256)       0:00:17.519 **********
2026-05-28 02:45:44.998248 | mon1 | changed: [mon1]
2026-05-28 02:45:44.998319 | mon1 |
2026-05-28 02:45:44.998643 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-05-28 02:45:44.998693 | mon1 | Thursday 28 May 2026  02:45:44 +0000 (0:00:01.991)       0:00:19.510 **********
2026-05-28 02:45:46.013570 | mon1 | ok: [mon1]
2026-05-28 02:45:46.013627 | mon1 |
2026-05-28 02:45:46.013639 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-05-28 02:45:46.013649 | mon1 | Thursday 28 May 2026  02:45:46 +0000 (0:00:01.014)       0:00:20.524 **********
2026-05-28 02:45:46.051871 | mon1 | ok: [mon1] => {
2026-05-28 02:45:46.051899 | mon1 |     "changed": false,
2026-05-28 02:45:46.051905 | mon1 |     "msg": "All assertions passed"
2026-05-28 02:45:46.051910 | mon1 | }
2026-05-28 02:45:46.051914 | mon1 |
2026-05-28 02:45:46.051918 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] *********
2026-05-28 02:45:46.051922 | mon1 | Thursday 28 May 2026  02:45:46 +0000 (0:00:00.038)       0:00:20.563 **********
2026-05-28 02:45:46.999217 | mon1 | ok: [mon1]
2026-05-28 02:45:46.999290 | mon1 |
2026-05-28 02:45:46.999441 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] ****
2026-05-28 02:45:46.999570 | mon1 | Thursday 28 May 2026  02:45:46 +0000 (0:00:00.947)       0:00:21.511 **********
2026-05-28 02:45:47.030107 | mon1 | ok: [mon1] => {
2026-05-28 02:45:47.030302 | mon1 |     "changed": false,
2026-05-28 02:45:47.030511 | mon1 |     "msg": "All assertions passed"
2026-05-28 02:45:47.030875 | mon1 | }
2026-05-28 02:45:47.031135 | mon1 |
2026-05-28 02:45:47.031345 | mon1 | PLAY RECAP *********************************************************************
2026-05-28 02:45:47.031571 | mon1 | mon1                       : ok=10   changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-28 02:45:47.031875 | mon1 |
2026-05-28 02:45:47.032078 | mon1 |
2026-05-28 02:45:47.032284 | mon1 | TASKS RECAP ********************************************************************
2026-05-28 02:45:47.032489 | mon1 | Thursday 28 May 2026  02:45:47 +0000 (0:00:00.031)       0:00:21.542 **********
2026-05-28 02:45:47.032687 | mon1 | ===============================================================================
2026-05-28 02:45:47.032979 | mon1 | Get cluster health status ---------------------------------------------- 10.10s
2026-05-28 02:45:47.033196 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.26s
2026-05-28 02:45:47.033422 | mon1 | Create a test Ceph key -------------------------------------------------- 1.99s
2026-05-28 02:45:47.033619 | mon1 | Gathering Facts --------------------------------------------------------- 1.10s
2026-05-28 02:45:47.033842 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.01s
2026-05-28 02:45:47.034051 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 0.95s
2026-05-28 02:45:47.034253 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-05-28 02:45:47.034456 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.03s
2026-05-28 02:45:47.034651 | mon1 | Print cluster health status --------------------------------------------- 0.03s
2026-05-28 02:45:47.034914 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-05-28 02:45:47.097099 | mon1 | INFO     [default > verify] Executed: Successful
2026-05-28 02:45:47.108141 | mon1 | INFO     [default > cleanup] Executing
2026-05-28 02:45:47.108381 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-28 02:45:47.113825 | mon1 | INFO     [default > destroy] Executing
2026-05-28 02:45:47.113853 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-28 02:45:47.113918 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-28 02:45:47.114183 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-05-28 02:45:57.317640 | mon1 | ok: Runtime: 0:13:08.427743
2026-05-28 02:45:57.336565 | 
2026-05-28 02:45:57.336647 | PLAY RECAP
2026-05-28 02:45:57.336704 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-28 02:45:57.336726 | 
2026-05-28 02:45:57.433318 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-28 02:45:57.438790 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-28 02:45:58.019370 | 
2026-05-28 02:45:58.019484 | PLAY [all]
2026-05-28 02:45:58.030178 | 
2026-05-28 02:45:58.030254 | TASK [fetch-output : Set log path for multiple nodes]
2026-05-28 02:45:58.092124 | mon1 | ok
2026-05-28 02:45:58.097718 | osd1 | ok
2026-05-28 02:45:58.102423 | 
2026-05-28 02:45:58.102495 | TASK [fetch-output : Set log path for single node]
2026-05-28 02:45:58.126777 | mon1 | skipping: Conditional result was False
2026-05-28 02:45:58.157968 | osd1 | skipping: Conditional result was False
2026-05-28 02:45:58.168038 | 
2026-05-28 02:45:58.168129 | LOOP [fetch-output : Ensure local output dirs]
2026-05-28 02:45:58.538003 | mon1 -> localhost | changed: "/var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/logs/mon1"
2026-05-28 02:45:58.553089 | osd1 -> localhost | changed: "/var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/logs/osd1"
2026-05-28 02:45:58.754245 | osd1 -> localhost | ok: "/var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/artifacts"
2026-05-28 02:45:58.755993 | mon1 -> localhost | changed: "/var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/artifacts"
2026-05-28 02:45:58.959239 | osd1 -> localhost | changed: "/var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/docs"
2026-05-28 02:45:58.974824 | mon1 -> localhost | ok: "/var/lib/zuul/builds/487845e3033a45d69500c148e739155e/work/docs"
2026-05-28 02:45:58.974944 | mon1 -> localhost | changed: All items complete
2026-05-28 02:45:58.975001 | 
2026-05-28 02:45:58.992508 | 
2026-05-28 02:45:58.992697 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-05-28 02:45:59.886697 | osd1 | changed: .d..t...... ./
2026-05-28 02:45:59.891357 | mon1 | changed: .d..t...... ./
2026-05-28 02:46:00.331067 | osd1 | changed: .d..t...... ./
2026-05-28 02:46:00.346203 | mon1 | changed: .d..t...... ./
2026-05-28 02:46:00.790666 | osd1 | changed: .d..t...... ./
2026-05-28 02:46:00.797778 | mon1 | changed: .d..t...... ./
2026-05-28 02:46:00.821323 | 
2026-05-28 02:46:00.821485 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-05-28 02:46:01.216505 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.006346
2026-05-28 02:46:01.216809 | mon1 -> localhost | changed: All items complete
2026-05-28 02:46:01.216878 | 
2026-05-28 02:46:01.426546 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006963
2026-05-28 02:46:01.446717 | 
2026-05-28 02:46:01.446825 | PLAY [all]
2026-05-28 02:46:01.453559 | 
2026-05-28 02:46:01.453626 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-05-28 02:46:01.837922 | mon1 | changed
2026-05-28 02:46:02.020217 | osd1 | changed
2026-05-28 02:46:02.030253 | 
2026-05-28 02:46:02.030305 | PLAY RECAP
2026-05-28 02:46:02.030349 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-28 02:46:02.030378 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-28 02:46:02.030397 | 
2026-05-28 02:46:02.144051 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-28 02:46:02.149984 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-05-28 02:46:02.704940 | 
2026-05-28 02:46:02.705434 | PLAY [localhost]
2026-05-28 02:46:02.714763 | 
2026-05-28 02:46:02.714833 | TASK [Generate Zuul manifest]
2026-05-28 02:46:02.731783 | localhost | ok
2026-05-28 02:46:02.745705 | 
2026-05-28 02:46:02.745780 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-05-28 02:46:03.108421 | localhost | changed
2026-05-28 02:46:03.119779 | 
2026-05-28 02:46:03.119850 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-05-28 02:46:03.169673 | localhost | ok
2026-05-28 02:46:03.178223 | 
2026-05-28 02:46:03.178311 | TASK [Upload logs]
2026-05-28 02:46:03.195925 | localhost | ok
2026-05-28 02:46:03.264936 | 
2026-05-28 02:46:03.265080 | TASK [Set zuul-log-path fact]
2026-05-28 02:46:03.285459 | localhost | ok
2026-05-28 02:46:03.301045 | 
2026-05-28 02:46:03.301109 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-28 02:46:03.330452 | localhost | ok
2026-05-28 02:46:03.339356 | 
2026-05-28 02:46:03.339442 | TASK [upload-logs : Create log directories]
2026-05-28 02:46:03.752298 | localhost | changed
2026-05-28 02:46:03.761336 | 
2026-05-28 02:46:03.761415 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-05-28 02:46:04.198823 | localhost -> localhost | ok: Runtime: 0:00:00.004821
2026-05-28 02:46:04.204513 | 
2026-05-28 02:46:04.204597 | TASK [upload-logs : Upload logs to log server]
2026-05-28 02:46:04.661513 | localhost | Output suppressed because no_log was given
2026-05-28 02:46:04.666467 | 
2026-05-28 02:46:04.666557 | LOOP [upload-logs : Compress console log and json output]
2026-05-28 02:46:04.739340 | localhost | skipping: Conditional result was False
2026-05-28 02:46:04.746970 | localhost | skipping: Conditional result was False
2026-05-28 02:46:04.757641 | 
2026-05-28 02:46:04.757760 | LOOP [upload-logs : Upload compressed console log and json output]
2026-05-28 02:46:04.836436 | localhost | skipping: Conditional result was False
2026-05-28 02:46:04.836726 | 
2026-05-28 02:46:04.841574 | localhost | skipping: Conditional result was False
2026-05-28 02:46:04.876584 | 
2026-05-28 02:46:04.876705 | LOOP [upload-logs : Upload console log and json output]