2026-05-08 04:10:23.855588 | Job console starting
2026-05-08 04:10:23.882077 | Updating git repos
2026-05-08 04:10:23.906465 | Cloning repos into workspace
2026-05-08 04:10:24.016535 | Restoring repo states
2026-05-08 04:10:24.025512 | Merging changes
2026-05-08 04:10:24.370076 | Checking out repos
2026-05-08 04:10:24.424667 | Preparing playbooks
2026-05-08 04:10:26.019302 | Running Ansible setup
2026-05-08 04:10:30.125626 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-08 04:10:30.729825 | 
2026-05-08 04:10:30.730013 | PLAY [localhost]
2026-05-08 04:10:30.738714 | 
2026-05-08 04:10:30.738814 | TASK [Gathering Facts]
2026-05-08 04:10:31.622553 | localhost | ok
2026-05-08 04:10:31.634621 | 
2026-05-08 04:10:31.634734 | TASK [Setup log path fact]
2026-05-08 04:10:31.653603 | localhost | ok
2026-05-08 04:10:31.666064 | 
2026-05-08 04:10:31.666318 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-08 04:10:31.697932 | localhost | ok
2026-05-08 04:10:31.706782 | 
2026-05-08 04:10:31.706923 | TASK [emit-job-header : Print job information]
2026-05-08 04:10:31.748418 | # Job Information
2026-05-08 04:10:31.748654 | Ansible Version: 2.16.18
2026-05-08 04:10:31.748725 | Job: ansible-collection-ceph-molecule-ha-ubuntu-jammy
2026-05-08 04:10:31.748774 | Pipeline: check
2026-05-08 04:10:31.748818 | Executor: 2d72f0692154
2026-05-08 04:10:31.748861 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/108
2026-05-08 04:10:31.748911 | Event ID: cfeb2c60-4a93-11f1-8c80-efa4176c08e9
2026-05-08 04:10:31.752210 | 
2026-05-08 04:10:31.752273 | LOOP [emit-job-header : Print node information]
2026-05-08 04:10:31.841929 | localhost | ok:
2026-05-08 04:10:31.842272 | localhost | # Node Information
2026-05-08 04:10:31.842335 | localhost | Inventory Hostname: mon1
2026-05-08 04:10:31.842383 | localhost | Hostname: np0000172675
2026-05-08 04:10:31.842427 | localhost | Username: zuul
2026-05-08 04:10:31.842475 | localhost | Distro: Ubuntu 22.04
2026-05-08 04:10:31.842518 | localhost | Provider: yul1
2026-05-08 04:10:31.842559 | localhost | Region: ca-ymq-1
2026-05-08 04:10:31.842600 | localhost | Label: ubuntu-jammy
2026-05-08 04:10:31.842639 | localhost | Product Name: OpenStack Nova
2026-05-08 04:10:31.842679 | localhost | Interface IP: 199.204.45.89
2026-05-08 04:10:31.886288 | localhost | ok:
2026-05-08 04:10:31.886436 | localhost | # Node Information
2026-05-08 04:10:31.886493 | localhost | Inventory Hostname: osd1
2026-05-08 04:10:31.886539 | localhost | Hostname: np0000172676
2026-05-08 04:10:31.886583 | localhost | Username: zuul
2026-05-08 04:10:31.886626 | localhost | Distro: Ubuntu 22.04
2026-05-08 04:10:31.886668 | localhost | Provider: yul1
2026-05-08 04:10:31.886709 | localhost | Region: ca-ymq-1
2026-05-08 04:10:31.886749 | localhost | Label: ubuntu-jammy
2026-05-08 04:10:31.886790 | localhost | Product Name: OpenStack Nova
2026-05-08 04:10:31.886833 | localhost | Interface IP: 199.204.45.223
2026-05-08 04:10:31.895100 | 
2026-05-08 04:10:31.895237 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-05-08 04:10:32.275234 | localhost -> localhost | changed
2026-05-08 04:10:32.283930 | 
2026-05-08 04:10:32.284187 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-05-08 04:10:33.127273 | localhost -> localhost | changed
2026-05-08 04:10:33.138180 | 
2026-05-08 04:10:33.138260 | PLAY [all]
2026-05-08 04:10:33.148306 | 
2026-05-08 04:10:33.148373 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-05-08 04:10:33.385696 | mon1 -> localhost | ok
2026-05-08 04:10:33.396274 | 
2026-05-08 04:10:33.396364 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-05-08 04:10:33.430771 | mon1 | ok
2026-05-08 04:10:33.434861 | osd1 | ok
2026-05-08 04:10:33.454523 | mon1 | included: /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-08 04:10:33.454592 | osd1 | included: /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-05-08 04:10:33.460413 | 
2026-05-08 04:10:33.460476 | TASK [add-build-sshkey : Create Temp SSH key]
2026-05-08 04:10:34.699886 | mon1 -> localhost | Generating public/private rsa key pair.
2026-05-08 04:10:34.700081 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/4e0c3bb33a334364b11c528ed301a742_id_rsa
2026-05-08 04:10:34.700114 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/4e0c3bb33a334364b11c528ed301a742_id_rsa.pub
2026-05-08 04:10:34.700138 | mon1 -> localhost | The key fingerprint is:
2026-05-08 04:10:34.700161 | mon1 -> localhost | SHA256:N/dSlhJoYohTYOT/4A6WgagmmLC54ETjEjgqGGzf0ic zuul-build-sshkey
2026-05-08 04:10:34.700182 | mon1 -> localhost | The key's randomart image is:
2026-05-08 04:10:34.700202 | mon1 -> localhost | +---[RSA 3072]----+
2026-05-08 04:10:34.700222 | mon1 -> localhost | |   .+..          |
2026-05-08 04:10:34.700243 | mon1 -> localhost | |   o o .   .     |
2026-05-08 04:10:34.700263 | mon1 -> localhost | |    + . o o .    |
2026-05-08 04:10:34.700284 | mon1 -> localhost | |o. . o . o   . . |
2026-05-08 04:10:34.700304 | mon1 -> localhost | |B=. . o S o o +  |
2026-05-08 04:10:34.700323 | mon1 -> localhost | |XBo o+ o . o =   |
2026-05-08 04:10:34.700343 | mon1 -> localhost | |&+ o+E...   . .  |
2026-05-08 04:10:34.700362 | mon1 -> localhost | |O. ..oo      .   |
2026-05-08 04:10:34.700382 | mon1 -> localhost | |..    .          |
2026-05-08 04:10:34.700401 | mon1 -> localhost | +----[SHA256]-----+
2026-05-08 04:10:34.700453 | mon1 -> localhost | ok: Runtime: 0:00:00.798891
2026-05-08 04:10:34.705542 | 
2026-05-08 04:10:34.705608 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-05-08 04:10:34.738613 | mon1 | ok
2026-05-08 04:10:34.744704 | osd1 | ok
2026-05-08 04:10:34.756849 | mon1 | included: /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-08 04:10:34.756901 | osd1 | included: /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-05-08 04:10:34.767137 | 
2026-05-08 04:10:34.767201 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-05-08 04:10:34.793510 | mon1 | skipping: Conditional result was False
2026-05-08 04:10:34.804534 | osd1 | skipping: Conditional result was False
2026-05-08 04:10:34.813965 | 
2026-05-08 04:10:34.814059 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-05-08 04:10:35.274444 | mon1 | changed
2026-05-08 04:10:35.279422 | osd1 | changed
2026-05-08 04:10:35.284290 | 
2026-05-08 04:10:35.284354 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-05-08 04:10:35.469865 | mon1 | ok
2026-05-08 04:10:35.494393 | osd1 | ok
2026-05-08 04:10:35.505889 | 
2026-05-08 04:10:35.505963 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-05-08 04:10:35.954233 | mon1 | changed
2026-05-08 04:10:35.985298 | osd1 | changed
2026-05-08 04:10:35.992801 | 
2026-05-08 04:10:35.992899 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-05-08 04:10:36.487821 | mon1 | changed
2026-05-08 04:10:36.492137 | osd1 | changed
2026-05-08 04:10:36.496841 | 
2026-05-08 04:10:36.496908 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-05-08 04:10:36.522436 | mon1 | skipping: Conditional result was False
2026-05-08 04:10:36.533728 | osd1 | skipping: Conditional result was False
2026-05-08 04:10:36.543574 | 
2026-05-08 04:10:36.543764 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-05-08 04:10:36.915940 | mon1 -> localhost | changed
2026-05-08 04:10:36.936748 | 
2026-05-08 04:10:36.936822 | TASK [add-build-sshkey : Add back temp key]
2026-05-08 04:10:37.225030 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/4e0c3bb33a334364b11c528ed301a742_id_rsa (zuul-build-sshkey)
2026-05-08 04:10:37.225302 | mon1 -> localhost | ok: Runtime: 0:00:00.014794
2026-05-08 04:10:37.231473 | 
2026-05-08 04:10:37.231542 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-05-08 04:10:37.494856 | mon1 | ok
2026-05-08 04:10:37.502009 | osd1 | ok
2026-05-08 04:10:37.506463 | 
2026-05-08 04:10:37.506532 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-05-08 04:10:37.538197 | mon1 | skipping: Conditional result was False
2026-05-08 04:10:37.549263 | osd1 | skipping: Conditional result was False
2026-05-08 04:10:37.568568 | 
2026-05-08 04:10:37.568645 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-05-08 04:10:37.858090 | mon1 | ok
2026-05-08 04:10:37.863755 | osd1 | ok
2026-05-08 04:10:37.869570 | 
2026-05-08 04:10:37.869635 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-05-08 04:10:38.547649 | mon1 | Output suppressed because no_log was given
2026-05-08 04:10:38.553798 | osd1 | Output suppressed because no_log was given
2026-05-08 04:10:38.566637 | 
2026-05-08 04:10:38.566712 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-05-08 04:10:38.767696 | osd1 | ok: "logs"
2026-05-08 04:10:38.768130 | osd1 | ok: All items complete
2026-05-08 04:10:38.768182 | 
2026-05-08 04:10:38.773403 | mon1 | ok: "logs"
2026-05-08 04:10:38.931755 | osd1 | ok: "artifacts"
2026-05-08 04:10:38.962753 | mon1 | ok: "artifacts"
2026-05-08 04:10:39.085851 | osd1 | ok: "docs"
2026-05-08 04:10:39.117564 | mon1 | ok: "docs"
2026-05-08 04:10:39.131768 | 
2026-05-08 04:10:39.131923 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-05-08 04:10:39.317839 | mon1 | changed: "logs"
2026-05-08 04:10:39.318318 | mon1 | ok: All items complete
2026-05-08 04:10:39.318350 | 
2026-05-08 04:10:39.334751 | osd1 | changed: "logs"
2026-05-08 04:10:39.495555 | mon1 | changed: "artifacts"
2026-05-08 04:10:39.500946 | osd1 | changed: "artifacts"
2026-05-08 04:10:39.657035 | osd1 | changed: "docs"
2026-05-08 04:10:39.866987 | mon1 | changed: "docs"
2026-05-08 04:10:39.898212 | 
2026-05-08 04:10:39.898329 | PLAY RECAP
2026-05-08 04:10:39.898380 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:10:39.898411 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-08 04:10:39.898439 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-05-08 04:10:39.898458 | 
2026-05-08 04:10:40.050202 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-05-08 04:10:40.055071 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-08 04:10:40.668255 | 
2026-05-08 04:10:40.668415 | PLAY [all]
2026-05-08 04:10:40.680717 | 
2026-05-08 04:10:40.680797 | TASK [setup-uv : Extract archive]
2026-05-08 04:10:43.007034 | osd1 | changed
2026-05-08 04:10:43.022116 | mon1 | changed
2026-05-08 04:10:43.028869 | 
2026-05-08 04:10:43.029051 | TASK [setup-uv : Print version]
2026-05-08 04:10:43.341495 | osd1 | uv 0.8.13
2026-05-08 04:10:43.401967 | mon1 | uv 0.8.13
2026-05-08 04:10:43.590128 | mon1 | ok: Runtime: 0:00:00.013365
2026-05-08 04:10:43.599604 | osd1 | ok: Runtime: 0:00:00.016299
2026-05-08 04:10:43.610774 | 
2026-05-08 04:10:43.610917 | PLAY RECAP
2026-05-08 04:10:43.610969 | mon1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:10:43.611000 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:10:43.611020 | 
2026-05-08 04:10:43.735861 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-05-08 04:10:43.741101 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-08 04:10:44.381171 | 
2026-05-08 04:10:44.381315 | PLAY [all]
2026-05-08 04:10:44.392534 | 
2026-05-08 04:10:44.392607 | TASK [Copy inventory file for Zuul]
2026-05-08 04:10:45.230347 | mon1 | changed
2026-05-08 04:10:45.412062 | 
2026-05-08 04:10:45.412444 | TASK [Switch "ansible_host" to private IP]
2026-05-08 04:10:45.722389 | mon1 | changed: 2 replacements made
2026-05-08 04:10:45.729405 | 
2026-05-08 04:10:45.729492 | TASK [Run Molecule scenario]
2026-05-08 04:10:46.310861 | mon1 | Downloading cpython-3.13.7-linux-x86_64-gnu (download) (30.9MiB)
2026-05-08 04:10:47.072891 | mon1 |  Downloading cpython-3.13.7-linux-x86_64-gnu (download)
2026-05-08 04:10:47.250765 | mon1 | Using CPython 3.13.7
2026-05-08 04:10:47.250844 | mon1 | Creating virtual environment at: .venv
2026-05-08 04:10:47.634987 | mon1 | Downloading pygments (1.2MiB)
2026-05-08 04:10:47.635489 | mon1 | Downloading cryptography (4.3MiB)
2026-05-08 04:10:47.642390 | mon1 | Downloading netaddr (2.2MiB)
2026-05-08 04:10:47.670961 | mon1 | Downloading ansible-core (2.1MiB)
2026-05-08 04:10:47.815114 | mon1 |  Downloading netaddr
2026-05-08 04:10:47.824407 | mon1 |  Downloading cryptography
2026-05-08 04:10:47.871733 | mon1 |  Downloading pygments
2026-05-08 04:10:48.000650 | mon1 |  Downloading ansible-core
2026-05-08 04:10:48.029261 | mon1 | Installed 36 packages in 27ms
2026-05-08 04:10:49.109661 | mon1 | INFO     Collection 'vexxhost.ceph' detected.
2026-05-08 04:10:49.109789 | mon1 | INFO     Scenarios will be used from 'extensions/molecule'
2026-05-08 04:10:49.719451 | mon1 | INFO     [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy
2026-05-08 04:10:49.719606 | mon1 | INFO     [default > prerun] Performing prerun with role_name_check=0...
2026-05-08 04:11:08.638059 | mon1 | INFO     [default > dependency] Executing
2026-05-08 04:11:08.641443 | mon1 | WARNING  [default > dependency] Missing roles requirements file: requirements.yml
2026-05-08 04:11:08.641925 | mon1 | WARNING  [default > dependency] Missing collections requirements file: collections.yml
2026-05-08 04:11:08.642220 | mon1 | WARNING  [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress)
2026-05-08 04:11:08.652324 | mon1 | INFO     [default > cleanup] Executing
2026-05-08 04:11:08.652822 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:11:08.659665 | mon1 | INFO     [default > destroy] Executing
2026-05-08 04:11:08.659777 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-08 04:11:08.659865 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-08 04:11:08.665009 | mon1 | INFO     [default > syntax] Executing
2026-05-08 04:11:09.612677 | mon1 |
2026-05-08 04:11:09.613164 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml
2026-05-08 04:11:09.674659 | mon1 | INFO     [default > syntax] Executed: Successful
2026-05-08 04:11:09.686553 | mon1 | INFO     [default > create] Executing
2026-05-08 04:11:09.687887 | mon1 | WARNING  [default > create] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:11:09.692920 | mon1 | INFO     [default > prepare] Executing
2026-05-08 04:11:10.355890 | mon1 |
2026-05-08 04:11:10.356261 | mon1 | PLAY [Prepare] *****************************************************************
2026-05-08 04:11:10.356537 | mon1 |
2026-05-08 04:11:10.356823 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:11:10.357145 | mon1 | Friday 08 May 2026  04:11:10 +0000 (0:00:00.029)       0:00:00.029 ************
2026-05-08 04:11:11.550943 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-08 04:11:11.551165 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:11:11.551462 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:11:11.551715 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:11:11.551943 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:11:11.573624 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:11:11.573837 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:11:11.574061 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:11:11.574313 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:11:11.574530 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:11:11.583459 | mon1 | ok: [osd1]
2026-05-08 04:11:11.583663 | mon1 | ok: [mon1]
2026-05-08 04:11:11.583851 | mon1 |
2026-05-08 04:11:11.584056 | mon1 | TASK [Configure short hostname] ************************************************
2026-05-08 04:11:11.584294 | mon1 | Friday 08 May 2026  04:11:11 +0000 (0:00:01.228)       0:00:01.258 ************
2026-05-08 04:11:12.322866 | mon1 | changed: [mon1]
2026-05-08 04:11:12.323036 | mon1 | changed: [osd1]
2026-05-08 04:11:12.323224 | mon1 |
2026-05-08 04:11:12.323489 | mon1 | TASK [Ensure hostname inside hosts file] ***************************************
2026-05-08 04:11:12.323707 | mon1 | Friday 08 May 2026  04:11:12 +0000 (0:00:00.738)       0:00:01.996 ************
2026-05-08 04:11:12.603804 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created
2026-05-08 04:11:12.603868 | mon1 | with a mode of 0700, this may cause issues when running as another user. To
2026-05-08 04:11:12.603880 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually
2026-05-08 04:11:12.617166 | mon1 | changed: [mon1]
2026-05-08 04:11:12.617221 | mon1 | changed: [osd1]
2026-05-08 04:11:12.617229 | mon1 |
2026-05-08 04:11:12.617235 | mon1 | TASK [Update apt cache] ********************************************************
2026-05-08 04:11:12.617275 | mon1 | Friday 08 May 2026  04:11:12 +0000 (0:00:00.294)       0:00:02.291 ************
2026-05-08 04:11:27.520412 | mon1 | changed: [osd1]
2026-05-08 04:11:27.520562 | mon1 | changed: [mon1]
2026-05-08 04:11:27.520748 | mon1 |
2026-05-08 04:11:27.520961 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-05-08 04:11:27.521175 | mon1 |
2026-05-08 04:11:27.521388 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:11:27.521590 | mon1 | Friday 08 May 2026  04:11:27 +0000 (0:00:14.903)       0:00:17.194 ************
2026-05-08 04:11:28.250201 | mon1 | ok: [osd1]
2026-05-08 04:11:28.250302 | mon1 |
2026-05-08 04:11:28.250575 | mon1 | TASK [Install depedencies] *****************************************************
2026-05-08 04:11:28.250774 | mon1 | Friday 08 May 2026  04:11:28 +0000 (0:00:00.729)       0:00:17.924 ************
2026-05-08 04:11:48.470907 | mon1 | changed: [osd1]
2026-05-08 04:11:48.471096 | mon1 |
2026-05-08 04:11:48.471415 | mon1 | TASK [Start up service] ********************************************************
2026-05-08 04:11:48.471707 | mon1 | Friday 08 May 2026  04:11:48 +0000 (0:00:20.220)       0:00:38.145 ************
2026-05-08 04:11:49.044916 | mon1 | ok: [osd1]
2026-05-08 04:11:49.045073 | mon1 |
2026-05-08 04:11:49.045416 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-05-08 04:11:49.045692 | mon1 | Friday 08 May 2026  04:11:49 +0000 (0:00:00.573)       0:00:38.718 ************
2026-05-08 04:11:49.353839 | mon1 | ok: [osd1]
2026-05-08 04:11:49.353939 | mon1 |
2026-05-08 04:11:49.354139 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-05-08 04:11:49.354419 | mon1 | Friday 08 May 2026  04:11:49 +0000 (0:00:00.309)       0:00:39.028 ************
2026-05-08 04:11:50.017495 | mon1 | changed: [osd1]
2026-05-08 04:11:50.017569 | mon1 |
2026-05-08 04:11:50.017694 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-05-08 04:11:50.017820 | mon1 | Friday 08 May 2026  04:11:50 +0000 (0:00:00.663)       0:00:39.691 ************
2026-05-08 04:11:50.214148 | mon1 | ok: [osd1]
2026-05-08 04:11:50.214286 | mon1 |
2026-05-08 04:11:50.214496 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-05-08 04:11:50.214697 | mon1 | Friday 08 May 2026  04:11:50 +0000 (0:00:00.196)       0:00:39.888 ************
2026-05-08 04:11:50.239684 | mon1 | skipping: [osd1]
2026-05-08 04:11:50.239836 | mon1 |
2026-05-08 04:11:50.240042 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-05-08 04:11:50.240245 | mon1 | Friday 08 May 2026  04:11:50 +0000 (0:00:00.026)       0:00:39.914 ************
2026-05-08 04:11:50.790877 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:11:50.791042 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:11:50.791252 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:11:50.791501 | mon1 |
2026-05-08 04:11:50.791670 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-05-08 04:11:50.791867 | mon1 | Friday 08 May 2026  04:11:50 +0000 (0:00:00.551)       0:00:40.465 ************
2026-05-08 04:11:51.424777 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:11:51.425016 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:11:51.425272 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:11:51.425564 | mon1 |
2026-05-08 04:11:51.425797 | mon1 | TASK [Start loop devices] ******************************************************
2026-05-08 04:11:51.426021 | mon1 | Friday 08 May 2026  04:11:51 +0000 (0:00:00.633)       0:00:41.099 ************
2026-05-08 04:11:52.166733 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:11:52.166896 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:11:52.167094 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:11:52.167282 | mon1 |
2026-05-08 04:11:52.167565 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-05-08 04:11:52.167844 | mon1 | Friday 08 May 2026  04:11:52 +0000 (0:00:00.741)       0:00:41.840 ************
2026-05-08 04:11:55.032708 | mon1 | changed: [osd1] => (item=osd0)
2026-05-08 04:11:55.032900 | mon1 | changed: [osd1] => (item=osd1)
2026-05-08 04:11:55.033158 | mon1 | changed: [osd1] => (item=osd2)
2026-05-08 04:11:55.033349 | mon1 |
2026-05-08 04:11:55.033562 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-05-08 04:11:55.033793 | mon1 | Friday 08 May 2026  04:11:55 +0000 (0:00:02.866)       0:00:44.707 ************
2026-05-08 04:11:56.866994 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0)
2026-05-08 04:11:56.867171 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1)
2026-05-08 04:11:56.867471 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2)
2026-05-08 04:11:56.867669 | mon1 |
2026-05-08 04:11:56.868069 | mon1 | PLAY [Enable loopback precheck skip for coverage] ******************************
2026-05-08 04:11:56.868107 | mon1 |
2026-05-08 04:11:56.868283 | mon1 | TASK [Set loopback precheck skip variable] *************************************
2026-05-08 04:11:56.868475 | mon1 | Friday 08 May 2026  04:11:56 +0000 (0:00:01.834)       0:00:46.541 ************
2026-05-08 04:11:56.901898 | mon1 | ok: [osd1]
2026-05-08 04:11:56.902103 | mon1 |
2026-05-08 04:11:56.902352 | mon1 | PLAY [Create devices for Ceph] *************************************************
2026-05-08 04:11:56.902610 | mon1 |
2026-05-08 04:11:56.902829 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:11:56.903031 | mon1 | Friday 08 May 2026  04:11:56 +0000 (0:00:00.034)       0:00:46.576 ************
2026-05-08 04:11:57.812289 | mon1 | ok: [osd1]
2026-05-08 04:11:57.812385 | mon1 |
2026-05-08 04:11:57.812617 | mon1 | TASK [Install depedencies] *****************************************************
2026-05-08 04:11:57.812821 | mon1 | Friday 08 May 2026  04:11:57 +0000 (0:00:00.909)       0:00:47.486 ************
2026-05-08 04:11:59.069361 | mon1 | ok: [osd1]
2026-05-08 04:11:59.069451 | mon1 |
2026-05-08 04:11:59.069499 | mon1 | TASK [Start up service] ********************************************************
2026-05-08 04:11:59.069636 | mon1 | Friday 08 May 2026  04:11:59 +0000 (0:00:01.257)       0:00:48.743 ************
2026-05-08 04:11:59.408880 | mon1 | ok: [osd1]
2026-05-08 04:11:59.408978 | mon1 |
2026-05-08 04:11:59.409195 | mon1 | TASK [Generate lvm.conf] *******************************************************
2026-05-08 04:11:59.409396 | mon1 | Friday 08 May 2026  04:11:59 +0000 (0:00:00.339)       0:00:49.083 ************
2026-05-08 04:11:59.637371 | mon1 | ok: [osd1]
2026-05-08 04:11:59.637556 | mon1 |
2026-05-08 04:11:59.637766 | mon1 | TASK [Write /etc/lvm/lvm.conf] *************************************************
2026-05-08 04:11:59.638016 | mon1 | Friday 08 May 2026  04:11:59 +0000 (0:00:00.228)       0:00:49.311 ************
2026-05-08 04:12:00.064221 | mon1 | ok: [osd1]
2026-05-08 04:12:00.064334 | mon1 |
2026-05-08 04:12:00.064701 | mon1 | TASK [Get list of all loopback devices] ****************************************
2026-05-08 04:12:00.064718 | mon1 | Friday 08 May 2026  04:12:00 +0000 (0:00:00.426)       0:00:49.738 ************
2026-05-08 04:12:00.087300 | mon1 | skipping: [osd1]
2026-05-08 04:12:00.087724 | mon1 |
2026-05-08 04:12:00.088072 | mon1 | TASK [Fail if there is any existing loopback devices] **************************
2026-05-08 04:12:00.088401 | mon1 | Friday 08 May 2026  04:12:00 +0000 (0:00:00.023)       0:00:49.761 ************
2026-05-08 04:12:00.109967 | mon1 | skipping: [osd1]
2026-05-08 04:12:00.110353 | mon1 |
2026-05-08 04:12:00.110732 | mon1 | TASK [Create devices for Ceph] *************************************************
2026-05-08 04:12:00.111095 | mon1 | Friday 08 May 2026  04:12:00 +0000 (0:00:00.022)       0:00:49.784 ************
2026-05-08 04:12:00.629914 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:00.630352 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:00.630749 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:00.631061 | mon1 |
2026-05-08 04:12:00.631371 | mon1 | TASK [Set permissions on loopback devices] *************************************
2026-05-08 04:12:00.631668 | mon1 | Friday 08 May 2026  04:12:00 +0000 (0:00:00.519)       0:00:50.303 ************
2026-05-08 04:12:01.197202 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:01.197569 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:01.197784 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:01.197992 | mon1 |
2026-05-08 04:12:01.198192 | mon1 | TASK [Start loop devices] ******************************************************
2026-05-08 04:12:01.198353 | mon1 | Friday 08 May 2026  04:12:01 +0000 (0:00:00.565)       0:00:50.869 ************
2026-05-08 04:12:01.739290 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:01.739346 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:01.739351 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:01.739356 | mon1 |
2026-05-08 04:12:01.739361 | mon1 | TASK [Create a volume group for each loop device] ******************************
2026-05-08 04:12:01.739366 | mon1 | Friday 08 May 2026  04:12:01 +0000 (0:00:00.543)       0:00:51.413 ************
2026-05-08 04:12:02.664654 | mon1 | ok: [osd1] => (item=osd0)
2026-05-08 04:12:02.664715 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:12:02.664722 | mon1 | ok: [osd1] => (item=osd2)
2026-05-08 04:12:02.664729 | mon1 |
2026-05-08 04:12:02.664735 | mon1 | TASK [Create a logical volume for each loop device] ****************************
2026-05-08 04:12:02.664741 | mon1 | Friday 08 May 2026  04:12:02 +0000 (0:00:00.925)       0:00:52.338 ************
2026-05-08 04:12:03.761149 | mon1 | ok: [osd1] => (item=ceph-osd1-osd0)
2026-05-08 04:12:03.761734 | mon1 | ok: [osd1] => (item=ceph-osd1-osd1)
2026-05-08 04:12:03.761743 | mon1 | ok: [osd1] => (item=ceph-osd1-osd2)
2026-05-08 04:12:03.761749 | mon1 |
2026-05-08 04:12:03.761756 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:12:03.761763 | mon1 | mon1                       : ok=4    changed=3    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-08 04:12:03.761783 | mon1 | osd1                       : ok=26   changed=10   unreachable=0    failed=0    skipped=3    rescued=0    ignored=0
2026-05-08 04:12:03.761790 | mon1 |
2026-05-08 04:12:03.761795 | mon1 |
2026-05-08 04:12:03.761801 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:12:03.765112 | mon1 | Friday 08 May 2026  04:12:03 +0000 (0:00:01.095)       0:00:53.434 ************
2026-05-08 04:12:03.765134 | mon1 | ===============================================================================
2026-05-08 04:12:03.765140 | mon1 | Install depedencies ---------------------------------------------------- 20.22s
2026-05-08 04:12:03.765146 | mon1 | Update apt cache ------------------------------------------------------- 14.90s
2026-05-08 04:12:03.765151 | mon1 | Create a volume group for each loop device ------------------------------ 2.87s
2026-05-08 04:12:03.765157 | mon1 | Create a logical volume for each loop device ---------------------------- 1.83s
2026-05-08 04:12:03.765162 | mon1 | Install depedencies ----------------------------------------------------- 1.26s
2026-05-08 04:12:03.765168 | mon1 | Gathering Facts --------------------------------------------------------- 1.23s
2026-05-08 04:12:03.765173 | mon1 | Create a logical volume for each loop device ---------------------------- 1.10s
2026-05-08 04:12:03.765179 | mon1 | Create a volume group for each loop device ------------------------------ 0.93s
2026-05-08 04:12:03.765184 | mon1 | Gathering Facts --------------------------------------------------------- 0.91s
2026-05-08 04:12:03.765190 | mon1 | Start loop devices ------------------------------------------------------ 0.74s
2026-05-08 04:12:03.765207 | mon1 | Configure short hostname ------------------------------------------------ 0.74s
2026-05-08 04:12:03.765237 | mon1 | Gathering Facts --------------------------------------------------------- 0.73s
2026-05-08 04:12:03.765474 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.66s
2026-05-08 04:12:03.765710 | mon1 | Set permissions on loopback devices ------------------------------------- 0.63s
2026-05-08 04:12:03.765935 | mon1 | Start up service -------------------------------------------------------- 0.57s
2026-05-08 04:12:03.766274 | mon1 | Set permissions on loopback devices ------------------------------------- 0.57s
2026-05-08 04:12:03.766663 | mon1 | Create devices for Ceph ------------------------------------------------- 0.55s
2026-05-08 04:12:03.766903 | mon1 | Start loop devices ------------------------------------------------------ 0.54s
2026-05-08 04:12:03.767079 | mon1 | Create devices for Ceph ------------------------------------------------- 0.52s
2026-05-08 04:12:03.767280 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.43s
2026-05-08 04:12:03.855012 | mon1 | INFO     [default > prepare] Executed: Successful
2026-05-08 04:12:03.860413 | mon1 | INFO     [default > converge] Executing
2026-05-08 04:12:04.698891 | mon1 |
2026-05-08 04:12:04.699171 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-08 04:12:04.699406 | mon1 |
2026-05-08 04:12:04.699623 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:12:04.699837 | mon1 | Friday 08 May 2026  04:12:04 +0000 (0:00:00.051)       0:00:00.051 ************
2026-05-08 04:12:05.707631 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:12:05.707741 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:12:05.707885 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:12:05.708026 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:12:05.708213 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:12:05.720652 | mon1 | ok: [mon1]
2026-05-08 04:12:05.720829 | mon1 |
2026-05-08 04:12:05.721033 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:12:05.721266 | mon1 | Friday 08 May 2026  04:12:05 +0000 (0:00:01.022)       0:00:01.074 ************
2026-05-08 04:12:06.034578 | mon1 | ok: [mon1]
2026-05-08 04:12:06.034714 | mon1 |
2026-05-08 04:12:06.034954 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:12:06.035334 | mon1 | Friday 08 May 2026  04:12:06 +0000 (0:00:00.313)       0:00:01.387 ************
2026-05-08 04:12:06.073224 | mon1 | skipping: [mon1]
2026-05-08 04:12:06.073413 | mon1 |
2026-05-08 04:12:06.073625 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:12:06.073823 | mon1 | Friday 08 May 2026  04:12:06 +0000 (0:00:00.038)       0:00:01.426 ************
2026-05-08 04:12:06.386981 | mon1 | changed: [mon1]
2026-05-08 04:12:06.387174 | mon1 |
2026-05-08 04:12:06.387511 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:12:06.387758 | mon1 | Friday 08 May 2026  04:12:06 +0000 (0:00:00.313)       0:00:01.740 ************
2026-05-08 04:12:06.480370 | mon1 | ok: [mon1] => {
2026-05-08 04:12:06.480558 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:12:06.480757 | mon1 | }
2026-05-08 04:12:06.480941 | mon1 |
2026-05-08 04:12:06.481184 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:12:06.481386 | mon1 | Friday 08 May 2026  04:12:06 +0000 (0:00:00.093)       0:00:01.833 ************
2026-05-08 04:12:07.131494 | mon1 | changed: [mon1]
2026-05-08 04:12:07.131856 | mon1 |
2026-05-08 04:12:07.132116 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:12:07.132352 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.650)       0:00:02.484 ************
2026-05-08 04:12:07.175276 | mon1 | skipping: [mon1]
2026-05-08 04:12:07.175394 | mon1 |
2026-05-08 04:12:07.175632 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:12:07.175891 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.044)       0:00:02.528 ************
2026-05-08 04:12:07.217350 | mon1 | skipping: [mon1]
2026-05-08 04:12:07.217491 | mon1 |
2026-05-08 04:12:07.217772 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:12:07.217898 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.042)       0:00:02.570 ************
2026-05-08 04:12:07.423987 | mon1 | ok: [mon1]
2026-05-08 04:12:07.424178 | mon1 |
2026-05-08 04:12:07.424463 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:12:07.424726 | mon1 | Friday 08 May 2026  04:12:07 +0000 (0:00:00.205)       0:00:02.776 ************
2026-05-08 04:12:08.730783 | mon1 | ok: [mon1]
2026-05-08 04:12:08.731107 | mon1 |
2026-05-08 04:12:08.731378 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:12:08.731636 | mon1 | Friday 08 May 2026  04:12:08 +0000 (0:00:01.307)       0:00:04.084 ************
2026-05-08 04:12:08.809443 | mon1 | ok: [mon1] => {
2026-05-08 04:12:08.809528 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:12:08.809616 | mon1 | }
2026-05-08 04:12:08.809794 | mon1 |
2026-05-08 04:12:08.809955 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:12:08.810087 | mon1 | Friday 08 May 2026  04:12:08 +0000 (0:00:00.078)       0:00:04.162 ************
2026-05-08 04:12:09.606305 | mon1 | changed: [mon1]
2026-05-08 04:12:09.606384 | mon1 |
2026-05-08 04:12:09.606576 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:12:09.606958 | mon1 | Friday 08 May 2026  04:12:09 +0000 (0:00:00.796)       0:00:04.959 ************
2026-05-08 04:12:12.595505 | mon1 | changed: [mon1]
2026-05-08 04:12:12.595724 | mon1 |
2026-05-08 04:12:12.595862 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:12:12.595985 | mon1 | Friday 08 May 2026  04:12:12 +0000 (0:00:02.985)       0:00:07.945 ************
2026-05-08 04:12:12.619806 | mon1 | skipping: [mon1]
2026-05-08 04:12:12.619895 | mon1 |
2026-05-08 04:12:12.619911 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:12:12.620039 | mon1 | Friday 08 May 2026  04:12:12 +0000 (0:00:00.028)       0:00:07.973 ************
2026-05-08 04:12:12.653488 | mon1 | skipping: [mon1]
2026-05-08 04:12:12.653543 | mon1 |
2026-05-08 04:12:12.653637 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:12:12.653747 | mon1 | Friday 08 May 2026  04:12:12 +0000 (0:00:00.032)       0:00:08.005 ************
2026-05-08 04:12:12.680594 | mon1 | skipping: [mon1]
2026-05-08 04:12:12.680755 | mon1 |
2026-05-08 04:12:12.680893 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:12:12.681019 | mon1 | Friday 08 May 2026  04:12:12 +0000 (0:00:00.026)       0:00:08.032 ************
2026-05-08 04:12:18.339350 | mon1 | changed: [mon1]
2026-05-08 04:12:18.339453 | mon1 |
2026-05-08 04:12:18.339508 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:12:18.339630 | mon1 | Friday 08 May 2026  04:12:18 +0000 (0:00:05.660)       0:00:13.693 ************
2026-05-08 04:12:18.881690 | mon1 | changed: [mon1]
2026-05-08 04:12:18.881807 | mon1 |
2026-05-08 04:12:18.881823 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:12:18.881960 | mon1 | Friday 08 May 2026  04:12:18 +0000 (0:00:00.542)       0:00:14.235 ************
2026-05-08 04:12:19.785832 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'})
2026-05-08 04:12:19.785932 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:12:19.786730 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:12:19.786783 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:12:19.786792 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:12:19.786810 | mon1 |
2026-05-08 04:12:19.786826 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:12:19.786833 | mon1 | Friday 08 May 2026  04:12:19 +0000 (0:00:00.903)       0:00:15.139 ************
2026-05-08 04:12:20.358889 | mon1 | changed: [mon1]
2026-05-08 04:12:20.359015 | mon1 |
2026-05-08 04:12:20.359043 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:12:20.359071 | mon1 | Friday 08 May 2026  04:12:20 +0000 (0:00:00.565)       0:00:15.705 ************
2026-05-08 04:12:20.359377 | mon1 |
2026-05-08 04:12:20.359423 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:12:20.359429 | mon1 | Friday 08 May 2026  04:12:20 +0000 (0:00:00.007)       0:00:15.712 ************
2026-05-08 04:12:21.232190 | mon1 | ok: [mon1]
2026-05-08 04:12:21.232231 | mon1 |
2026-05-08 04:12:21.232238 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-08 04:12:21.232243 | mon1 | Friday 08 May 2026  04:12:21 +0000 (0:00:00.873)       0:00:16.585 ************
2026-05-08 04:12:21.668361 | mon1 | changed: [mon1]
2026-05-08 04:12:21.668438 | mon1 |
2026-05-08 04:12:21.668616 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:12:21.668657 | mon1 | Friday 08 May 2026  04:12:21 +0000 (0:00:00.436)       0:00:17.022 ************
2026-05-08 04:12:22.184587 | mon1 | changed: [mon1]
2026-05-08 04:12:22.184663 | mon1 |
2026-05-08 04:12:22.184900 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:12:22.184949 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:00.516)       0:00:17.538 ************
2026-05-08 04:12:22.383564 | mon1 | ok: [mon1]
2026-05-08 04:12:22.383651 | mon1 |
2026-05-08 04:12:22.383670 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:12:22.383809 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:00.198)       0:00:17.737 ************
2026-05-08 04:12:22.451138 | mon1 | ok: [mon1] => {
2026-05-08 04:12:22.451226 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:12:22.451573 | mon1 | }
2026-05-08 04:12:22.451617 | mon1 |
2026-05-08 04:12:22.451623 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:12:22.451628 | mon1 | Friday 08 May 2026  04:12:22 +0000 (0:00:00.067)       0:00:17.804 ************
2026-05-08 04:12:23.272533 | mon1 | changed: [mon1]
2026-05-08 04:12:23.272612 | mon1 |
2026-05-08 04:12:23.272864 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:12:23.272912 | mon1 | Friday 08 May 2026  04:12:23 +0000 (0:00:00.821)       0:00:18.626 ************
2026-05-08 04:12:27.602369 | mon1 | changed: [mon1]
2026-05-08 04:12:27.602424 | mon1 |
2026-05-08 04:12:27.602651 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:12:27.602692 | mon1 | Friday 08 May 2026  04:12:27 +0000 (0:00:04.329)       0:00:22.956 ************
2026-05-08 04:12:28.561638 | mon1 | ok: [mon1]
2026-05-08 04:12:28.561714 | mon1 |
2026-05-08 04:12:28.561788 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:12:28.561916 | mon1 | Friday 08 May 2026  04:12:28 +0000 (0:00:00.959)       0:00:23.915 ************
2026-05-08 04:12:28.873060 | mon1 | changed: [mon1]
2026-05-08 04:12:28.873125 | mon1 |
2026-05-08 04:12:28.873134 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:12:28.873140 | mon1 | Friday 08 May 2026  04:12:28 +0000 (0:00:00.311)       0:00:24.226 ************
2026-05-08 04:12:29.331234 | mon1 | changed: [mon1]
2026-05-08 04:12:29.331313 | mon1 |
2026-05-08 04:12:29.331607 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:12:29.331658 | mon1 | Friday 08 May 2026  04:12:29 +0000 (0:00:00.458)       0:00:24.684 ************
2026-05-08 04:12:29.875058 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'})
2026-05-08 04:12:29.875143 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:12:29.875242 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:12:29.875555 | mon1 |
2026-05-08 04:12:29.875605 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:12:29.875611 | mon1 | Friday 08 May 2026  04:12:29 +0000 (0:00:00.543)       0:00:25.228 ************
2026-05-08 04:12:30.330429 | mon1 | changed: [mon1]
2026-05-08 04:12:30.330508 | mon1 |
2026-05-08 04:12:30.330730 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:12:30.330804 | mon1 | Friday 08 May 2026  04:12:30 +0000 (0:00:00.454)       0:00:25.683 ************
2026-05-08 04:12:30.789317 | mon1 | changed: [mon1]
2026-05-08 04:12:30.789413 | mon1 |
2026-05-08 04:12:30.789429 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:12:30.789902 | mon1 | Friday 08 May 2026  04:12:30 +0000 (0:00:00.453)       0:00:26.137 ************
2026-05-08 04:12:30.789962 | mon1 |
2026-05-08 04:12:30.789969 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:12:30.789974 | mon1 | Friday 08 May 2026  04:12:30 +0000 (0:00:00.006)       0:00:26.143 ************
2026-05-08 04:12:31.421484 | mon1 | ok: [mon1]
2026-05-08 04:12:31.421553 | mon1 |
2026-05-08 04:12:31.421747 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-08 04:12:31.421917 | mon1 | Friday 08 May 2026  04:12:31 +0000 (0:00:00.632)       0:00:26.775 ************
2026-05-08 04:12:32.241260 | mon1 | changed: [mon1]
2026-05-08 04:12:32.241347 | mon1 |
2026-05-08 04:12:32.241581 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:12:32.241656 | mon1 | Friday 08 May 2026  04:12:32 +0000 (0:00:00.819)       0:00:27.594 ************
2026-05-08 04:12:32.799379 | mon1 | changed: [mon1]
2026-05-08 04:12:32.799441 | mon1 |
2026-05-08 04:12:32.799447 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:12:32.799453 | mon1 | Friday 08 May 2026  04:12:32 +0000 (0:00:00.557)       0:00:28.152 ************
2026-05-08 04:12:32.850100 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-08 04:12:32.850139 | mon1 |
2026-05-08 04:12:32.850147 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:12:32.850154 | mon1 | Friday 08 May 2026  04:12:32 +0000 (0:00:00.051)       0:00:28.203 ************
2026-05-08 04:13:14.152890 | mon1 | changed: [mon1]
2026-05-08 04:13:14.153028 | mon1 |
2026-05-08 04:13:14.153080 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:13:14.153282 | mon1 | Friday 08 May 2026  04:13:14 +0000 (0:00:41.302)       0:01:09.506 ************
2026-05-08 04:13:14.818119 | mon1 | ok: [mon1] => (item=chronyd)
2026-05-08 04:13:14.818193 | mon1 | ok: [mon1] => (item=sshd)
2026-05-08 04:13:14.818666 | mon1 |
2026-05-08 04:13:14.818720 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:13:14.818728 | mon1 | Friday 08 May 2026  04:13:14 +0000 (0:00:00.665)       0:01:10.171 ************
2026-05-08 04:13:15.418722 | mon1 | changed: [mon1]
2026-05-08 04:13:15.418811 | mon1 |
2026-05-08 04:13:15.419128 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:13:15.419182 | mon1 | Friday 08 May 2026  04:13:15 +0000 (0:00:00.600)       0:01:10.772 ************
2026-05-08 04:13:15.616841 | mon1 | ok: [mon1]
2026-05-08 04:13:15.616916 | mon1 |
2026-05-08 04:13:15.617149 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:13:15.617376 | mon1 | Friday 08 May 2026  04:13:15 +0000 (0:00:00.198)       0:01:10.970 ************
2026-05-08 04:13:16.067878 | mon1 | changed: [mon1]
2026-05-08 04:13:16.067945 | mon1 |
2026-05-08 04:13:16.068016 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:13:16.068144 | mon1 | Friday 08 May 2026  04:13:16 +0000 (0:00:00.451)       0:01:11.421 ************
2026-05-08 04:13:16.401492 | mon1 | changed: [mon1]
2026-05-08 04:13:16.401567 | mon1 |
2026-05-08 04:13:16.401901 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-08 04:13:16.401968 | mon1 | Friday 08 May 2026  04:13:16 +0000 (0:00:00.333)       0:01:11.754 ************
2026-05-08 04:13:16.521393 | mon1 | ok: [mon1]
2026-05-08 04:13:16.521476 | mon1 |
2026-05-08 04:13:16.521781 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-08 04:13:16.521831 | mon1 | Friday 08 May 2026  04:13:16 +0000 (0:00:00.119)       0:01:11.874 ************
2026-05-08 04:13:16.737649 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:13:16.737726 | mon1 |
2026-05-08 04:13:16.737926 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-08 04:13:16.737972 | mon1 | Friday 08 May 2026  04:13:16 +0000 (0:00:00.216)       0:01:12.091 ************
2026-05-08 04:13:16.774515 | mon1 | ok: [mon1]
2026-05-08 04:13:16.774584 | mon1 |
2026-05-08 04:13:16.774661 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-08 04:13:16.774757 | mon1 | Friday 08 May 2026  04:13:16 +0000 (0:00:00.037)       0:01:12.128 ************
2026-05-08 04:13:16.857108 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1
2026-05-08 04:13:16.857416 | mon1 |
2026-05-08 04:13:16.857468 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] *************
2026-05-08 04:13:16.857475 | mon1 | Friday 08 May 2026  04:13:16 +0000 (0:00:00.082)       0:01:12.210 ************
2026-05-08 04:13:17.138957 | mon1 | changed: [mon1]
2026-05-08 04:13:17.139017 | mon1 |
2026-05-08 04:13:17.139358 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ******************
2026-05-08 04:13:17.139414 | mon1 | Friday 08 May 2026  04:13:17 +0000 (0:00:00.281)       0:01:12.492 ************
2026-05-08 04:13:17.812160 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0})
2026-05-08 04:13:17.812233 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False})
2026-05-08 04:13:17.812616 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10})
2026-05-08 04:13:17.812662 | mon1 |
2026-05-08 04:13:17.812668 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] *******************************
2026-05-08 04:13:17.812673 | mon1 | Friday 08 May 2026  04:13:17 +0000 (0:00:00.673)       0:01:13.165 ************
2026-05-08 04:14:42.362060 | mon1 | ok: [mon1]
2026-05-08 04:14:42.362156 | mon1 |
2026-05-08 04:14:42.362266 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] ***************
2026-05-08 04:14:42.362360 | mon1 | Friday 08 May 2026  04:14:42 +0000 (0:01:24.549)       0:02:37.715 ************
2026-05-08 04:14:42.590021 | mon1 | changed: [mon1]
2026-05-08 04:14:42.590076 | mon1 |
2026-05-08 04:14:42.590082 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] **********************************
2026-05-08 04:14:42.590087 | mon1 | Friday 08 May 2026  04:14:42 +0000 (0:00:00.227)       0:02:37.942 ************
2026-05-08 04:14:42.627399 | mon1 | ok: [mon1]
2026-05-08 04:14:42.627445 | mon1 |
2026-05-08 04:14:42.627450 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:14:42.627455 | mon1 | Friday 08 May 2026  04:14:42 +0000 (0:00:00.038)       0:02:37.980 ************
2026-05-08 04:14:42.692274 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:14:42.692321 | mon1 |
2026-05-08 04:14:42.692327 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:14:42.692331 | mon1 | Friday 08 May 2026  04:14:42 +0000 (0:00:00.064)       0:02:38.045 ************
2026-05-08 04:14:48.234506 | mon1 | ok: [mon1]
2026-05-08 04:14:48.234602 | mon1 |
2026-05-08 04:14:48.234945 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:14:48.234996 | mon1 | Friday 08 May 2026  04:14:48 +0000 (0:00:05.542)       0:02:43.588 ************
2026-05-08 04:14:48.284154 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:14:48.284192 | mon1 |
2026-05-08 04:14:48.284198 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:14:48.284215 | mon1 | Friday 08 May 2026  04:14:48 +0000 (0:00:00.049)       0:02:43.637 ************
2026-05-08 04:14:48.642388 | mon1 | ok: [mon1]
2026-05-08 04:14:48.642440 | mon1 |
2026-05-08 04:14:48.642448 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:14:48.642455 | mon1 | Friday 08 May 2026  04:14:48 +0000 (0:00:00.357)       0:02:43.995 ************
2026-05-08 04:14:57.471044 | mon1 | ok: [mon1]
2026-05-08 04:14:57.471116 | mon1 |
2026-05-08 04:14:57.471342 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-08 04:14:57.471386 | mon1 | Friday 08 May 2026  04:14:57 +0000 (0:00:08.829)       0:02:52.824 ************
2026-05-08 04:15:46.693423 | mon1 | changed: [mon1]
2026-05-08 04:15:46.693513 | mon1 |
2026-05-08 04:15:46.693653 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-08 04:15:46.693775 | mon1 | Friday 08 May 2026  04:15:46 +0000 (0:00:49.221)       0:03:42.046 ************
2026-05-08 04:16:00.793787 | mon1 | ok: [mon1]
2026-05-08 04:16:00.793881 | mon1 |
2026-05-08 04:16:00.793897 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:16:00.794055 | mon1 | Friday 08 May 2026  04:16:00 +0000 (0:00:14.100)       0:03:56.147 ************
2026-05-08 04:16:00.854985 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:16:00.855065 | mon1 |
2026-05-08 04:16:00.855107 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:16:00.855205 | mon1 | Friday 08 May 2026  04:16:00 +0000 (0:00:00.061)       0:03:56.208 ************
2026-05-08 04:16:00.893866 | mon1 | skipping: [mon1]
2026-05-08 04:16:00.893930 | mon1 |
2026-05-08 04:16:00.894172 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:16:00.894241 | mon1 | Friday 08 May 2026  04:16:00 +0000 (0:00:00.038)       0:03:56.247 ************
2026-05-08 04:16:00.933445 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-08 04:16:00.934001 | mon1 | skipping: [mon1]
2026-05-08 04:16:00.934069 | mon1 |
2026-05-08 04:16:00.934078 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:16:00.934085 | mon1 | Friday 08 May 2026  04:16:00 +0000 (0:00:00.039)       0:03:56.286 ************
2026-05-08 04:16:01.201664 | mon1 | ok: [mon1]
2026-05-08 04:16:01.201749 | mon1 |
2026-05-08 04:16:01.201804 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:16:01.201899 | mon1 | Friday 08 May 2026  04:16:01 +0000 (0:00:00.268)       0:03:56.555 ************
2026-05-08 04:16:07.616799 | mon1 | ok: [mon1]
2026-05-08 04:16:07.616897 | mon1 |
2026-05-08 04:16:07.616959 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-08 04:16:07.617101 | mon1 | Friday 08 May 2026  04:16:07 +0000 (0:00:06.415)       0:04:02.970 ************
2026-05-08 04:16:19.629966 | mon1 | changed: [mon1]
2026-05-08 04:16:19.630059 | mon1 |
2026-05-08 04:16:19.630258 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-08 04:16:19.630274 | mon1 | Friday 08 May 2026  04:16:19 +0000 (0:00:12.012)       0:04:14.983 ************
2026-05-08 04:16:25.605663 | mon1 | ok: [mon1]
2026-05-08 04:16:25.605758 | mon1 |
2026-05-08 04:16:25.605819 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-08 04:16:25.605941 | mon1 | Friday 08 May 2026  04:16:25 +0000 (0:00:05.975)       0:04:20.959 ************
2026-05-08 04:16:32.938547 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-08 04:16:32.938639 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-08 04:16:32.938655 | mon1 | changed: [mon1] => (item={'name': 'prometheus'})
2026-05-08 04:16:32.938766 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-08 04:16:32.938992 | mon1 |
2026-05-08 04:16:32.939072 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-08 04:16:32.939163 | mon1 |
2026-05-08 04:16:32.939240 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:16:32.939342 | mon1 | Friday 08 May 2026  04:16:32 +0000 (0:00:07.332)       0:04:28.292 ************
2026-05-08 04:16:34.030229 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-08 04:16:34.030444 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:16:34.030657 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:16:34.030883 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:16:34.031177 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:16:34.043270 | mon1 | ok: [osd1]
2026-05-08 04:16:34.043322 | mon1 |
2026-05-08 04:16:34.043448 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:16:34.043537 | mon1 | Friday 08 May 2026  04:16:34 +0000 (0:00:01.104)       0:04:29.397 ************
2026-05-08 04:16:34.248229 | mon1 | ok: [osd1]
2026-05-08 04:16:34.248313 | mon1 |
2026-05-08 04:16:34.248354 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:16:34.248481 | mon1 | Friday 08 May 2026  04:16:34 +0000 (0:00:00.204)       0:04:29.602 ************
2026-05-08 04:16:34.283390 | mon1 | skipping: [osd1]
2026-05-08 04:16:34.283501 | mon1 |
2026-05-08 04:16:34.283514 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:16:34.283588 | mon1 | Friday 08 May 2026  04:16:34 +0000 (0:00:00.035)       0:04:29.637 ************
2026-05-08 04:16:34.485389 | mon1 | changed: [osd1]
2026-05-08 04:16:34.485492 | mon1 |
2026-05-08 04:16:34.485506 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:16:34.485639 | mon1 | Friday 08 May 2026  04:16:34 +0000 (0:00:00.201)       0:04:29.839 ************
2026-05-08 04:16:34.541736 | mon1 | ok: [osd1] => {
2026-05-08 04:16:34.541853 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:16:34.541866 | mon1 | }
2026-05-08 04:16:34.541942 | mon1 |
2026-05-08 04:16:34.542079 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:16:34.542190 | mon1 | Friday 08 May 2026  04:16:34 +0000 (0:00:00.056)       0:04:29.895 ************
2026-05-08 04:16:35.173709 | mon1 | changed: [osd1]
2026-05-08 04:16:35.173798 | mon1 |
2026-05-08 04:16:35.173888 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:16:35.174009 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:00.632)       0:04:30.527 ************
2026-05-08 04:16:35.217123 | mon1 | skipping: [osd1]
2026-05-08 04:16:35.217246 | mon1 |
2026-05-08 04:16:35.217265 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:16:35.217286 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:00.043)       0:04:30.571 ************
2026-05-08 04:16:35.257490 | mon1 | skipping: [osd1]
2026-05-08 04:16:35.257588 | mon1 |
2026-05-08 04:16:35.257600 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:16:35.257656 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:00.040)       0:04:30.611 ************
2026-05-08 04:16:35.471144 | mon1 | ok: [osd1]
2026-05-08 04:16:35.471261 | mon1 |
2026-05-08 04:16:35.471274 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:16:35.471346 | mon1 | Friday 08 May 2026  04:16:35 +0000 (0:00:00.213)       0:04:30.824 ************
2026-05-08 04:16:36.527892 | mon1 | ok: [osd1]
2026-05-08 04:16:36.527971 | mon1 |
2026-05-08 04:16:36.528037 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:16:36.528130 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:01.056)       0:04:31.881 ************
2026-05-08 04:16:36.592540 | mon1 | ok: [osd1] => {
2026-05-08 04:16:36.592625 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:16:36.592717 | mon1 | }
2026-05-08 04:16:36.592793 | mon1 |
2026-05-08 04:16:36.592893 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:16:36.592974 | mon1 | Friday 08 May 2026  04:16:36 +0000 (0:00:00.064)       0:04:31.946 ************
2026-05-08 04:16:37.321898 | mon1 | changed: [osd1]
2026-05-08 04:16:37.322050 | mon1 |
2026-05-08 04:16:37.322272 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:16:37.322479 | mon1 | Friday 08 May 2026  04:16:37 +0000 (0:00:00.728)       0:04:32.675 ************
2026-05-08 04:16:40.048935 | mon1 | changed: [osd1]
2026-05-08 04:16:40.049018 | mon1 |
2026-05-08 04:16:40.049233 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:16:40.049367 | mon1 | Friday 08 May 2026  04:16:40 +0000 (0:00:02.726)       0:04:35.402 ************
2026-05-08 04:16:40.078126 | mon1 | skipping: [osd1]
2026-05-08 04:16:40.078240 | mon1 |
2026-05-08 04:16:40.078377 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:16:40.078508 | mon1 | Friday 08 May 2026  04:16:40 +0000 (0:00:00.029)       0:04:35.431 ************
2026-05-08 04:16:40.107662 | mon1 | skipping: [osd1]
2026-05-08 04:16:40.107725 | mon1 |
2026-05-08 04:16:40.107864 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:16:40.108007 | mon1 | Friday 08 May 2026  04:16:40 +0000 (0:00:00.029)       0:04:35.460 ************
2026-05-08 04:16:40.139766 | mon1 | skipping: [osd1]
2026-05-08 04:16:40.139850 | mon1 |
2026-05-08 04:16:40.139954 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:16:40.140050 | mon1 | Friday 08 May 2026  04:16:40 +0000 (0:00:00.031)       0:04:35.492 ************
2026-05-08 04:16:45.669168 | mon1 | changed: [osd1]
2026-05-08 04:16:45.669251 | mon1 |
2026-05-08 04:16:45.669493 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:16:45.669542 | mon1 | Friday 08 May 2026  04:16:45 +0000 (0:00:05.529)       0:04:41.022 ************
2026-05-08 04:16:46.112946 | mon1 | changed: [osd1]
2026-05-08 04:16:46.113589 | mon1 |
2026-05-08 04:16:46.113642 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:16:46.113650 | mon1 | Friday 08 May 2026  04:16:46 +0000 (0:00:00.444)       0:04:41.466 ************
2026-05-08 04:16:47.010893 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'})
2026-05-08 04:16:47.010980 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:16:47.010996 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:16:47.011481 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:16:47.011528 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:16:47.011534 | mon1 |
2026-05-08 04:16:47.011539 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:16:47.011544 | mon1 | Friday 08 May 2026  04:16:47 +0000 (0:00:00.898)       0:04:42.364 ************
2026-05-08 04:16:47.566475 | mon1 | changed: [osd1]
2026-05-08 04:16:47.566559 | mon1 |
2026-05-08 04:16:47.567012 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:16:47.567058 | mon1 | Friday 08 May 2026  04:16:47 +0000 (0:00:00.548)       0:04:42.913 ************
2026-05-08 04:16:47.567064 | mon1 |
2026-05-08 04:16:47.567068 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:16:47.567073 | mon1 | Friday 08 May 2026  04:16:47 +0000 (0:00:00.006)       0:04:42.920 ************
2026-05-08 04:16:48.253172 | mon1 | ok: [osd1]
2026-05-08 04:16:48.253232 | mon1 |
2026-05-08 04:16:48.253319 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] **********
2026-05-08 04:16:48.253446 | mon1 | Friday 08 May 2026  04:16:48 +0000 (0:00:00.686)       0:04:43.607 ************
2026-05-08 04:16:48.710039 | mon1 | changed: [osd1]
2026-05-08 04:16:48.710117 | mon1 |
2026-05-08 04:16:48.710170 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:16:48.710285 | mon1 | Friday 08 May 2026  04:16:48 +0000 (0:00:00.456)       0:04:44.063 ************
2026-05-08 04:16:49.247085 | mon1 | changed: [osd1]
2026-05-08 04:16:49.247207 | mon1 |
2026-05-08 04:16:49.247219 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:16:49.247310 | mon1 | Friday 08 May 2026  04:16:49 +0000 (0:00:00.537)       0:04:44.600 ************
2026-05-08 04:16:49.451828 | mon1 | ok: [osd1]
2026-05-08 04:16:49.451907 | mon1 |
2026-05-08 04:16:49.452020 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:16:49.452168 | mon1 | Friday 08 May 2026  04:16:49 +0000 (0:00:00.204)       0:04:44.805 ************
2026-05-08 04:16:49.498806 | mon1 | ok: [osd1] => {
2026-05-08 04:16:49.498885 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:16:49.498948 | mon1 | }
2026-05-08 04:16:49.499641 | mon1 |
2026-05-08 04:16:49.499687 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:16:49.499693 | mon1 | Friday 08 May 2026  04:16:49 +0000 (0:00:00.046)       0:04:44.852 ************
2026-05-08 04:16:50.348095 | mon1 | changed: [osd1]
2026-05-08 04:16:50.348168 | mon1 |
2026-05-08 04:16:50.348590 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:16:50.348616 | mon1 | Friday 08 May 2026  04:16:50 +0000 (0:00:00.849)       0:04:45.701 ************
2026-05-08 04:16:54.751225 | mon1 | changed: [osd1]
2026-05-08 04:16:54.751303 | mon1 |
2026-05-08 04:16:54.751521 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:16:54.751578 | mon1 | Friday 08 May 2026  04:16:54 +0000 (0:00:04.403)       0:04:50.105 ************
2026-05-08 04:16:56.148871 | mon1 | ok: [osd1]
2026-05-08 04:16:56.148963 | mon1 |
2026-05-08 04:16:56.149176 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:16:56.149285 | mon1 | Friday 08 May 2026  04:16:56 +0000 (0:00:01.397)       0:04:51.502 ************
2026-05-08 04:16:56.383871 | mon1 | changed: [osd1]
2026-05-08 04:16:56.383951 | mon1 |
2026-05-08 04:16:56.384267 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:16:56.384317 | mon1 | Friday 08 May 2026  04:16:56 +0000 (0:00:00.234)       0:04:51.737 ************
2026-05-08 04:16:56.850633 | mon1 | changed: [osd1]
2026-05-08 04:16:56.850706 | mon1 |
2026-05-08 04:16:56.851053 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:16:56.851103 | mon1 | Friday 08 May 2026  04:16:56 +0000 (0:00:00.466)       0:04:52.204 ************
2026-05-08 04:16:57.401079 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'})
2026-05-08 04:16:57.401680 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:16:57.401689 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:16:57.401696 | mon1 |
2026-05-08 04:16:57.401701 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:16:57.401707 | mon1 | Friday 08 May 2026  04:16:57 +0000 (0:00:00.550)       0:04:52.754 ************
2026-05-08 04:16:57.886357 | mon1 | changed: [osd1]
2026-05-08 04:16:57.886440 | mon1 |
2026-05-08 04:16:57.886496 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:16:57.886628 | mon1 | Friday 08 May 2026  04:16:57 +0000 (0:00:00.485)       0:04:53.240 ************
2026-05-08 04:16:58.366851 | mon1 | changed: [osd1]
2026-05-08 04:16:58.366936 | mon1 |
2026-05-08 04:16:58.366971 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:16:58.367404 | mon1 | Friday 08 May 2026  04:16:58 +0000 (0:00:00.472)       0:04:53.712 ************
2026-05-08 04:16:58.367463 | mon1 |
2026-05-08 04:16:58.367471 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] **************
2026-05-08 04:16:58.367477 | mon1 | Friday 08 May 2026  04:16:58 +0000 (0:00:00.007)       0:04:53.720 ************
2026-05-08 04:16:59.057874 | mon1 | ok: [osd1]
2026-05-08 04:16:59.057957 | mon1 |
2026-05-08 04:16:59.058021 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ******************
2026-05-08 04:16:59.058130 | mon1 | Friday 08 May 2026  04:16:59 +0000 (0:00:00.691)       0:04:54.411 ************
2026-05-08 04:16:59.739813 | mon1 | changed: [osd1]
2026-05-08 04:16:59.739897 | mon1 |
2026-05-08 04:16:59.739910 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:16:59.740031 | mon1 | Friday 08 May 2026  04:16:59 +0000 (0:00:00.681)       0:04:55.093 ************
2026-05-08 04:17:00.279604 | mon1 | changed: [osd1]
2026-05-08 04:17:00.279737 | mon1 |
2026-05-08 04:17:00.279764 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:17:00.279956 | mon1 | Friday 08 May 2026  04:17:00 +0000 (0:00:00.540)       0:04:55.633 ************
2026-05-08 04:17:00.324842 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-08 04:17:00.324931 | mon1 |
2026-05-08 04:17:00.325149 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:17:00.325227 | mon1 | Friday 08 May 2026  04:17:00 +0000 (0:00:00.045)       0:04:55.678 ************
2026-05-08 04:17:05.263697 | mon1 | changed: [osd1]
2026-05-08 04:17:05.263870 | mon1 |
2026-05-08 04:17:05.263890 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:17:05.264136 | mon1 | Friday 08 May 2026  04:17:05 +0000 (0:00:04.938)       0:05:00.616 ************
2026-05-08 04:17:05.934357 | mon1 | ok: [osd1] => (item=chronyd)
2026-05-08 04:17:05.934444 | mon1 | ok: [osd1] => (item=sshd)
2026-05-08 04:17:05.934829 | mon1 |
2026-05-08 04:17:05.934880 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:17:05.934889 | mon1 | Friday 08 May 2026  04:17:05 +0000 (0:00:00.671)       0:05:01.287 ************
2026-05-08 04:17:06.216167 | mon1 | changed: [osd1]
2026-05-08 04:17:06.216255 | mon1 |
2026-05-08 04:17:06.216618 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:17:06.216676 | mon1 | Friday 08 May 2026  04:17:06 +0000 (0:00:00.281)       0:05:01.569 ************
2026-05-08 04:17:06.416024 | mon1 | ok: [osd1]
2026-05-08 04:17:06.416098 | mon1 |
2026-05-08 04:17:06.416440 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:17:06.416491 | mon1 | Friday 08 May 2026  04:17:06 +0000 (0:00:00.199)       0:05:01.769 ************
2026-05-08 04:17:06.718529 | mon1 | changed: [osd1]
2026-05-08 04:17:06.718591 | mon1 |
2026-05-08 04:17:06.718651 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:17:06.718763 | mon1 | Friday 08 May 2026  04:17:06 +0000 (0:00:00.302)       0:05:02.072 ************
2026-05-08 04:17:06.962697 | mon1 | changed: [osd1]
2026-05-08 04:17:06.962831 | mon1 |
2026-05-08 04:17:06.962899 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-08 04:17:06.963011 | mon1 | Friday 08 May 2026  04:17:06 +0000 (0:00:00.244)       0:05:02.316 ************
2026-05-08 04:17:07.210389 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-08 04:17:07.210462 | mon1 |
2026-05-08 04:17:07.210734 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-08 04:17:07.210783 | mon1 | Friday 08 May 2026  04:17:07 +0000 (0:00:00.247)       0:05:02.564 ************
2026-05-08 04:17:07.257314 | mon1 | ok: [osd1]
2026-05-08 04:17:07.257382 | mon1 |
2026-05-08 04:17:07.257605 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:17:07.257654 | mon1 | Friday 08 May 2026  04:17:07 +0000 (0:00:00.046)       0:05:02.610 ************
2026-05-08 04:17:07.312316 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-08 04:17:07.312395 | mon1 |
2026-05-08 04:17:07.312478 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:17:07.312580 | mon1 | Friday 08 May 2026  04:17:07 +0000 (0:00:00.055)       0:05:02.666 ************
2026-05-08 04:17:13.308702 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:17:13.308791 | mon1 |
2026-05-08 04:17:13.308853 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:17:13.308977 | mon1 | Friday 08 May 2026  04:17:13 +0000 (0:00:05.996)       0:05:08.662 ************
2026-05-08 04:17:13.361285 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:17:13.361607 | mon1 |
2026-05-08 04:17:13.361657 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:17:13.361674 | mon1 | Friday 08 May 2026  04:17:13 +0000 (0:00:00.051)       0:05:08.714 ************
2026-05-08 04:17:13.612533 | mon1 | changed: [osd1]
2026-05-08 04:17:13.612608 | mon1 |
2026-05-08 04:17:13.612814 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:17:13.612867 | mon1 | Friday 08 May 2026  04:17:13 +0000 (0:00:00.251)       0:05:08.966 ************
2026-05-08 04:17:22.201844 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:17:22.201909 | mon1 |
2026-05-08 04:17:22.202015 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-08 04:17:22.202129 | mon1 | Friday 08 May 2026  04:17:22 +0000 (0:00:08.589)       0:05:17.555 ************
2026-05-08 04:17:23.736380 | mon1 | ok: [osd1]
2026-05-08 04:17:23.736458 | mon1 |
2026-05-08 04:17:23.736769 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-08 04:17:23.736859 | mon1 | Friday 08 May 2026  04:17:23 +0000 (0:00:01.533)       0:05:19.089 ************
2026-05-08 04:18:04.187261 | mon1 | ok: [osd1]
2026-05-08 04:18:04.187359 | mon1 |
2026-05-08 04:18:04.187372 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-08 04:18:04.187436 | mon1 | Friday 08 May 2026  04:18:04 +0000 (0:00:40.451)       0:05:59.540 ************
2026-05-08 04:19:33.430185 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data)
2026-05-08 04:19:33.430258 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data)
2026-05-08 04:19:33.430727 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data)
2026-05-08 04:19:33.430803 | mon1 |
2026-05-08 04:19:33.430810 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-08 04:19:33.430815 | mon1 | Friday 08 May 2026  04:19:33 +0000 (0:01:29.242)       0:07:28.783 ************
2026-05-08 04:19:39.428232 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:19:39.428322 | mon1 |
2026-05-08 04:19:39.428396 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-08 04:19:39.428534 | mon1 | Friday 08 May 2026  04:19:39 +0000 (0:00:05.998)       0:07:34.782 ************
2026-05-08 04:19:45.358641 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:19:45.358714 | mon1 |
2026-05-08 04:19:45.358740 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-08 04:19:45.358783 | mon1 | Friday 08 May 2026  04:19:45 +0000 (0:00:05.930)       0:07:40.712 ************
2026-05-08 04:19:45.406394 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-08 04:19:45.406440 | mon1 |
2026-05-08 04:19:45.406753 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-08 04:19:45.406829 | mon1 | Friday 08 May 2026  04:19:45 +0000 (0:00:00.047)       0:07:40.760 ************
2026-05-08 04:19:45.440027 | mon1 | ok: [osd1]
2026-05-08 04:19:45.440111 | mon1 |
2026-05-08 04:19:45.440407 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-08 04:19:45.440463 | mon1 | Friday 08 May 2026  04:19:45 +0000 (0:00:00.033)       0:07:40.793 ************
2026-05-08 04:19:51.353127 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:19:51.353434 | mon1 |
2026-05-08 04:19:51.353446 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-08 04:19:51.353451 | mon1 | Friday 08 May 2026  04:19:51 +0000 (0:00:05.913)       0:07:46.706 ************
2026-05-08 04:19:51.390377 | mon1 | ok: [osd1]
2026-05-08 04:19:51.390414 | mon1 |
2026-05-08 04:19:51.390426 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-08 04:19:51.390437 | mon1 | Friday 08 May 2026  04:19:51 +0000 (0:00:00.036)       0:07:46.743 ************
2026-05-08 04:19:51.425258 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:19:51.425328 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:19:51.425340 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:19:51.425350 | mon1 | skipping: [osd1]
2026-05-08 04:19:51.425380 | mon1 |
2026-05-08 04:19:51.425391 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-08 04:19:51.425410 | mon1 | Friday 08 May 2026  04:19:51 +0000 (0:00:00.033)       0:07:46.777 ************
2026-05-08 04:19:51.454520 | mon1 | skipping: [osd1]
2026-05-08 04:19:51.454690 | mon1 |
2026-05-08 04:19:51.454915 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:19:51.455150 | mon1 | mon1                       : ok=59   changed=29   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-05-08 04:19:51.455381 | mon1 | osd1                       : ok=53   changed=24   unreachable=0    failed=0    skipped=8    rescued=0    ignored=0
2026-05-08 04:19:51.455573 | mon1 |
2026-05-08 04:19:51.455755 | mon1 |
2026-05-08 04:19:51.455968 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:19:51.456173 | mon1 | Friday 08 May 2026  04:19:51 +0000 (0:00:00.030)       0:07:46.808 ************
2026-05-08 04:19:51.456598 | mon1 | ===============================================================================
2026-05-08 04:19:51.456807 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 89.24s
2026-05-08 04:19:51.457015 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ------------------------------ 84.55s
2026-05-08 04:19:51.457263 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ----------------- 49.22s
2026-05-08 04:19:51.457472 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 41.30s
2026-05-08 04:19:51.457682 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 40.45s
2026-05-08 04:19:51.457893 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.10s
2026-05-08 04:19:51.458092 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ----------------- 12.01s
2026-05-08 04:19:51.458301 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.83s
2026-05-08 04:19:51.458501 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 8.59s
2026-05-08 04:19:51.458691 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.33s
2026-05-08 04:19:51.458884 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.42s
2026-05-08 04:19:51.459076 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.00s
2026-05-08 04:19:51.459277 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.00s
2026-05-08 04:19:51.459471 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.98s
2026-05-08 04:19:51.459664 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.93s
2026-05-08 04:19:51.459854 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.91s
2026-05-08 04:19:51.460049 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.66s
2026-05-08 04:19:51.460266 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.54s
2026-05-08 04:19:51.460467 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 5.53s
2026-05-08 04:19:51.460660 | mon1 | vexxhost.ceph.cephadm : Install packages -------------------------------- 4.94s
2026-05-08 04:19:51.544882 | mon1 | INFO     [default > converge] Executed: Successful
2026-05-08 04:19:51.552302 | mon1 | INFO     [default > idempotence] Executing
2026-05-08 04:19:52.337540 | mon1 |
2026-05-08 04:19:52.337727 | mon1 | PLAY [Deploy Ceph monitors & managers] *****************************************
2026-05-08 04:19:52.337915 | mon1 |
2026-05-08 04:19:52.338121 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:19:52.338328 | mon1 | Friday 08 May 2026  04:19:52 +0000 (0:00:00.046)       0:00:00.046 ************
2026-05-08 04:19:53.508469 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:19:53.508669 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:19:53.508880 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:19:53.509105 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:19:53.509379 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:19:53.520366 | mon1 | ok: [mon1]
2026-05-08 04:19:53.520469 | mon1 |
2026-05-08 04:19:53.520590 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:19:53.520711 | mon1 | Friday 08 May 2026  04:19:53 +0000 (0:00:01.183)       0:00:01.229 ************
2026-05-08 04:19:53.821606 | mon1 | ok: [mon1]
2026-05-08 04:19:53.821775 | mon1 |
2026-05-08 04:19:53.821995 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:19:53.822206 | mon1 | Friday 08 May 2026  04:19:53 +0000 (0:00:00.300)       0:00:01.530 ************
2026-05-08 04:19:53.858448 | mon1 | skipping: [mon1]
2026-05-08 04:19:53.858654 | mon1 |
2026-05-08 04:19:53.858882 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:19:53.859095 | mon1 | Friday 08 May 2026  04:19:53 +0000 (0:00:00.036)       0:00:01.567 ************
2026-05-08 04:19:54.161178 | mon1 | ok: [mon1]
2026-05-08 04:19:54.161362 | mon1 |
2026-05-08 04:19:54.161597 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:19:54.161888 | mon1 | Friday 08 May 2026  04:19:54 +0000 (0:00:00.302)       0:00:01.869 ************
2026-05-08 04:19:54.226838 | mon1 | ok: [mon1] => {
2026-05-08 04:19:54.226931 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:19:54.227062 | mon1 | }
2026-05-08 04:19:54.227171 | mon1 |
2026-05-08 04:19:54.227298 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:19:54.227420 | mon1 | Friday 08 May 2026  04:19:54 +0000 (0:00:00.065)       0:00:01.935 ************
2026-05-08 04:19:54.628294 | mon1 | ok: [mon1]
2026-05-08 04:19:54.628515 | mon1 |
2026-05-08 04:19:54.628778 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:19:54.628974 | mon1 | Friday 08 May 2026  04:19:54 +0000 (0:00:00.401)       0:00:02.337 ************
2026-05-08 04:19:54.666668 | mon1 | skipping: [mon1]
2026-05-08 04:19:54.666814 | mon1 |
2026-05-08 04:19:54.667031 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:19:54.667239 | mon1 | Friday 08 May 2026  04:19:54 +0000 (0:00:00.038)       0:00:02.375 ************
2026-05-08 04:19:54.702745 | mon1 | skipping: [mon1]
2026-05-08 04:19:54.702908 | mon1 |
2026-05-08 04:19:54.703109 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:19:54.703307 | mon1 | Friday 08 May 2026  04:19:54 +0000 (0:00:00.036)       0:00:02.411 ************
2026-05-08 04:19:54.910522 | mon1 | ok: [mon1]
2026-05-08 04:19:54.910686 | mon1 |
2026-05-08 04:19:54.910929 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:19:54.911137 | mon1 | Friday 08 May 2026  04:19:54 +0000 (0:00:00.207)       0:00:02.619 ************
2026-05-08 04:19:56.033367 | mon1 | ok: [mon1]
2026-05-08 04:19:56.033535 | mon1 |
2026-05-08 04:19:56.033755 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:19:56.033965 | mon1 | Friday 08 May 2026  04:19:56 +0000 (0:00:01.122)       0:00:03.742 ************
2026-05-08 04:19:56.102598 | mon1 | ok: [mon1] => {
2026-05-08 04:19:56.102901 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:19:56.103107 | mon1 | }
2026-05-08 04:19:56.103298 | mon1 |
2026-05-08 04:19:56.103516 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:19:56.103793 | mon1 | Friday 08 May 2026  04:19:56 +0000 (0:00:00.069)       0:00:03.811 ************
2026-05-08 04:19:56.448299 | mon1 | ok: [mon1]
2026-05-08 04:19:56.448570 | mon1 |
2026-05-08 04:19:56.448871 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:19:56.449244 | mon1 | Friday 08 May 2026  04:19:56 +0000 (0:00:00.345)       0:00:04.156 ************
2026-05-08 04:19:58.643616 | mon1 | ok: [mon1]
2026-05-08 04:19:58.643708 | mon1 |
2026-05-08 04:19:58.643730 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:19:58.643737 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:02.195)       0:00:06.352 ************
2026-05-08 04:19:58.672122 | mon1 | skipping: [mon1]
2026-05-08 04:19:58.672178 | mon1 |
2026-05-08 04:19:58.672281 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:19:58.672387 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:00.028)       0:00:06.381 ************
2026-05-08 04:19:58.700510 | mon1 | skipping: [mon1]
2026-05-08 04:19:58.700582 | mon1 |
2026-05-08 04:19:58.700803 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:19:58.700857 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:00.028)       0:00:06.409 ************
2026-05-08 04:19:58.730654 | mon1 | skipping: [mon1]
2026-05-08 04:19:58.730722 | mon1 |
2026-05-08 04:19:58.730786 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:19:58.730891 | mon1 | Friday 08 May 2026  04:19:58 +0000 (0:00:00.030)       0:00:06.439 ************
2026-05-08 04:19:59.797828 | mon1 | ok: [mon1]
2026-05-08 04:19:59.797899 | mon1 |
2026-05-08 04:19:59.797980 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:19:59.798111 | mon1 | Friday 08 May 2026  04:19:59 +0000 (0:00:01.067)       0:00:07.506 ************
2026-05-08 04:20:00.207151 | mon1 | ok: [mon1]
2026-05-08 04:20:00.207559 | mon1 |
2026-05-08 04:20:00.207605 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:20:00.207613 | mon1 | Friday 08 May 2026  04:20:00 +0000 (0:00:00.409)       0:00:07.916 ************
2026-05-08 04:20:01.092731 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'})
2026-05-08 04:20:01.092850 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:20:01.093122 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:20:01.093162 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:20:01.093786 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:20:01.093837 | mon1 |
2026-05-08 04:20:01.093845 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:20:01.093857 | mon1 | Friday 08 May 2026  04:20:01 +0000 (0:00:00.885)       0:00:08.801 ************
2026-05-08 04:20:01.607149 | mon1 | ok: [mon1]
2026-05-08 04:20:01.607220 | mon1 |
2026-05-08 04:20:01.607297 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:20:01.607641 | mon1 | Friday 08 May 2026  04:20:01 +0000 (0:00:00.508)       0:00:09.310 ************
2026-05-08 04:20:01.607763 | mon1 |
2026-05-08 04:20:01.607788 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:20:01.607807 | mon1 | Friday 08 May 2026  04:20:01 +0000 (0:00:00.006)       0:00:09.316 ************
2026-05-08 04:20:02.173847 | mon1 | ok: [mon1]
2026-05-08 04:20:02.173957 | mon1 |
2026-05-08 04:20:02.174179 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:20:02.174227 | mon1 | Friday 08 May 2026  04:20:02 +0000 (0:00:00.566)       0:00:09.882 ************
2026-05-08 04:20:02.393707 | mon1 | ok: [mon1]
2026-05-08 04:20:02.393779 | mon1 |
2026-05-08 04:20:02.393971 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:20:02.394036 | mon1 | Friday 08 May 2026  04:20:02 +0000 (0:00:00.219)       0:00:10.102 ************
2026-05-08 04:20:02.462227 | mon1 | ok: [mon1] => {
2026-05-08 04:20:02.462330 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:20:02.462779 | mon1 | }
2026-05-08 04:20:02.462826 | mon1 |
2026-05-08 04:20:02.462832 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:20:02.462837 | mon1 | Friday 08 May 2026  04:20:02 +0000 (0:00:00.068)       0:00:10.170 ************
2026-05-08 04:20:02.817407 | mon1 | ok: [mon1]
2026-05-08 04:20:02.817519 | mon1 |
2026-05-08 04:20:02.817838 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:20:02.817891 | mon1 | Friday 08 May 2026  04:20:02 +0000 (0:00:00.355)       0:00:10.526 ************
2026-05-08 04:20:05.883107 | mon1 | ok: [mon1]
2026-05-08 04:20:05.883175 | mon1 |
2026-05-08 04:20:05.883357 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:20:05.883399 | mon1 | Friday 08 May 2026  04:20:05 +0000 (0:00:03.065)       0:00:13.592 ************
2026-05-08 04:20:06.861509 | mon1 | ok: [mon1]
2026-05-08 04:20:06.861701 | mon1 |
2026-05-08 04:20:06.861710 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:20:06.861861 | mon1 | Friday 08 May 2026  04:20:06 +0000 (0:00:00.978)       0:00:14.570 ************
2026-05-08 04:20:07.154204 | mon1 | ok: [mon1]
2026-05-08 04:20:07.154277 | mon1 |
2026-05-08 04:20:07.154471 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:20:07.154519 | mon1 | Friday 08 May 2026  04:20:07 +0000 (0:00:00.292)       0:00:14.863 ************
2026-05-08 04:20:07.557599 | mon1 | ok: [mon1]
2026-05-08 04:20:07.557667 | mon1 |
2026-05-08 04:20:07.557878 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:20:07.557921 | mon1 | Friday 08 May 2026  04:20:07 +0000 (0:00:00.403)       0:00:15.266 ************
2026-05-08 04:20:08.106751 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'})
2026-05-08 04:20:08.106814 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:20:08.106897 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:20:08.107180 | mon1 |
2026-05-08 04:20:08.107223 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:20:08.107229 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.549)       0:00:15.815 ************
2026-05-08 04:20:08.502171 | mon1 | ok: [mon1]
2026-05-08 04:20:08.502575 | mon1 |
2026-05-08 04:20:08.502596 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:20:08.502604 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.395)       0:00:16.211 ************
2026-05-08 04:20:08.910209 | mon1 | ok: [mon1]
2026-05-08 04:20:08.910277 | mon1 |
2026-05-08 04:20:08.910343 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:20:08.910701 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.400)       0:00:16.611 ************
2026-05-08 04:20:08.910718 | mon1 |
2026-05-08 04:20:08.910723 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:20:08.910727 | mon1 | Friday 08 May 2026  04:20:08 +0000 (0:00:00.007)       0:00:16.619 ************
2026-05-08 04:20:09.248713 | mon1 | ok: [mon1]
2026-05-08 04:20:09.248776 | mon1 |
2026-05-08 04:20:09.248856 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:20:09.248989 | mon1 | Friday 08 May 2026  04:20:09 +0000 (0:00:00.338)       0:00:16.957 ************
2026-05-08 04:20:09.294194 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-08 04:20:09.294582 | mon1 |
2026-05-08 04:20:09.294616 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:20:09.294622 | mon1 | Friday 08 May 2026  04:20:09 +0000 (0:00:00.045)       0:00:17.003 ************
2026-05-08 04:20:10.291365 | mon1 | ok: [mon1]
2026-05-08 04:20:10.291444 | mon1 |
2026-05-08 04:20:10.291692 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:20:10.291736 | mon1 | Friday 08 May 2026  04:20:10 +0000 (0:00:00.997)       0:00:18.000 ************
2026-05-08 04:20:11.930805 | mon1 | ok: [mon1] => (item=chronyd)
2026-05-08 04:20:11.930879 | mon1 | ok: [mon1] => (item=sshd)
2026-05-08 04:20:11.931430 | mon1 |
2026-05-08 04:20:11.931484 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:20:11.931492 | mon1 | Friday 08 May 2026  04:20:11 +0000 (0:00:01.639)       0:00:19.639 ************
2026-05-08 04:20:12.212861 | mon1 | ok: [mon1]
2026-05-08 04:20:12.212965 | mon1 |
2026-05-08 04:20:12.213214 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:20:12.213297 | mon1 | Friday 08 May 2026  04:20:12 +0000 (0:00:00.282)       0:00:19.921 ************
2026-05-08 04:20:12.402859 | mon1 | ok: [mon1]
2026-05-08 04:20:12.402936 | mon1 |
2026-05-08 04:20:12.403187 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:20:12.403208 | mon1 | Friday 08 May 2026  04:20:12 +0000 (0:00:00.189)       0:00:20.111 ************
2026-05-08 04:20:12.787252 | mon1 | ok: [mon1]
2026-05-08 04:20:12.787303 | mon1 |
2026-05-08 04:20:12.787311 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:20:12.787320 | mon1 | Friday 08 May 2026  04:20:12 +0000 (0:00:00.383)       0:00:20.495 ************
2026-05-08 04:20:13.107794 | mon1 | ok: [mon1]
2026-05-08 04:20:13.107868 | mon1 |
2026-05-08 04:20:13.108066 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] *************************
2026-05-08 04:20:13.108110 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.321)       0:00:20.816 ************
2026-05-08 04:20:13.174478 | mon1 | ok: [mon1]
2026-05-08 04:20:13.174540 | mon1 |
2026-05-08 04:20:13.174806 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] *******************
2026-05-08 04:20:13.174852 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.066)       0:00:20.883 ************
2026-05-08 04:20:13.402096 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:20:13.402187 | mon1 |
2026-05-08 04:20:13.402208 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ********
2026-05-08 04:20:13.402352 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.227)       0:00:21.111 ************
2026-05-08 04:20:13.445718 | mon1 | ok: [mon1]
2026-05-08 04:20:13.445784 | mon1 |
2026-05-08 04:20:13.446169 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] ***********************************
2026-05-08 04:20:13.446212 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.043)       0:00:21.154 ************
2026-05-08 04:20:13.482131 | mon1 | skipping: [mon1]
2026-05-08 04:20:13.482185 | mon1 |
2026-05-08 04:20:13.482286 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:20:13.482414 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.036)       0:00:21.191 ************
2026-05-08 04:20:13.545208 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:20:13.545283 | mon1 |
2026-05-08 04:20:13.545492 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:20:13.545537 | mon1 | Friday 08 May 2026  04:20:13 +0000 (0:00:00.062)       0:00:21.254 ************
2026-05-08 04:20:19.557125 | mon1 | ok: [mon1]
2026-05-08 04:20:19.557663 | mon1 |
2026-05-08 04:20:19.557688 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:20:19.557698 | mon1 | Friday 08 May 2026  04:20:19 +0000 (0:00:06.011)       0:00:27.266 ************
2026-05-08 04:20:19.600675 | mon1 | ok: [mon1] => (item=mon1)
2026-05-08 04:20:19.600768 | mon1 |
2026-05-08 04:20:19.600911 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:20:19.601046 | mon1 | Friday 08 May 2026  04:20:19 +0000 (0:00:00.043)       0:00:27.309 ************
2026-05-08 04:20:19.971070 | mon1 | ok: [mon1]
2026-05-08 04:20:19.971146 | mon1 |
2026-05-08 04:20:19.971505 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:20:19.971554 | mon1 | Friday 08 May 2026  04:20:19 +0000 (0:00:00.370)       0:00:27.680 ************
2026-05-08 04:20:26.286886 | mon1 | ok: [mon1]
2026-05-08 04:20:26.286978 | mon1 |
2026-05-08 04:20:26.286994 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ******************
2026-05-08 04:20:26.287130 | mon1 | Friday 08 May 2026  04:20:26 +0000 (0:00:06.315)       0:00:33.995 ************
2026-05-08 04:20:32.448972 | mon1 | ok: [mon1]
2026-05-08 04:20:32.449017 | mon1 |
2026-05-08 04:20:32.449024 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ******************************
2026-05-08 04:20:32.449028 | mon1 | Friday 08 May 2026  04:20:32 +0000 (0:00:06.161)       0:00:40.157 ************
2026-05-08 04:20:46.443861 | mon1 | ok: [mon1]
2026-05-08 04:20:46.443938 | mon1 |
2026-05-08 04:20:46.444185 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:20:46.444241 | mon1 | Friday 08 May 2026  04:20:46 +0000 (0:00:13.995)       0:00:54.152 ************
2026-05-08 04:20:46.504924 | mon1 | included: vexxhost.ceph.cephadm_host for mon1
2026-05-08 04:20:46.504992 | mon1 |
2026-05-08 04:20:46.505193 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:20:46.505233 | mon1 | Friday 08 May 2026  04:20:46 +0000 (0:00:00.061)       0:00:54.213 ************
2026-05-08 04:20:46.549534 | mon1 | skipping: [mon1]
2026-05-08 04:20:46.549597 | mon1 |
2026-05-08 04:20:46.549781 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:20:46.549799 | mon1 | Friday 08 May 2026  04:20:46 +0000 (0:00:00.044)       0:00:54.258 ************
2026-05-08 04:20:46.584702 | mon1 | skipping: [mon1] => (item=mon1)
2026-05-08 04:20:46.584794 | mon1 | skipping: [mon1]
2026-05-08 04:20:46.584879 | mon1 |
2026-05-08 04:20:46.585135 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:20:46.585191 | mon1 | Friday 08 May 2026  04:20:46 +0000 (0:00:00.035)       0:00:54.293 ************
2026-05-08 04:20:46.822710 | mon1 | ok: [mon1]
2026-05-08 04:20:46.822769 | mon1 |
2026-05-08 04:20:46.822855 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:20:46.822990 | mon1 | Friday 08 May 2026  04:20:46 +0000 (0:00:00.237)       0:00:54.531 ************
2026-05-08 04:20:53.138301 | mon1 | ok: [mon1]
2026-05-08 04:20:53.138388 | mon1 |
2026-05-08 04:20:53.138429 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ******************
2026-05-08 04:20:53.138548 | mon1 | Friday 08 May 2026  04:20:53 +0000 (0:00:06.315)       0:01:00.847 ************
2026-05-08 04:20:59.228054 | mon1 | ok: [mon1]
2026-05-08 04:20:59.228133 | mon1 |
2026-05-08 04:20:59.228444 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ******************************
2026-05-08 04:20:59.228493 | mon1 | Friday 08 May 2026  04:20:59 +0000 (0:00:06.089)       0:01:06.936 ************
2026-05-08 04:21:05.208880 | mon1 | ok: [mon1]
2026-05-08 04:21:05.208958 | mon1 |
2026-05-08 04:21:05.209190 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] ***************************
2026-05-08 04:21:05.209247 | mon1 | Friday 08 May 2026  04:21:05 +0000 (0:00:05.980)       0:01:12.917 ************
2026-05-08 04:21:13.087751 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'})
2026-05-08 04:21:13.087805 | mon1 | ok: [mon1] => (item={'name': 'dashboard'})
2026-05-08 04:21:13.087811 | mon1 | ok: [mon1] => (item={'name': 'prometheus'})
2026-05-08 04:21:13.087816 | mon1 | ok: [mon1] => (item={'name': 'iostat'})
2026-05-08 04:21:13.087820 | mon1 |
2026-05-08 04:21:13.087825 | mon1 | PLAY [Deploy Ceph OSDs] ********************************************************
2026-05-08 04:21:13.087829 | mon1 |
2026-05-08 04:21:13.087833 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:21:13.087837 | mon1 | Friday 08 May 2026  04:21:13 +0000 (0:00:07.877)       0:01:20.795 ************
2026-05-08 04:21:14.231367 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python
2026-05-08 04:21:14.231432 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:21:14.231741 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:21:14.231868 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:21:14.231875 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:21:14.244045 | mon1 | ok: [osd1]
2026-05-08 04:21:14.244133 | mon1 |
2026-05-08 04:21:14.244236 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:21:14.244351 | mon1 | Friday 08 May 2026  04:21:14 +0000 (0:00:01.157)       0:01:21.953 ************
2026-05-08 04:21:14.452670 | mon1 | ok: [osd1]
2026-05-08 04:21:14.452741 | mon1 |
2026-05-08 04:21:14.452811 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:21:14.452909 | mon1 | Friday 08 May 2026  04:21:14 +0000 (0:00:00.208)       0:01:22.161 ************
2026-05-08 04:21:14.485897 | mon1 | skipping: [osd1]
2026-05-08 04:21:14.486082 | mon1 |
2026-05-08 04:21:14.486295 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] ***
2026-05-08 04:21:14.486519 | mon1 | Friday 08 May 2026  04:21:14 +0000 (0:00:00.033)       0:01:22.194 ************
2026-05-08 04:21:14.690676 | mon1 | ok: [osd1]
2026-05-08 04:21:14.690841 | mon1 |
2026-05-08 04:21:14.691061 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:21:14.691302 | mon1 | Friday 08 May 2026  04:21:14 +0000 (0:00:00.204)       0:01:22.399 ************
2026-05-08 04:21:14.758943 | mon1 | ok: [osd1] => {
2026-05-08 04:21:14.759139 | mon1 |     "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64"
2026-05-08 04:21:14.759343 | mon1 | }
2026-05-08 04:21:14.759523 | mon1 |
2026-05-08 04:21:14.759761 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:21:14.759964 | mon1 | Friday 08 May 2026  04:21:14 +0000 (0:00:00.068)       0:01:22.467 ************
2026-05-08 04:21:15.065415 | mon1 | ok: [osd1]
2026-05-08 04:21:15.065588 | mon1 |
2026-05-08 04:21:15.065875 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:21:15.066094 | mon1 | Friday 08 May 2026  04:21:15 +0000 (0:00:00.306)       0:01:22.774 ************
2026-05-08 04:21:15.099911 | mon1 | skipping: [osd1]
2026-05-08 04:21:15.100083 | mon1 |
2026-05-08 04:21:15.100288 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:21:15.100482 | mon1 | Friday 08 May 2026  04:21:15 +0000 (0:00:00.034)       0:01:22.809 ************
2026-05-08 04:21:15.135413 | mon1 | skipping: [osd1]
2026-05-08 04:21:15.135587 | mon1 |
2026-05-08 04:21:15.135794 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:21:15.135992 | mon1 | Friday 08 May 2026  04:21:15 +0000 (0:00:00.035)       0:01:22.844 ************
2026-05-08 04:21:15.329908 | mon1 | ok: [osd1]
2026-05-08 04:21:15.330063 | mon1 |
2026-05-08 04:21:15.330274 | mon1 | TASK [vexxhost.containers.package : Update state for tar] **********************
2026-05-08 04:21:15.330465 | mon1 | Friday 08 May 2026  04:21:15 +0000 (0:00:00.193)       0:01:23.038 ************
2026-05-08 04:21:16.572567 | mon1 | ok: [osd1]
2026-05-08 04:21:16.572803 | mon1 |
2026-05-08 04:21:16.572990 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:21:16.573197 | mon1 | Friday 08 May 2026  04:21:16 +0000 (0:00:01.242)       0:01:24.281 ************
2026-05-08 04:21:16.649098 | mon1 | ok: [osd1] => {
2026-05-08 04:21:16.649339 | mon1 |     "msg": "https://github.com/containerd/containerd/releases/download/v2.2.3/containerd-2.2.3-linux-amd64.tar.gz"
2026-05-08 04:21:16.649515 | mon1 | }
2026-05-08 04:21:16.649681 | mon1 |
2026-05-08 04:21:16.649859 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:21:16.649990 | mon1 | Friday 08 May 2026  04:21:16 +0000 (0:00:00.074)       0:01:24.355 ************
2026-05-08 04:21:16.993782 | mon1 | ok: [osd1]
2026-05-08 04:21:16.993834 | mon1 |
2026-05-08 04:21:16.993841 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:21:16.993848 | mon1 | Friday 08 May 2026  04:21:16 +0000 (0:00:00.346)       0:01:24.702 ************
2026-05-08 04:21:19.008261 | mon1 | ok: [osd1]
2026-05-08 04:21:19.008309 | mon1 |
2026-05-08 04:21:19.008314 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] ***************
2026-05-08 04:21:19.008319 | mon1 | Friday 08 May 2026  04:21:19 +0000 (0:00:02.014)       0:01:26.717 ************
2026-05-08 04:21:19.034807 | mon1 | skipping: [osd1]
2026-05-08 04:21:19.034854 | mon1 |
2026-05-08 04:21:19.034863 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] ***
2026-05-08 04:21:19.034869 | mon1 | Friday 08 May 2026  04:21:19 +0000 (0:00:00.026)       0:01:26.743 ************
2026-05-08 04:21:19.062941 | mon1 | skipping: [osd1]
2026-05-08 04:21:19.062992 | mon1 |
2026-05-08 04:21:19.063001 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ********
2026-05-08 04:21:19.063008 | mon1 | Friday 08 May 2026  04:21:19 +0000 (0:00:00.028)       0:01:26.771 ************
2026-05-08 04:21:19.087874 | mon1 | skipping: [osd1]
2026-05-08 04:21:19.087915 | mon1 |
2026-05-08 04:21:19.087922 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] **************
2026-05-08 04:21:19.087929 | mon1 | Friday 08 May 2026  04:21:19 +0000 (0:00:00.025)       0:01:26.796 ************
2026-05-08 04:21:20.113274 | mon1 | ok: [osd1]
2026-05-08 04:21:20.113392 | mon1 |
2026-05-08 04:21:20.113845 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] ***
2026-05-08 04:21:20.113914 | mon1 | Friday 08 May 2026  04:21:20 +0000 (0:00:01.025)       0:01:27.821 ************
2026-05-08 04:21:20.533510 | mon1 | ok: [osd1]
2026-05-08 04:21:20.533590 | mon1 |
2026-05-08 04:21:20.533894 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] *******
2026-05-08 04:21:20.533946 | mon1 | Friday 08 May 2026  04:21:20 +0000 (0:00:00.420)       0:01:28.242 ************
2026-05-08 04:21:21.469569 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'})
2026-05-08 04:21:21.469643 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'})
2026-05-08 04:21:21.469706 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'})
2026-05-08 04:21:21.470169 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'})
2026-05-08 04:21:21.470219 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'})
2026-05-08 04:21:21.470226 | mon1 |
2026-05-08 04:21:21.470231 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] **********
2026-05-08 04:21:21.470235 | mon1 | Friday 08 May 2026  04:21:21 +0000 (0:00:00.936)       0:01:29.178 ************
2026-05-08 04:21:21.983269 | mon1 | ok: [osd1]
2026-05-08 04:21:21.983344 | mon1 |
2026-05-08 04:21:21.983403 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ********
2026-05-08 04:21:21.983790 | mon1 | Friday 08 May 2026  04:21:21 +0000 (0:00:00.507)       0:01:29.686 ************
2026-05-08 04:21:21.983837 | mon1 |
2026-05-08 04:21:21.983843 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] ***************
2026-05-08 04:21:21.983847 | mon1 | Friday 08 May 2026  04:21:21 +0000 (0:00:00.005)       0:01:29.692 ************
2026-05-08 04:21:22.329786 | mon1 | ok: [osd1]
2026-05-08 04:21:22.329872 | mon1 |
2026-05-08 04:21:22.329884 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] *********************
2026-05-08 04:21:22.330010 | mon1 | Friday 08 May 2026  04:21:22 +0000 (0:00:00.346)       0:01:30.038 ************
2026-05-08 04:21:22.523802 | mon1 | ok: [osd1]
2026-05-08 04:21:22.523875 | mon1 |
2026-05-08 04:21:22.523932 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] *******
2026-05-08 04:21:22.524060 | mon1 | Friday 08 May 2026  04:21:22 +0000 (0:00:00.194)       0:01:30.232 ************
2026-05-08 04:21:22.593399 | mon1 | ok: [osd1] => {
2026-05-08 04:21:22.593480 | mon1 |     "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz"
2026-05-08 04:21:22.593492 | mon1 | }
2026-05-08 04:21:22.593600 | mon1 |
2026-05-08 04:21:22.593768 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] *******************
2026-05-08 04:21:22.593893 | mon1 | Friday 08 May 2026  04:21:22 +0000 (0:00:00.069)       0:01:30.302 ************
2026-05-08 04:21:22.973707 | mon1 | ok: [osd1]
2026-05-08 04:21:22.973790 | mon1 |
2026-05-08 04:21:22.973805 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] *****************
2026-05-08 04:21:22.973956 | mon1 | Friday 08 May 2026  04:21:22 +0000 (0:00:00.380)       0:01:30.682 ************
2026-05-08 04:21:26.112640 | mon1 | ok: [osd1]
2026-05-08 04:21:26.112705 | mon1 |
2026-05-08 04:21:26.112779 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ******************
2026-05-08 04:21:26.112900 | mon1 | Friday 08 May 2026  04:21:26 +0000 (0:00:03.139)       0:01:33.821 ************
2026-05-08 04:21:27.117153 | mon1 | ok: [osd1]
2026-05-08 04:21:27.117227 | mon1 |
2026-05-08 04:21:27.117423 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] ***************
2026-05-08 04:21:27.117471 | mon1 | Friday 08 May 2026  04:21:27 +0000 (0:00:01.004)       0:01:34.826 ************
2026-05-08 04:21:27.303743 | mon1 | ok: [osd1]
2026-05-08 04:21:27.303817 | mon1 |
2026-05-08 04:21:27.304114 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] *****
2026-05-08 04:21:27.304158 | mon1 | Friday 08 May 2026  04:21:27 +0000 (0:00:00.186)       0:01:35.012 ************
2026-05-08 04:21:27.718687 | mon1 | ok: [osd1]
2026-05-08 04:21:27.718779 | mon1 |
2026-05-08 04:21:27.719142 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] ***********
2026-05-08 04:21:27.719163 | mon1 | Friday 08 May 2026  04:21:27 +0000 (0:00:00.415)       0:01:35.427 ************
2026-05-08 04:21:28.284586 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'})
2026-05-08 04:21:28.284662 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'})
2026-05-08 04:21:28.285132 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'})
2026-05-08 04:21:28.285181 | mon1 |
2026-05-08 04:21:28.285187 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ******
2026-05-08 04:21:28.285192 | mon1 | Friday 08 May 2026  04:21:28 +0000 (0:00:00.565)       0:01:35.993 ************
2026-05-08 04:21:28.717800 | mon1 | ok: [osd1]
2026-05-08 04:21:28.718073 | mon1 |
2026-05-08 04:21:28.718271 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] ***********
2026-05-08 04:21:28.718321 | mon1 | Friday 08 May 2026  04:21:28 +0000 (0:00:00.433)       0:01:36.426 ************
2026-05-08 04:21:29.163177 | mon1 | ok: [osd1]
2026-05-08 04:21:29.163265 | mon1 |
2026-05-08 04:21:29.163281 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************
2026-05-08 04:21:29.163712 | mon1 | Friday 08 May 2026  04:21:29 +0000 (0:00:00.438)       0:01:36.864 ************
2026-05-08 04:21:29.163772 | mon1 |
2026-05-08 04:21:29.163778 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] *******************
2026-05-08 04:21:29.163783 | mon1 | Friday 08 May 2026  04:21:29 +0000 (0:00:00.007)       0:01:36.872 ************
2026-05-08 04:21:29.545744 | mon1 | ok: [osd1]
2026-05-08 04:21:29.545824 | mon1 |
2026-05-08 04:21:29.545841 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ******
2026-05-08 04:21:29.546022 | mon1 | Friday 08 May 2026  04:21:29 +0000 (0:00:00.381)       0:01:37.254 ************
2026-05-08 04:21:29.590515 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/ubuntu-22.04.yml)
2026-05-08 04:21:29.590584 | mon1 |
2026-05-08 04:21:29.590799 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ********************************
2026-05-08 04:21:29.590852 | mon1 | Friday 08 May 2026  04:21:29 +0000 (0:00:00.045)       0:01:37.299 ************
2026-05-08 04:21:30.696720 | mon1 | ok: [osd1]
2026-05-08 04:21:30.696819 | mon1 |
2026-05-08 04:21:30.697191 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] *********************
2026-05-08 04:21:30.697306 | mon1 | Friday 08 May 2026  04:21:30 +0000 (0:00:01.106)       0:01:38.405 ************
2026-05-08 04:21:31.341015 | mon1 | ok: [osd1] => (item=chronyd)
2026-05-08 04:21:31.341192 | mon1 | ok: [osd1] => (item=sshd)
2026-05-08 04:21:31.341573 | mon1 |
2026-05-08 04:21:31.341631 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ******************************
2026-05-08 04:21:31.341638 | mon1 | Friday 08 May 2026  04:21:31 +0000 (0:00:00.644)       0:01:39.049 ************
2026-05-08 04:21:31.623041 | mon1 | ok: [osd1]
2026-05-08 04:21:31.623137 | mon1 |
2026-05-08 04:21:31.623275 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ********************
2026-05-08 04:21:31.623443 | mon1 | Friday 08 May 2026  04:21:31 +0000 (0:00:00.281)       0:01:39.331 ************
2026-05-08 04:21:31.823397 | mon1 | ok: [osd1]
2026-05-08 04:21:31.823583 | mon1 |
2026-05-08 04:21:31.823810 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] ****************
2026-05-08 04:21:31.824025 | mon1 | Friday 08 May 2026  04:21:31 +0000 (0:00:00.200)       0:01:39.531 ************
2026-05-08 04:21:32.062761 | mon1 | ok: [osd1]
2026-05-08 04:21:32.062914 | mon1 |
2026-05-08 04:21:32.063188 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] ***
2026-05-08 04:21:32.063493 | mon1 | Friday 08 May 2026  04:21:32 +0000 (0:00:00.239)       0:01:39.771 ************
2026-05-08 04:21:32.276022 | mon1 | ok: [osd1]
2026-05-08 04:21:32.276094 | mon1 |
2026-05-08 04:21:32.276282 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] **********************************
2026-05-08 04:21:32.276439 | mon1 | Friday 08 May 2026  04:21:32 +0000 (0:00:00.213)       0:01:39.984 ************
2026-05-08 04:21:32.491580 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1)
2026-05-08 04:21:32.491654 | mon1 |
2026-05-08 04:21:32.491813 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] ***********************************
2026-05-08 04:21:32.491955 | mon1 | Friday 08 May 2026  04:21:32 +0000 (0:00:00.215)       0:01:40.200 ************
2026-05-08 04:21:32.538015 | mon1 | ok: [osd1]
2026-05-08 04:21:32.538182 | mon1 |
2026-05-08 04:21:32.538394 | mon1 | TASK [Install Ceph host] *******************************************************
2026-05-08 04:21:32.538605 | mon1 | Friday 08 May 2026  04:21:32 +0000 (0:00:00.046)       0:01:40.246 ************
2026-05-08 04:21:32.603916 | mon1 | included: vexxhost.ceph.cephadm_host for osd1
2026-05-08 04:21:32.604080 | mon1 |
2026-05-08 04:21:32.604308 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ******
2026-05-08 04:21:32.604511 | mon1 | Friday 08 May 2026  04:21:32 +0000 (0:00:00.066)       0:01:40.312 ************
2026-05-08 04:21:38.573825 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:21:38.574039 | mon1 |
2026-05-08 04:21:38.574276 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] ***
2026-05-08 04:21:38.574484 | mon1 | Friday 08 May 2026  04:21:38 +0000 (0:00:05.969)       0:01:46.282 ************
2026-05-08 04:21:38.620372 | mon1 | ok: [osd1] => (item=osd1)
2026-05-08 04:21:38.620465 | mon1 |
2026-05-08 04:21:38.620611 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] ***********
2026-05-08 04:21:38.620734 | mon1 | Friday 08 May 2026  04:21:38 +0000 (0:00:00.046)       0:01:46.328 ************
2026-05-08 04:21:38.875652 | mon1 | ok: [osd1]
2026-05-08 04:21:38.875710 | mon1 |
2026-05-08 04:21:38.875813 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] ***********************
2026-05-08 04:21:38.875907 | mon1 | Friday 08 May 2026  04:21:38 +0000 (0:00:00.255)       0:01:46.584 ************
2026-05-08 04:21:45.237179 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:21:45.237242 | mon1 |
2026-05-08 04:21:45.237254 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] **********************
2026-05-08 04:21:45.237271 | mon1 | Friday 08 May 2026  04:21:45 +0000 (0:00:06.360)       0:01:52.945 ************
2026-05-08 04:21:50.601261 | mon1 | ok: [osd1]
2026-05-08 04:21:50.601345 | mon1 |
2026-05-08 04:21:50.601360 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] *******************
2026-05-08 04:21:50.601501 | mon1 | Friday 08 May 2026  04:21:50 +0000 (0:00:05.364)       0:01:58.310 ************
2026-05-08 04:22:12.693781 | mon1 | ok: [osd1]
2026-05-08 04:22:12.693863 | mon1 |
2026-05-08 04:22:12.693924 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] ****************************************
2026-05-08 04:22:12.694050 | mon1 | Friday 08 May 2026  04:22:12 +0000 (0:00:22.092)       0:02:20.402 ************
2026-05-08 04:22:12.758803 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data)
2026-05-08 04:22:12.758878 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data)
2026-05-08 04:22:12.759360 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data)
2026-05-08 04:22:12.759406 | mon1 | skipping: [osd1]
2026-05-08 04:22:12.759412 | mon1 |
2026-05-08 04:22:12.759417 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] ****************************************
2026-05-08 04:22:12.759422 | mon1 | Friday 08 May 2026  04:22:12 +0000 (0:00:00.064)       0:02:20.467 ************
2026-05-08 04:22:18.787495 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:18.787577 | mon1 |
2026-05-08 04:22:18.787808 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] ****************************
2026-05-08 04:22:18.787847 | mon1 | Friday 08 May 2026  04:22:18 +0000 (0:00:06.028)       0:02:26.496 ************
2026-05-08 04:22:24.747329 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:24.747445 | mon1 |
2026-05-08 04:22:24.747458 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] **********************
2026-05-08 04:22:24.747540 | mon1 | Friday 08 May 2026  04:22:24 +0000 (0:00:05.959)       0:02:32.456 ************
2026-05-08 04:22:24.800647 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1
2026-05-08 04:22:24.800710 | mon1 |
2026-05-08 04:22:24.800816 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] *********************************
2026-05-08 04:22:24.800903 | mon1 | Friday 08 May 2026  04:22:24 +0000 (0:00:00.053)       0:02:32.509 ************
2026-05-08 04:22:24.849529 | mon1 | ok: [osd1]
2026-05-08 04:22:24.849590 | mon1 |
2026-05-08 04:22:24.849804 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] **********************************
2026-05-08 04:22:24.849842 | mon1 | Friday 08 May 2026  04:22:24 +0000 (0:00:00.048)       0:02:32.558 ************
2026-05-08 04:22:30.841776 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})]
2026-05-08 04:22:30.842240 | mon1 |
2026-05-08 04:22:30.842324 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] *************************************
2026-05-08 04:22:30.842334 | mon1 | Friday 08 May 2026  04:22:30 +0000 (0:00:05.992)       0:02:38.550 ************
2026-05-08 04:22:30.876227 | mon1 | ok: [osd1]
2026-05-08 04:22:30.876302 | mon1 |
2026-05-08 04:22:30.876507 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] *************************
2026-05-08 04:22:30.876542 | mon1 | Friday 08 May 2026  04:22:30 +0000 (0:00:00.034)       0:02:38.585 ************
2026-05-08 04:22:30.910709 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:22:30.911498 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:22:30.911532 | mon1 | skipping: [osd1] => (item=1)
2026-05-08 04:22:30.911540 | mon1 | skipping: [osd1]
2026-05-08 04:22:30.911546 | mon1 |
2026-05-08 04:22:30.911553 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************
2026-05-08 04:22:30.911560 | mon1 | Friday 08 May 2026  04:22:30 +0000 (0:00:00.034)       0:02:38.619 ************
2026-05-08 04:22:30.941116 | mon1 | skipping: [osd1]
2026-05-08 04:22:30.941228 | mon1 |
2026-05-08 04:22:30.941331 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:22:30.941439 | mon1 | mon1                       : ok=49   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-05-08 04:22:30.943754 | mon1 | osd1                       : ok=48   changed=0    unreachable=0    failed=0    skipped=9    rescued=0    ignored=0
2026-05-08 04:22:30.943772 | mon1 |
2026-05-08 04:22:30.943777 | mon1 |
2026-05-08 04:22:30.943781 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:22:30.943786 | mon1 | Friday 08 May 2026  04:22:30 +0000 (0:00:00.030)       0:02:38.650 ************
2026-05-08 04:22:30.943790 | mon1 | ===============================================================================
2026-05-08 04:22:30.943794 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 22.09s
2026-05-08 04:22:30.943798 | mon1 | vexxhost.ceph.mon : Validate monitor exist ----------------------------- 14.00s
2026-05-08 04:22:30.943801 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.88s
2026-05-08 04:22:30.943805 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.36s
2026-05-08 04:22:30.943809 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.32s
2026-05-08 04:22:30.943813 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 6.32s
2026-05-08 04:22:30.943817 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 6.16s
2026-05-08 04:22:30.943821 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 6.09s
2026-05-08 04:22:30.943825 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 6.03s
2026-05-08 04:22:30.943829 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 6.01s
2026-05-08 04:22:30.943833 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 5.99s
2026-05-08 04:22:30.943837 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 5.98s
2026-05-08 04:22:30.943848 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 5.97s
2026-05-08 04:22:30.943852 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 5.96s
2026-05-08 04:22:30.943856 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.36s
2026-05-08 04:22:30.943860 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.14s
2026-05-08 04:22:30.943864 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.07s
2026-05-08 04:22:30.943868 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.20s
2026-05-08 04:22:30.943871 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.01s
2026-05-08 04:22:30.943875 | mon1 | vexxhost.ceph.cephadm : Ensure services are started --------------------- 1.64s
2026-05-08 04:22:31.026172 | mon1 | INFO     [default > idempotence] Executed: Successful
2026-05-08 04:22:31.037097 | mon1 | INFO     [default > side_effect] Executing
2026-05-08 04:22:31.037429 | mon1 | WARNING  [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:22:31.042388 | mon1 | INFO     [default > verify] Executing
2026-05-08 04:22:31.640608 | mon1 |
2026-05-08 04:22:31.640854 | mon1 | PLAY [Verify] ******************************************************************
2026-05-08 04:22:31.641036 | mon1 |
2026-05-08 04:22:31.641264 | mon1 | TASK [Gathering Facts] *********************************************************
2026-05-08 04:22:31.641439 | mon1 | Friday 08 May 2026  04:22:31 +0000 (0:00:00.006)       0:00:00.006 ************
2026-05-08 04:22:32.722393 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python
2026-05-08 04:22:32.722458 | mon1 | interpreter at /usr/bin/python3.10, but future installation of another Python
2026-05-08 04:22:32.722472 | mon1 | interpreter could change the meaning of that path. See
2026-05-08 04:22:32.722482 | mon1 | https://docs.ansible.com/ansible-
2026-05-08 04:22:32.722492 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information.
2026-05-08 04:22:32.734382 | mon1 | ok: [mon1]
2026-05-08 04:22:32.734414 | mon1 |
2026-05-08 04:22:32.734426 | mon1 | TASK [Get cluster health status] ***********************************************
2026-05-08 04:22:32.734436 | mon1 | Friday 08 May 2026  04:22:32 +0000 (0:00:01.093)       0:00:01.100 ************
2026-05-08 04:22:42.917110 | mon1 | ok: [mon1]
2026-05-08 04:22:42.917153 | mon1 |
2026-05-08 04:22:42.917305 | mon1 | TASK [Print cluster health status] *********************************************
2026-05-08 04:22:42.917521 | mon1 | Friday 08 May 2026  04:22:42 +0000 (0:00:10.182)       0:00:11.282 ************
2026-05-08 04:22:42.940445 | mon1 | ok: [mon1] => {
2026-05-08 04:22:42.940565 | mon1 |     "_ceph_health": {
2026-05-08 04:22:42.940777 | mon1 |         "changed": false,
2026-05-08 04:22:42.940984 | mon1 |         "cmd": [
2026-05-08 04:22:42.941247 | mon1 |             "cephadm",
2026-05-08 04:22:42.941443 | mon1 |             "shell",
2026-05-08 04:22:42.941629 | mon1 |             "--",
2026-05-08 04:22:42.941805 | mon1 |             "ceph",
2026-05-08 04:22:42.941986 | mon1 |             "health"
2026-05-08 04:22:42.942212 | mon1 |         ],
2026-05-08 04:22:42.942370 | mon1 |         "delta": "0:00:09.915361",
2026-05-08 04:22:42.942557 | mon1 |         "end": "2026-05-08 04:22:42.877683",
2026-05-08 04:22:42.942741 | mon1 |         "failed": false,
2026-05-08 04:22:42.942924 | mon1 |         "msg": "",
2026-05-08 04:22:42.943106 | mon1 |         "rc": 0,
2026-05-08 04:22:42.943294 | mon1 |         "start": "2026-05-08 04:22:32.962322",
2026-05-08 04:22:42.943506 | mon1 |         "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config",
2026-05-08 04:22:42.943692 | mon1 |         "stderr_lines": [
2026-05-08 04:22:42.943920 | mon1 |             "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2",
2026-05-08 04:22:42.944126 | mon1 |             "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config"
2026-05-08 04:22:42.944312 | mon1 |         ],
2026-05-08 04:22:42.944503 | mon1 |         "stdout": "HEALTH_OK",
2026-05-08 04:22:42.944692 | mon1 |         "stdout_lines": [
2026-05-08 04:22:42.944876 | mon1 |             "HEALTH_OK"
2026-05-08 04:22:42.945121 | mon1 |         ]
2026-05-08 04:22:42.945318 | mon1 |     }
2026-05-08 04:22:42.945503 | mon1 | }
2026-05-08 04:22:42.945680 | mon1 |
2026-05-08 04:22:42.945876 | mon1 | TASK [Assert that the cluster status is healthy] *******************************
2026-05-08 04:22:42.946069 | mon1 | Friday 08 May 2026  04:22:42 +0000 (0:00:00.023)       0:00:11.306 ************
2026-05-08 04:22:42.967203 | mon1 | ok: [mon1] => {
2026-05-08 04:22:42.967377 | mon1 |     "changed": false,
2026-05-08 04:22:42.967606 | mon1 |     "msg": "All assertions passed"
2026-05-08 04:22:42.967800 | mon1 | }
2026-05-08 04:22:42.967975 | mon1 |
2026-05-08 04:22:42.968128 | mon1 | TASK [Create a test Ceph pool] *************************************************
2026-05-08 04:22:42.968247 | mon1 | Friday 08 May 2026  04:22:42 +0000 (0:00:00.027)       0:00:11.333 ************
2026-05-08 04:22:49.151350 | mon1 | changed: [mon1]
2026-05-08 04:22:49.151418 | mon1 |
2026-05-08 04:22:49.151430 | mon1 | TASK [Create a test Ceph key] **************************************************
2026-05-08 04:22:49.151441 | mon1 | Friday 08 May 2026  04:22:49 +0000 (0:00:06.183)       0:00:17.516 ************
2026-05-08 04:22:51.482862 | mon1 | changed: [mon1]
2026-05-08 04:22:51.482945 | mon1 |
2026-05-08 04:22:51.483128 | mon1 | TASK [Retrieve info for the test Ceph key] *************************************
2026-05-08 04:22:51.483175 | mon1 | Friday 08 May 2026  04:22:51 +0000 (0:00:02.331)       0:00:19.848 ************
2026-05-08 04:22:52.692288 | mon1 | ok: [mon1]
2026-05-08 04:22:52.692362 | mon1 |
2026-05-08 04:22:52.692699 | mon1 | TASK [Assert that key_info returns the correct key] ****************************
2026-05-08 04:22:52.692787 | mon1 | Friday 08 May 2026  04:22:52 +0000 (0:00:01.209)       0:00:21.058 ************
2026-05-08 04:22:52.727519 | mon1 | ok: [mon1] => {
2026-05-08 04:22:52.729135 | mon1 |     "changed": false,
2026-05-08 04:22:52.729342 | mon1 |     "msg": "All assertions passed"
2026-05-08 04:22:52.729351 | mon1 | }
2026-05-08 04:22:52.729356 | mon1 |
2026-05-08 04:22:52.729361 | mon1 | PLAY RECAP *********************************************************************
2026-05-08 04:22:52.729367 | mon1 | mon1                       : ok=8    changed=2    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0
2026-05-08 04:22:52.729372 | mon1 |
2026-05-08 04:22:52.729381 | mon1 |
2026-05-08 04:22:52.729480 | mon1 | TASKS RECAP ********************************************************************
2026-05-08 04:22:52.729707 | mon1 | Friday 08 May 2026  04:22:52 +0000 (0:00:00.035)       0:00:21.093 ************
2026-05-08 04:22:52.729904 | mon1 | ===============================================================================
2026-05-08 04:22:52.730134 | mon1 | Get cluster health status ---------------------------------------------- 10.18s
2026-05-08 04:22:52.730347 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.18s
2026-05-08 04:22:52.730551 | mon1 | Create a test Ceph key -------------------------------------------------- 2.33s
2026-05-08 04:22:52.730757 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.21s
2026-05-08 04:22:52.730965 | mon1 | Gathering Facts --------------------------------------------------------- 1.09s
2026-05-08 04:22:52.731171 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.04s
2026-05-08 04:22:52.731376 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.03s
2026-05-08 04:22:52.731582 | mon1 | Print cluster health status --------------------------------------------- 0.02s
2026-05-08 04:22:52.828139 | mon1 | INFO     [default > verify] Executed: Successful
2026-05-08 04:22:52.838101 | mon1 | INFO     [default > cleanup] Executing
2026-05-08 04:22:52.838470 | mon1 | WARNING  [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress)
2026-05-08 04:22:52.846006 | mon1 | INFO     [default > destroy] Executing
2026-05-08 04:22:52.846049 | mon1 | WARNING  [default > destroy] Skipping, '--destroy=never' requested.
2026-05-08 04:22:52.846106 | mon1 | INFO     [default > destroy] Executed: Successful
2026-05-08 04:22:52.846455 | mon1 | WARNING  Molecule executed 1 scenario (1 missing files)
2026-05-08 04:23:03.224669 | mon1 | ok: Runtime: 0:12:06.828096
2026-05-08 04:23:03.237984 | 
2026-05-08 04:23:03.238040 | PLAY RECAP
2026-05-08 04:23:03.238085 | mon1 | ok: 3 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-05-08 04:23:03.238107 | 
2026-05-08 04:23:03.369509 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main]
2026-05-08 04:23:03.374271 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-08 04:23:04.010387 | 
2026-05-08 04:23:04.010532 | PLAY [all]
2026-05-08 04:23:04.022510 | 
2026-05-08 04:23:04.022607 | TASK [fetch-output : Set log path for multiple nodes]
2026-05-08 04:23:04.076906 | mon1 | ok
2026-05-08 04:23:04.084456 | osd1 | ok
2026-05-08 04:23:04.090332 | 
2026-05-08 04:23:04.090409 | TASK [fetch-output : Set log path for single node]
2026-05-08 04:23:04.116507 | mon1 | skipping: Conditional result was False
2026-05-08 04:23:04.127887 | osd1 | skipping: Conditional result was False
2026-05-08 04:23:04.136883 | 
2026-05-08 04:23:04.137034 | LOOP [fetch-output : Ensure local output dirs]
2026-05-08 04:23:04.529191 | osd1 -> localhost | changed: "/var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/logs/osd1"
2026-05-08 04:23:04.534520 | mon1 -> localhost | changed: "/var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/logs/mon1"
2026-05-08 04:23:04.738642 | osd1 -> localhost | changed: "/var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/artifacts"
2026-05-08 04:23:04.744359 | mon1 -> localhost | ok: "/var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/artifacts"
2026-05-08 04:23:04.955858 | osd1 -> localhost | changed: "/var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/docs"
2026-05-08 04:23:04.957433 | mon1 -> localhost | ok: "/var/lib/zuul/builds/4e0c3bb33a334364b11c528ed301a742/work/docs"
2026-05-08 04:23:04.974520 | 
2026-05-08 04:23:04.974714 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-05-08 04:23:05.593992 | mon1 | changed: .d..t...... ./
2026-05-08 04:23:05.594310 | mon1 | changed: All items complete
2026-05-08 04:23:05.594351 | 
2026-05-08 04:23:05.616190 | osd1 | changed: .d..t...... ./
2026-05-08 04:23:06.035360 | mon1 | changed: .d..t...... ./
2026-05-08 04:23:06.068768 | osd1 | ok
2026-05-08 04:23:06.471194 | mon1 | changed: .d..t...... ./
2026-05-08 04:23:06.516312 | osd1 | ok
2026-05-08 04:23:06.534777 | 
2026-05-08 04:23:06.534846 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-05-08 04:23:06.957353 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007512
2026-05-08 04:23:06.957649 | mon1 -> localhost | changed: All items complete
2026-05-08 04:23:06.957696 | 
2026-05-08 04:23:07.187190 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.009015
2026-05-08 04:23:07.211877 | 
2026-05-08 04:23:07.212004 | PLAY [all]
2026-05-08 04:23:07.223957 | 
2026-05-08 04:23:07.224044 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-05-08 04:23:07.635399 | mon1 | changed
2026-05-08 04:23:07.807322 | osd1 | changed
2026-05-08 04:23:07.819525 | 
2026-05-08 04:23:07.819576 | PLAY RECAP
2026-05-08 04:23:07.819625 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-08 04:23:07.819654 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-05-08 04:23:07.819673 | 
2026-05-08 04:23:07.967331 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-05-08 04:23:07.972721 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-05-08 04:23:08.562294 | 
2026-05-08 04:23:08.562478 | PLAY [localhost]
2026-05-08 04:23:08.572923 | 
2026-05-08 04:23:08.573078 | TASK [Generate Zuul manifest]
2026-05-08 04:23:08.593692 | localhost | ok
2026-05-08 04:23:08.613582 | 
2026-05-08 04:23:08.613684 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-05-08 04:23:09.003057 | localhost | changed
2026-05-08 04:23:09.016435 | 
2026-05-08 04:23:09.016508 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-05-08 04:23:09.047654 | localhost | ok
2026-05-08 04:23:09.056484 | 
2026-05-08 04:23:09.056567 | TASK [Upload logs]
2026-05-08 04:23:09.077324 | localhost | ok
2026-05-08 04:23:09.135594 | 
2026-05-08 04:23:09.135723 | TASK [Set zuul-log-path fact]
2026-05-08 04:23:09.156870 | localhost | ok
2026-05-08 04:23:09.172431 | 
2026-05-08 04:23:09.172496 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-05-08 04:23:09.204791 | localhost | ok
2026-05-08 04:23:09.213845 | 
2026-05-08 04:23:09.213909 | TASK [upload-logs : Create log directories]
2026-05-08 04:23:09.641931 | localhost | changed
2026-05-08 04:23:09.648771 | 
2026-05-08 04:23:09.648846 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-05-08 04:23:10.047547 | localhost -> localhost | ok: Runtime: 0:00:00.005802
2026-05-08 04:23:10.056383 | 
2026-05-08 04:23:10.056471 | TASK [upload-logs : Upload logs to log server]
2026-05-08 04:23:10.515401 | localhost | Output suppressed because no_log was given
2026-05-08 04:23:10.519601 | 
2026-05-08 04:23:10.519667 | LOOP [upload-logs : Compress console log and json output]
2026-05-08 04:23:10.611828 | localhost | skipping: Conditional result was False
2026-05-08 04:23:10.619830 | localhost | skipping: Conditional result was False
2026-05-08 04:23:10.636179 | 
2026-05-08 04:23:10.636379 | LOOP [upload-logs : Upload compressed console log and json output]
2026-05-08 04:23:10.722678 | localhost | skipping: Conditional result was False
2026-05-08 04:23:10.723096 | 
2026-05-08 04:23:10.726631 | localhost | skipping: Conditional result was False
2026-05-08 04:23:10.784439 | 
2026-05-08 04:23:10.784616 | LOOP [upload-logs : Upload console log and json output]