2026-08-24 15:29:45.081365 | Job console starting 2026-08-24 15:29:45.098187 | Updating git repos 2026-08-24 15:29:45.140708 | Cloning repos into workspace 2026-08-24 15:29:45.194409 | Restoring repo states 2026-08-24 15:29:45.202816 | Merging changes 2026-08-24 15:29:45.667363 | Checking out repos 2026-08-24 15:29:45.714277 | Preparing playbooks 2026-08-24 15:29:47.487559 | Running Ansible setup 2026-08-24 15:29:52.722337 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-24 15:29:53.583572 | 2026-08-24 15:29:53.583693 | PLAY [localhost] 2026-08-24 15:29:53.593086 | 2026-08-24 15:29:53.593196 | TASK [Gathering Facts] 2026-08-24 15:29:54.762369 | localhost | ok 2026-08-24 15:29:54.777774 | 2026-08-24 15:29:54.778008 | TASK [Setup log path fact] 2026-08-24 15:29:54.812223 | localhost | ok 2026-08-24 15:29:54.830776 | 2026-08-24 15:29:54.830997 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-24 15:29:54.863978 | localhost | ok 2026-08-24 15:29:54.873157 | 2026-08-24 15:29:54.873279 | TASK [emit-job-header : Print job information] 2026-08-24 15:29:54.917769 | # Job Information 2026-08-24 15:29:54.918036 | Ansible Version: 2.16.18 2026-08-24 15:29:54.918090 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble 2026-08-24 15:29:54.918131 | Pipeline: check 2026-08-24 15:29:54.918162 | Executor: 2d72f0692154 2026-08-24 15:29:54.918198 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/124 2026-08-24 15:29:54.918241 | Event ID: 6d3ab780-9fce-11f1-9599-8502feacb559 2026-08-24 15:29:54.922613 | 2026-08-24 15:29:54.922722 | LOOP [emit-job-header : Print node information] 2026-08-24 15:29:55.032474 | localhost | ok: 2026-08-24 15:29:55.032906 | localhost | # Node Information 2026-08-24 15:29:55.032978 | localhost | Inventory Hostname: mon1 2026-08-24 15:29:55.033016 | localhost | Hostname: np0000190887 2026-08-24 15:29:55.033045 | localhost | Username: zuul 2026-08-24 15:29:55.033076 | localhost | Distro: Ubuntu 24.04 2026-08-24 15:29:55.033103 | localhost | Provider: yul1 2026-08-24 15:29:55.033129 | localhost | Region: ca-ymq-1 2026-08-24 15:29:55.033155 | localhost | Label: ubuntu-noble 2026-08-24 15:29:55.033181 | localhost | Product Name: OpenStack Nova 2026-08-24 15:29:55.033208 | localhost | Interface IP: 199.19.213.20 2026-08-24 15:29:55.112761 | localhost | ok: 2026-08-24 15:29:55.112913 | localhost | # Node Information 2026-08-24 15:29:55.115437 | localhost | Inventory Hostname: osd1 2026-08-24 15:29:55.115544 | localhost | Hostname: np0000190888 2026-08-24 15:29:55.115620 | localhost | Username: zuul 2026-08-24 15:29:55.115700 | localhost | Distro: Ubuntu 24.04 2026-08-24 15:29:55.115789 | localhost | Provider: yul1 2026-08-24 15:29:55.115871 | localhost | Region: ca-ymq-1 2026-08-24 15:29:55.115943 | localhost | Label: ubuntu-noble 2026-08-24 15:29:55.115983 | localhost | Product Name: OpenStack Nova 2026-08-24 15:29:55.116057 | localhost | Interface IP: 199.19.213.66 2026-08-24 15:29:55.130660 | 2026-08-24 15:29:55.130804 | TASK [log-inventory : Ensure Zuul Ansible directory exists] 2026-08-24 15:29:55.530414 | localhost -> localhost | changed 2026-08-24 15:29:55.539773 | 2026-08-24 15:29:55.540378 | TASK [log-inventory : Copy ansible inventory to logs dir] 2026-08-24 15:29:56.537746 | localhost -> localhost | changed 2026-08-24 15:29:56.545742 | 2026-08-24 15:29:56.545836 | PLAY [all] 2026-08-24 15:29:56.559397 | 2026-08-24 15:29:56.559522 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build] 2026-08-24 15:29:56.792645 | mon1 -> localhost | ok 2026-08-24 15:29:56.799564 | 2026-08-24 15:29:56.799637 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID] 2026-08-24 15:29:56.837918 | mon1 | ok 2026-08-24 15:29:56.843767 | osd1 | ok 2026-08-24 15:29:56.862295 | mon1 | included: /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-24 15:29:56.862379 | osd1 | included: /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml 2026-08-24 15:29:56.870692 | 2026-08-24 15:29:56.870763 | TASK [add-build-sshkey : Create Temp SSH key] 2026-08-24 15:29:59.149044 | mon1 -> localhost | Generating public/private rsa key pair. 2026-08-24 15:29:59.149207 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/7482d67de3244ef38cbfa266d1cc8906_id_rsa 2026-08-24 15:29:59.149273 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/7482d67de3244ef38cbfa266d1cc8906_id_rsa.pub 2026-08-24 15:29:59.149301 | mon1 -> localhost | The key fingerprint is: 2026-08-24 15:29:59.149344 | mon1 -> localhost | SHA256:vtC6LNl7L0/V5cWtzSUheYrbweHJNj/+qKJXGbgPmGM zuul-build-sshkey 2026-08-24 15:29:59.149371 | mon1 -> localhost | The key's randomart image is: 2026-08-24 15:29:59.149394 | mon1 -> localhost | +---[RSA 3072]----+ 2026-08-24 15:29:59.149414 | mon1 -> localhost | | ... | 2026-08-24 15:29:59.149435 | mon1 -> localhost | | o..o.| 2026-08-24 15:29:59.149456 | mon1 -> localhost | | * =. *| 2026-08-24 15:29:59.149477 | mon1 -> localhost | | o @. Bo| 2026-08-24 15:29:59.149497 | mon1 -> localhost | | So =.*o +| 2026-08-24 15:29:59.149518 | mon1 -> localhost | | oE +.+ o | 2026-08-24 15:29:59.149537 | mon1 -> localhost | | o..o..+ . . | 2026-08-24 15:29:59.149556 | mon1 -> localhost | | o..oooo . .. | 2026-08-24 15:29:59.149576 | mon1 -> localhost | | .=+o*o......| 2026-08-24 15:29:59.149596 | mon1 -> localhost | +----[SHA256]-----+ 2026-08-24 15:29:59.149645 | mon1 -> localhost | ok: Runtime: 0:00:01.825324 2026-08-24 15:29:59.155603 | 2026-08-24 15:29:59.155670 | TASK [add-build-sshkey : Remote setup ssh keys (linux)] 2026-08-24 15:29:59.189488 | mon1 | ok 2026-08-24 15:29:59.196273 | osd1 | ok 2026-08-24 15:29:59.209954 | mon1 | included: /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-24 15:29:59.210043 | osd1 | included: /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml 2026-08-24 15:29:59.224189 | 2026-08-24 15:29:59.224299 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey] 2026-08-24 15:29:59.250653 | mon1 | skipping: Conditional result was False 2026-08-24 15:29:59.262061 | osd1 | skipping: Conditional result was False 2026-08-24 15:29:59.272393 | 2026-08-24 15:29:59.272505 | TASK [add-build-sshkey : Enable access via build key on all nodes] 2026-08-24 15:29:59.817569 | mon1 | changed 2026-08-24 15:29:59.848825 | osd1 | changed 2026-08-24 15:29:59.857186 | 2026-08-24 15:29:59.857285 | TASK [add-build-sshkey : Make sure user has a .ssh] 2026-08-24 15:30:00.086205 | mon1 | ok 2026-08-24 15:30:00.169629 | osd1 | ok 2026-08-24 15:30:00.180506 | 2026-08-24 15:30:00.180674 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes] 2026-08-24 15:30:01.104710 | mon1 | changed 2026-08-24 15:30:01.119678 | osd1 | changed 2026-08-24 15:30:01.126263 | 2026-08-24 15:30:01.126339 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes] 2026-08-24 15:30:01.729800 | mon1 | changed 2026-08-24 15:30:01.759373 | osd1 | changed 2026-08-24 15:30:01.768157 | 2026-08-24 15:30:01.768251 | TASK [add-build-sshkey : Remote setup ssh keys (windows)] 2026-08-24 15:30:01.794737 | mon1 | skipping: Conditional result was False 2026-08-24 15:30:01.797050 | osd1 | skipping: Conditional result was False 2026-08-24 15:30:01.808755 | 2026-08-24 15:30:01.808886 | TASK [remove-zuul-sshkey : Remove master key from local agent] 2026-08-24 15:30:02.834995 | mon1 -> localhost | changed 2026-08-24 15:30:02.860309 | 2026-08-24 15:30:02.860471 | TASK [add-build-sshkey : Add back temp key] 2026-08-24 15:30:03.351335 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/7482d67de3244ef38cbfa266d1cc8906_id_rsa (zuul-build-sshkey) 2026-08-24 15:30:03.351609 | mon1 -> localhost | ok: Runtime: 0:00:00.199918 2026-08-24 15:30:03.358516 | 2026-08-24 15:30:03.358645 | TASK [add-build-sshkey : Verify we can still SSH to all nodes] 2026-08-24 15:30:03.933517 | osd1 | ok 2026-08-24 15:30:03.942613 | mon1 | ok 2026-08-24 15:30:03.949273 | 2026-08-24 15:30:03.949419 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)] 2026-08-24 15:30:03.981090 | mon1 | skipping: Conditional result was False 2026-08-24 15:30:03.992730 | osd1 | skipping: Conditional result was False 2026-08-24 15:30:04.018717 | 2026-08-24 15:30:04.018922 | TASK [prepare-workspace : Start zuul_console daemon.] 2026-08-24 15:30:04.399433 | mon1 | ok 2026-08-24 15:30:04.419106 | osd1 | ok 2026-08-24 15:30:04.430031 | 2026-08-24 15:30:04.430147 | TASK [prepare-workspace : Synchronize src repos to workspace directory.] 2026-08-24 15:30:06.538514 | osd1 | Output suppressed because no_log was given 2026-08-24 15:30:06.545163 | mon1 | Output suppressed because no_log was given 2026-08-24 15:30:06.566229 | 2026-08-24 15:30:06.566366 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them] 2026-08-24 15:30:06.793487 | mon1 | ok: "logs" 2026-08-24 15:30:06.793856 | mon1 | ok: All items complete 2026-08-24 15:30:06.793897 | 2026-08-24 15:30:06.805661 | osd1 | ok: "logs" 2026-08-24 15:30:06.996559 | mon1 | ok: "artifacts" 2026-08-24 15:30:07.009275 | osd1 | ok: "artifacts" 2026-08-24 15:30:07.199333 | mon1 | ok: "docs" 2026-08-24 15:30:07.219551 | osd1 | ok: "docs" 2026-08-24 15:30:07.237072 | 2026-08-24 15:30:07.237241 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist] 2026-08-24 15:30:07.470869 | osd1 | changed: "logs" 2026-08-24 15:30:07.471149 | osd1 | ok: All items complete 2026-08-24 15:30:07.471198 | 2026-08-24 15:30:07.479742 | mon1 | changed: "logs" 2026-08-24 15:30:07.673437 | osd1 | changed: "artifacts" 2026-08-24 15:30:07.685626 | mon1 | changed: "artifacts" 2026-08-24 15:30:07.876111 | osd1 | changed: "docs" 2026-08-24 15:30:07.884817 | mon1 | changed: "docs" 2026-08-24 15:30:07.907083 | 2026-08-24 15:30:07.907242 | PLAY RECAP 2026-08-24 15:30:07.907299 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-24 15:30:07.907333 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-24 15:30:07.907359 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0 2026-08-24 15:30:07.907379 | 2026-08-24 15:30:08.071941 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main] 2026-08-24 15:30:08.076855 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-24 15:30:08.770484 | 2026-08-24 15:30:08.770599 | PLAY [all] 2026-08-24 15:30:08.782687 | 2026-08-24 15:30:08.782806 | TASK [setup-uv : Extract archive] 2026-08-24 15:30:11.203233 | osd1 | changed 2026-08-24 15:30:11.377826 | mon1 | changed 2026-08-24 15:30:11.387577 | 2026-08-24 15:30:11.387670 | TASK [setup-uv : Print version] 2026-08-24 15:30:11.808346 | mon1 | uv 0.8.13 2026-08-24 15:30:11.835471 | osd1 | uv 0.8.13 2026-08-24 15:30:11.959131 | mon1 | ok: Runtime: 0:00:00.014292 2026-08-24 15:30:11.969861 | osd1 | ok: Runtime: 0:00:00.015974 2026-08-24 15:30:11.986661 | 2026-08-24 15:30:11.986783 | TASK [Install Ansible collection siblings] 2026-08-24 15:30:12.404309 | mon1 | ok: 2026-08-24 15:30:12.404561 | mon1 | Skipping community.general: no checked-out sibling 2026-08-24 15:30:12.404593 | mon1 | Skipping ansible.utils: no checked-out sibling 2026-08-24 15:30:12.404615 | mon1 | Skipping vexxhost.containers: no checked-out sibling 2026-08-24 15:30:12.406586 | 2026-08-24 15:30:12.406636 | PLAY RECAP 2026-08-24 15:30:12.406683 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-24 15:30:12.406724 | osd1 | ok: 2 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-24 15:30:12.406744 | 2026-08-24 15:30:12.565901 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main] 2026-08-24 15:30:12.571304 | RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-24 15:30:13.187724 | 2026-08-24 15:30:13.187857 | PLAY [all] 2026-08-24 15:30:13.200050 | 2026-08-24 15:30:13.200145 | LOOP [Check inventory directories] 2026-08-24 15:30:13.583004 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-24 15:30:13.775004 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/molecule/default/inventory" 2026-08-24 15:30:13.960753 | mon1 | ok: "src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/inventory" 2026-08-24 15:30:13.971401 | 2026-08-24 15:30:13.971522 | LOOP [Copy inventory file for Zuul] 2026-08-24 15:30:14.994219 | mon1 | changed: 2026-08-24 15:30:14.994456 | mon1 | { 2026-08-24 15:30:14.994516 | mon1 | "ansible_loop_var": "item", 2026-08-24 15:30:14.994554 | mon1 | "changed": false, 2026-08-24 15:30:14.994585 | mon1 | "failed": false, 2026-08-24 15:30:14.994619 | mon1 | "invocation": { 2026-08-24 15:30:14.994650 | mon1 | "module_args": { 2026-08-24 15:30:14.994678 | mon1 | "checksum_algorithm": "sha1", 2026-08-24 15:30:14.994707 | mon1 | "follow": true, 2026-08-24 15:30:14.994735 | mon1 | "get_attributes": true, 2026-08-24 15:30:14.994772 | mon1 | "get_checksum": true, 2026-08-24 15:30:14.994813 | mon1 | "get_mime": true, 2026-08-24 15:30:14.994854 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph" 2026-08-24 15:30:14.994891 | mon1 | } 2026-08-24 15:30:14.994928 | mon1 | }, 2026-08-24 15:30:14.994960 | mon1 | "item": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-24 15:30:14.994987 | mon1 | "stat": { 2026-08-24 15:30:14.995013 | mon1 | "atime": 1787585406.4231787, 2026-08-24 15:30:14.995043 | mon1 | "attr_flags": "e", 2026-08-24 15:30:14.995070 | mon1 | "attributes": [ 2026-08-24 15:30:14.995096 | mon1 | "extents" 2026-08-24 15:30:14.995124 | mon1 | ], 2026-08-24 15:30:14.995150 | mon1 | "block_size": 4096, 2026-08-24 15:30:14.995178 | mon1 | "blocks": 8, 2026-08-24 15:30:14.995205 | mon1 | "charset": "unknown", 2026-08-24 15:30:14.995234 | mon1 | "ctime": 1787585406.4381804, 2026-08-24 15:30:14.995262 | mon1 | "dev": 64769, 2026-08-24 15:30:14.995288 | mon1 | "device_type": 0, 2026-08-24 15:30:14.995315 | mon1 | "executable": true, 2026-08-24 15:30:14.995341 | mon1 | "exists": true, 2026-08-24 15:30:14.995368 | mon1 | "gid": 1000, 2026-08-24 15:30:14.995395 | mon1 | "gr_name": "zuul", 2026-08-24 15:30:14.995420 | mon1 | "inode": 1034272, 2026-08-24 15:30:14.995446 | mon1 | "isblk": false, 2026-08-24 15:30:14.995477 | mon1 | "ischr": false, 2026-08-24 15:30:14.995515 | mon1 | "isdir": true, 2026-08-24 15:30:14.995546 | mon1 | "isfifo": false, 2026-08-24 15:30:14.995573 | mon1 | "isgid": false, 2026-08-24 15:30:14.995600 | mon1 | "islnk": false, 2026-08-24 15:30:14.995626 | mon1 | "isreg": false, 2026-08-24 15:30:14.995653 | mon1 | "issock": false, 2026-08-24 15:30:14.995679 | mon1 | "isuid": false, 2026-08-24 15:30:14.995705 | mon1 | "mimetype": "unknown", 2026-08-24 15:30:14.995731 | mon1 | "mode": "0755", 2026-08-24 15:30:14.995762 | mon1 | "mtime": 1787585385.2258542, 2026-08-24 15:30:14.995798 | mon1 | "nlink": 10, 2026-08-24 15:30:14.995837 | mon1 | "path": "src/github.com/vexxhost/ansible-collection-ceph", 2026-08-24 15:30:14.995872 | mon1 | "pw_name": "zuul", 2026-08-24 15:30:14.995915 | mon1 | "readable": true, 2026-08-24 15:30:14.995955 | mon1 | "rgrp": true, 2026-08-24 15:30:14.996174 | mon1 | "roth": true, 2026-08-24 15:30:14.996209 | mon1 | "rusr": true, 2026-08-24 15:30:14.996230 | mon1 | "size": 4096, 2026-08-24 15:30:14.996260 | mon1 | "uid": 1000, 2026-08-24 15:30:14.996279 | mon1 | "version": "1658014350", 2026-08-24 15:30:14.996298 | mon1 | "wgrp": false, 2026-08-24 15:30:14.996317 | mon1 | "woth": false, 2026-08-24 15:30:14.996336 | mon1 | "writeable": true, 2026-08-24 15:30:14.996353 | mon1 | "wusr": true, 2026-08-24 15:30:14.996370 | mon1 | "xgrp": true, 2026-08-24 15:30:14.996387 | mon1 | "xoth": true, 2026-08-24 15:30:14.996404 | mon1 | "xusr": true 2026-08-24 15:30:14.996421 | mon1 | } 2026-08-24 15:30:14.996438 | mon1 | } 2026-08-24 15:30:14.996476 | mon1 | ok: All items complete 2026-08-24 15:30:14.996506 | 2026-08-24 15:30:14.998237 | mon1 | skipping: Conditional result was False 2026-08-24 15:30:14.998950 | mon1 | skipping: Conditional result was False 2026-08-24 15:30:15.012927 | 2026-08-24 15:30:15.013082 | LOOP [Switch "ansible_host" to private IP] 2026-08-24 15:30:15.461956 | mon1 | changed: 2 replacements made 2026-08-24 15:30:15.463868 | mon1 | skipping: Conditional result was False 2026-08-24 15:30:15.464741 | mon1 | skipping: Conditional result was False 2026-08-24 15:30:15.482524 | 2026-08-24 15:30:15.482623 | TASK [Run Molecule scenario] 2026-08-24 15:30:16.005298 | mon1 | Using CPython 3.12.3 interpreter at: /usr/bin/python3 2026-08-24 15:30:16.005435 | mon1 | Creating virtual environment at: .venv 2026-08-24 15:30:16.293374 | mon1 | Downloading pygments (1.2MiB) 2026-08-24 15:30:16.293739 | mon1 | Downloading ansible-core (2.1MiB) 2026-08-24 15:30:16.295519 | mon1 | Downloading cryptography (4.3MiB) 2026-08-24 15:30:16.296712 | mon1 | Downloading netaddr (2.2MiB) 2026-08-24 15:30:16.490886 | mon1 | Downloading netaddr 2026-08-24 15:30:16.502910 | mon1 | Downloading cryptography 2026-08-24 15:30:16.558133 | mon1 | Downloading pygments 2026-08-24 15:30:16.681923 | mon1 | Downloading ansible-core 2026-08-24 15:30:16.726394 | mon1 | Installed 37 packages in 43ms 2026-08-24 15:30:17.521603 | mon1 | INFO Collection 'vexxhost.ceph' detected. 2026-08-24 15:30:17.521693 | mon1 | INFO Scenarios will be used from 'extensions/molecule' 2026-08-24 15:30:18.147879 | mon1 | INFO [default > discovery] scenario test matrix: dependency, cleanup, destroy, syntax, create, prepare, converge, idempotence, side_effect, verify, cleanup, destroy 2026-08-24 15:30:18.147967 | mon1 | INFO [default > prerun] Performing prerun with role_name_check=0... 2026-08-24 15:31:36.495023 | mon1 | INFO [default > dependency] Executing 2026-08-24 15:31:36.495237 | mon1 | WARNING [default > dependency] Missing roles requirements file: requirements.yml 2026-08-24 15:31:36.495527 | mon1 | WARNING [default > dependency] Missing collections requirements file: collections.yml 2026-08-24 15:31:36.495702 | mon1 | WARNING [default > dependency] Executed: 2 missing (Remove from test_sequence to suppress) 2026-08-24 15:31:36.503755 | mon1 | INFO [default > cleanup] Executing 2026-08-24 15:31:36.504120 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-24 15:31:36.509917 | mon1 | INFO [default > destroy] Executing 2026-08-24 15:31:36.509963 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-24 15:31:36.509982 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-24 15:31:36.515697 | mon1 | INFO [default > syntax] Executing 2026-08-24 15:31:37.720854 | mon1 | 2026-08-24 15:31:37.720983 | mon1 | playbook: /home/zuul/src/github.com/vexxhost/ansible-collection-ceph/extensions/molecule/default/converge.yml 2026-08-24 15:31:37.785625 | mon1 | INFO [default > syntax] Executed: Successful 2026-08-24 15:31:37.796890 | mon1 | INFO [default > create] Executing 2026-08-24 15:31:37.798407 | mon1 | WARNING [default > create] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-24 15:31:37.804216 | mon1 | INFO [default > prepare] Executing 2026-08-24 15:31:38.612853 | mon1 | 2026-08-24 15:31:38.612990 | mon1 | PLAY [Prepare] ***************************************************************** 2026-08-24 15:31:38.613327 | mon1 | 2026-08-24 15:31:38.613564 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:31:38.613820 | mon1 | Monday 24 August 2026 15:31:38 +0000 (0:00:00.035) 0:00:00.035 ********* 2026-08-24 15:31:39.877297 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-24 15:31:39.877632 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:31:39.877909 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:31:39.878166 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:31:39.878507 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:31:39.942604 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-24 15:31:39.942813 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:31:39.943100 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:31:39.943399 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:31:39.943653 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:31:39.950922 | mon1 | ok: [mon1] 2026-08-24 15:31:39.951162 | mon1 | ok: [osd1] 2026-08-24 15:31:39.951433 | mon1 | 2026-08-24 15:31:39.951688 | mon1 | TASK [Configure short hostname] ************************************************ 2026-08-24 15:31:39.952065 | mon1 | Monday 24 August 2026 15:31:39 +0000 (0:00:01.338) 0:00:01.374 ********* 2026-08-24 15:31:40.790108 | mon1 | changed: [mon1] 2026-08-24 15:31:40.790256 | mon1 | changed: [osd1] 2026-08-24 15:31:40.790441 | mon1 | 2026-08-24 15:31:40.790632 | mon1 | TASK [Ensure hostname inside hosts file] *************************************** 2026-08-24 15:31:40.790830 | mon1 | Monday 24 August 2026 15:31:40 +0000 (0:00:00.838) 0:00:02.213 ********* 2026-08-24 15:31:41.107765 | mon1 | [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created 2026-08-24 15:31:41.107894 | mon1 | with a mode of 0700, this may cause issues when running as another user. To 2026-08-24 15:31:41.108051 | mon1 | avoid this, create the remote_tmp dir with the correct permissions manually 2026-08-24 15:31:41.136414 | mon1 | changed: [mon1] 2026-08-24 15:31:41.136546 | mon1 | changed: [osd1] 2026-08-24 15:31:41.136557 | mon1 | 2026-08-24 15:31:41.136576 | mon1 | TASK [Update apt cache] ******************************************************** 2026-08-24 15:31:41.136884 | mon1 | Monday 24 August 2026 15:31:41 +0000 (0:00:00.345) 0:00:02.558 ********* 2026-08-24 15:32:06.931964 | mon1 | changed: [mon1] 2026-08-24 15:32:06.932069 | mon1 | changed: [osd1] 2026-08-24 15:32:06.932085 | mon1 | 2026-08-24 15:32:06.932100 | mon1 | PLAY [Create devices for Ceph] ************************************************* 2026-08-24 15:32:06.932114 | mon1 | 2026-08-24 15:32:06.932297 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:32:06.932382 | mon1 | Monday 24 August 2026 15:32:06 +0000 (0:00:25.795) 0:00:28.354 ********* 2026-08-24 15:32:07.750010 | mon1 | ok: [osd1] 2026-08-24 15:32:07.750323 | mon1 | 2026-08-24 15:32:07.750609 | mon1 | TASK [Install depedencies] ***************************************************** 2026-08-24 15:32:07.750868 | mon1 | Monday 24 August 2026 15:32:07 +0000 (0:00:00.817) 0:00:29.172 ********* 2026-08-24 15:32:27.039051 | mon1 | changed: [osd1] 2026-08-24 15:32:27.039284 | mon1 | 2026-08-24 15:32:27.039355 | mon1 | TASK [Start up service] ******************************************************** 2026-08-24 15:32:27.039540 | mon1 | Monday 24 August 2026 15:32:27 +0000 (0:00:19.289) 0:00:48.461 ********* 2026-08-24 15:32:28.709860 | mon1 | ok: [osd1] 2026-08-24 15:32:28.710091 | mon1 | 2026-08-24 15:32:28.710462 | mon1 | TASK [Generate lvm.conf] ******************************************************* 2026-08-24 15:32:28.710715 | mon1 | Monday 24 August 2026 15:32:28 +0000 (0:00:01.670) 0:00:50.132 ********* 2026-08-24 15:32:29.099303 | mon1 | ok: [osd1] 2026-08-24 15:32:29.099511 | mon1 | 2026-08-24 15:32:29.099754 | mon1 | TASK [Write /etc/lvm/lvm.conf] ************************************************* 2026-08-24 15:32:29.100044 | mon1 | Monday 24 August 2026 15:32:29 +0000 (0:00:00.389) 0:00:50.522 ********* 2026-08-24 15:32:29.897325 | mon1 | changed: [osd1] 2026-08-24 15:32:29.897542 | mon1 | 2026-08-24 15:32:29.897819 | mon1 | TASK [Get list of all loopback devices] **************************************** 2026-08-24 15:32:29.898067 | mon1 | Monday 24 August 2026 15:32:29 +0000 (0:00:00.797) 0:00:51.320 ********* 2026-08-24 15:32:30.157272 | mon1 | ok: [osd1] 2026-08-24 15:32:30.157544 | mon1 | 2026-08-24 15:32:30.157871 | mon1 | TASK [Fail if there is any existing loopback devices] ************************** 2026-08-24 15:32:30.158186 | mon1 | Monday 24 August 2026 15:32:30 +0000 (0:00:00.259) 0:00:51.579 ********* 2026-08-24 15:32:30.185661 | mon1 | skipping: [osd1] 2026-08-24 15:32:30.185927 | mon1 | 2026-08-24 15:32:30.186240 | mon1 | TASK [Create devices for Ceph] ************************************************* 2026-08-24 15:32:30.186555 | mon1 | Monday 24 August 2026 15:32:30 +0000 (0:00:00.029) 0:00:51.609 ********* 2026-08-24 15:32:30.874586 | mon1 | changed: [osd1] => (item=osd0) 2026-08-24 15:32:30.874974 | mon1 | changed: [osd1] => (item=osd1) 2026-08-24 15:32:30.875539 | mon1 | changed: [osd1] => (item=osd2) 2026-08-24 15:32:30.875804 | mon1 | 2026-08-24 15:32:30.876065 | mon1 | TASK [Set permissions on loopback devices] ************************************* 2026-08-24 15:32:30.876402 | mon1 | Monday 24 August 2026 15:32:30 +0000 (0:00:00.688) 0:00:52.297 ********* 2026-08-24 15:32:31.679867 | mon1 | changed: [osd1] => (item=osd0) 2026-08-24 15:32:31.680085 | mon1 | changed: [osd1] => (item=osd1) 2026-08-24 15:32:31.680367 | mon1 | changed: [osd1] => (item=osd2) 2026-08-24 15:32:31.680599 | mon1 | 2026-08-24 15:32:31.680848 | mon1 | TASK [Start loop devices] ****************************************************** 2026-08-24 15:32:31.681103 | mon1 | Monday 24 August 2026 15:32:31 +0000 (0:00:00.805) 0:00:53.102 ********* 2026-08-24 15:32:32.501607 | mon1 | changed: [osd1] => (item=osd0) 2026-08-24 15:32:32.501847 | mon1 | changed: [osd1] => (item=osd1) 2026-08-24 15:32:32.502083 | mon1 | changed: [osd1] => (item=osd2) 2026-08-24 15:32:32.502376 | mon1 | 2026-08-24 15:32:32.502634 | mon1 | TASK [Create a volume group for each loop device] ****************************** 2026-08-24 15:32:32.502884 | mon1 | Monday 24 August 2026 15:32:32 +0000 (0:00:00.821) 0:00:53.924 ********* 2026-08-24 15:32:33.918338 | mon1 | changed: [osd1] => (item=osd0) 2026-08-24 15:32:33.918553 | mon1 | changed: [osd1] => (item=osd1) 2026-08-24 15:32:33.920096 | mon1 | changed: [osd1] => (item=osd2) 2026-08-24 15:32:33.920119 | mon1 | 2026-08-24 15:32:33.920135 | mon1 | TASK [Create a logical volume for each loop device] **************************** 2026-08-24 15:32:33.920148 | mon1 | Monday 24 August 2026 15:32:33 +0000 (0:00:01.416) 0:00:55.341 ********* 2026-08-24 15:32:35.289415 | mon1 | changed: [osd1] => (item=ceph-osd1-osd0) 2026-08-24 15:32:35.289453 | mon1 | changed: [osd1] => (item=ceph-osd1-osd1) 2026-08-24 15:32:35.289459 | mon1 | changed: [osd1] => (item=ceph-osd1-osd2) 2026-08-24 15:32:35.289464 | mon1 | 2026-08-24 15:32:35.289470 | mon1 | PLAY RECAP ********************************************************************* 2026-08-24 15:32:35.289476 | mon1 | mon1 : ok=4 changed=3 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-24 15:32:35.289483 | mon1 | osd1 : ok=15 changed=10 unreachable=0 failed=0 skipped=1 rescued=0 ignored=0 2026-08-24 15:32:35.290219 | mon1 | 2026-08-24 15:32:35.290229 | mon1 | 2026-08-24 15:32:35.290234 | mon1 | TASKS RECAP ******************************************************************** 2026-08-24 15:32:35.293266 | mon1 | Monday 24 August 2026 15:32:35 +0000 (0:00:01.369) 0:00:56.711 ********* 2026-08-24 15:32:35.293305 | mon1 | =============================================================================== 2026-08-24 15:32:35.293318 | mon1 | Update apt cache ------------------------------------------------------- 25.80s 2026-08-24 15:32:35.293329 | mon1 | Install depedencies ---------------------------------------------------- 19.29s 2026-08-24 15:32:35.293340 | mon1 | Start up service -------------------------------------------------------- 1.67s 2026-08-24 15:32:35.293352 | mon1 | Create a volume group for each loop device ------------------------------ 1.42s 2026-08-24 15:32:35.293363 | mon1 | Create a logical volume for each loop device ---------------------------- 1.37s 2026-08-24 15:32:35.293374 | mon1 | Gathering Facts --------------------------------------------------------- 1.34s 2026-08-24 15:32:35.293385 | mon1 | Configure short hostname ------------------------------------------------ 0.84s 2026-08-24 15:32:35.293396 | mon1 | Start loop devices ------------------------------------------------------ 0.82s 2026-08-24 15:32:35.293407 | mon1 | Gathering Facts --------------------------------------------------------- 0.82s 2026-08-24 15:32:35.293419 | mon1 | Set permissions on loopback devices ------------------------------------- 0.81s 2026-08-24 15:32:35.293435 | mon1 | Write /etc/lvm/lvm.conf ------------------------------------------------- 0.80s 2026-08-24 15:32:35.294152 | mon1 | Create devices for Ceph ------------------------------------------------- 0.69s 2026-08-24 15:32:35.294187 | mon1 | Generate lvm.conf ------------------------------------------------------- 0.39s 2026-08-24 15:32:35.294216 | mon1 | Ensure hostname inside hosts file --------------------------------------- 0.35s 2026-08-24 15:32:35.294227 | mon1 | Get list of all loopback devices ---------------------------------------- 0.26s 2026-08-24 15:32:35.294234 | mon1 | Fail if there is any existing loopback devices -------------------------- 0.03s 2026-08-24 15:32:35.373505 | mon1 | INFO [default > prepare] Executed: Successful 2026-08-24 15:32:35.383625 | mon1 | INFO [default > converge] Executing 2026-08-24 15:32:36.474105 | mon1 | 2026-08-24 15:32:36.474345 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-24 15:32:36.474611 | mon1 | 2026-08-24 15:32:36.474868 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:32:36.475117 | mon1 | Monday 24 August 2026 15:32:36 +0000 (0:00:00.056) 0:00:00.056 ********* 2026-08-24 15:32:37.591413 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-24 15:32:37.591479 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:32:37.591594 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:32:37.591903 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:32:37.592152 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:32:37.606133 | mon1 | ok: [mon1] 2026-08-24 15:32:37.606324 | mon1 | 2026-08-24 15:32:37.606577 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:32:37.606838 | mon1 | Monday 24 August 2026 15:32:37 +0000 (0:00:01.132) 0:00:01.188 ********* 2026-08-24 15:32:37.966435 | mon1 | ok: [mon1] 2026-08-24 15:32:37.966489 | mon1 | 2026-08-24 15:32:37.966609 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:32:37.966859 | mon1 | Monday 24 August 2026 15:32:37 +0000 (0:00:00.359) 0:00:01.548 ********* 2026-08-24 15:32:38.008270 | mon1 | skipping: [mon1] 2026-08-24 15:32:38.008499 | mon1 | 2026-08-24 15:32:38.008752 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-24 15:32:38.009004 | mon1 | Monday 24 August 2026 15:32:38 +0000 (0:00:00.042) 0:00:01.590 ********* 2026-08-24 15:32:38.372877 | mon1 | changed: [mon1] 2026-08-24 15:32:38.372951 | mon1 | 2026-08-24 15:32:38.373125 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:32:38.373321 | mon1 | Monday 24 August 2026 15:32:38 +0000 (0:00:00.364) 0:00:01.954 ********* 2026-08-24 15:32:38.478315 | mon1 | ok: [mon1] => { 2026-08-24 15:32:38.478590 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-24 15:32:38.478840 | mon1 | } 2026-08-24 15:32:38.479148 | mon1 | 2026-08-24 15:32:38.479490 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:32:38.479803 | mon1 | Monday 24 August 2026 15:32:38 +0000 (0:00:00.105) 0:00:02.060 ********* 2026-08-24 15:32:39.248005 | mon1 | changed: [mon1] 2026-08-24 15:32:39.248120 | mon1 | 2026-08-24 15:32:39.248340 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:32:39.248520 | mon1 | Monday 24 August 2026 15:32:39 +0000 (0:00:00.769) 0:00:02.830 ********* 2026-08-24 15:32:39.296841 | mon1 | skipping: [mon1] 2026-08-24 15:32:39.297029 | mon1 | 2026-08-24 15:32:39.297338 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:32:39.297587 | mon1 | Monday 24 August 2026 15:32:39 +0000 (0:00:00.048) 0:00:02.879 ********* 2026-08-24 15:32:39.346315 | mon1 | skipping: [mon1] 2026-08-24 15:32:39.346533 | mon1 | 2026-08-24 15:32:39.346781 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:32:39.347121 | mon1 | Monday 24 August 2026 15:32:39 +0000 (0:00:00.049) 0:00:02.928 ********* 2026-08-24 15:32:39.630949 | mon1 | ok: [mon1] 2026-08-24 15:32:39.631214 | mon1 | 2026-08-24 15:32:39.631720 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:32:39.631991 | mon1 | Monday 24 August 2026 15:32:39 +0000 (0:00:00.284) 0:00:03.213 ********* 2026-08-24 15:32:40.716314 | mon1 | ok: [mon1] 2026-08-24 15:32:40.716376 | mon1 | 2026-08-24 15:32:40.716393 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:32:40.716604 | mon1 | Monday 24 August 2026 15:32:40 +0000 (0:00:01.084) 0:00:04.298 ********* 2026-08-24 15:32:40.929500 | mon1 | ok: [mon1] => { 2026-08-24 15:32:40.929590 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-24 15:32:40.929703 | mon1 | } 2026-08-24 15:32:40.929826 | mon1 | 2026-08-24 15:32:40.929970 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:32:40.930090 | mon1 | Monday 24 August 2026 15:32:40 +0000 (0:00:00.213) 0:00:04.511 ********* 2026-08-24 15:32:41.918687 | mon1 | changed: [mon1] 2026-08-24 15:32:41.918767 | mon1 | 2026-08-24 15:32:41.918853 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:32:41.918968 | mon1 | Monday 24 August 2026 15:32:41 +0000 (0:00:00.988) 0:00:05.499 ********* 2026-08-24 15:32:45.082377 | mon1 | changed: [mon1] 2026-08-24 15:32:45.082436 | mon1 | 2026-08-24 15:32:45.082560 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-24 15:32:45.082672 | mon1 | Monday 24 August 2026 15:32:45 +0000 (0:00:03.165) 0:00:08.665 ********* 2026-08-24 15:32:45.119404 | mon1 | skipping: [mon1] 2026-08-24 15:32:45.119497 | mon1 | 2026-08-24 15:32:45.119942 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-24 15:32:45.120002 | mon1 | Monday 24 August 2026 15:32:45 +0000 (0:00:00.035) 0:00:08.700 ********* 2026-08-24 15:32:45.159808 | mon1 | skipping: [mon1] 2026-08-24 15:32:45.159854 | mon1 | 2026-08-24 15:32:45.159868 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-24 15:32:45.159882 | mon1 | Monday 24 August 2026 15:32:45 +0000 (0:00:00.040) 0:00:08.741 ********* 2026-08-24 15:32:45.196672 | mon1 | skipping: [mon1] 2026-08-24 15:32:45.196715 | mon1 | 2026-08-24 15:32:45.196729 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-24 15:32:45.196743 | mon1 | Monday 24 August 2026 15:32:45 +0000 (0:00:00.036) 0:00:08.777 ********* 2026-08-24 15:32:53.304099 | mon1 | changed: [mon1] 2026-08-24 15:32:53.304145 | mon1 | 2026-08-24 15:32:53.304152 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-24 15:32:53.304158 | mon1 | Monday 24 August 2026 15:32:53 +0000 (0:00:08.107) 0:00:16.885 ********* 2026-08-24 15:32:53.947389 | mon1 | changed: [mon1] 2026-08-24 15:32:53.947457 | mon1 | 2026-08-24 15:32:53.947819 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-24 15:32:53.947875 | mon1 | Monday 24 August 2026 15:32:53 +0000 (0:00:00.642) 0:00:17.528 ********* 2026-08-24 15:32:55.104115 | mon1 | changed: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-24 15:32:55.104190 | mon1 | changed: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-24 15:32:55.104222 | mon1 | changed: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-24 15:32:55.104230 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-24 15:32:55.104238 | mon1 | changed: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-24 15:32:55.104246 | mon1 | 2026-08-24 15:32:55.104255 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-24 15:32:55.104262 | mon1 | Monday 24 August 2026 15:32:55 +0000 (0:00:01.156) 0:00:18.684 ********* 2026-08-24 15:32:55.830553 | mon1 | changed: [mon1] 2026-08-24 15:32:55.830603 | mon1 | 2026-08-24 15:32:55.830617 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-24 15:32:55.830630 | mon1 | Monday 24 August 2026 15:32:55 +0000 (0:00:00.715) 0:00:19.399 ********* 2026-08-24 15:32:55.830642 | mon1 | 2026-08-24 15:32:55.830653 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-24 15:32:55.830665 | mon1 | Monday 24 August 2026 15:32:55 +0000 (0:00:00.010) 0:00:19.410 ********* 2026-08-24 15:32:56.923846 | mon1 | ok: [mon1] 2026-08-24 15:32:56.923890 | mon1 | 2026-08-24 15:32:56.923904 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-24 15:32:56.923917 | mon1 | Monday 24 August 2026 15:32:56 +0000 (0:00:01.094) 0:00:20.504 ********* 2026-08-24 15:32:57.561111 | mon1 | changed: [mon1] 2026-08-24 15:32:57.561247 | mon1 | 2026-08-24 15:32:57.561264 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-24 15:32:57.561274 | mon1 | Monday 24 August 2026 15:32:57 +0000 (0:00:00.636) 0:00:21.140 ********* 2026-08-24 15:32:58.252346 | mon1 | changed: [mon1] 2026-08-24 15:32:58.252394 | mon1 | 2026-08-24 15:32:58.252992 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:32:58.253032 | mon1 | Monday 24 August 2026 15:32:58 +0000 (0:00:00.693) 0:00:21.834 ********* 2026-08-24 15:32:58.506272 | mon1 | ok: [mon1] 2026-08-24 15:32:58.506324 | mon1 | 2026-08-24 15:32:58.506816 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:32:58.506858 | mon1 | Monday 24 August 2026 15:32:58 +0000 (0:00:00.253) 0:00:22.088 ********* 2026-08-24 15:32:58.588376 | mon1 | ok: [mon1] => { 2026-08-24 15:32:58.588433 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-24 15:32:58.588441 | mon1 | } 2026-08-24 15:32:58.588447 | mon1 | 2026-08-24 15:32:58.588453 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:32:58.588464 | mon1 | Monday 24 August 2026 15:32:58 +0000 (0:00:00.080) 0:00:22.168 ********* 2026-08-24 15:32:59.508285 | mon1 | changed: [mon1] 2026-08-24 15:32:59.508353 | mon1 | 2026-08-24 15:32:59.508949 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:32:59.509016 | mon1 | Monday 24 August 2026 15:32:59 +0000 (0:00:00.920) 0:00:23.089 ********* 2026-08-24 15:33:04.123283 | mon1 | changed: [mon1] 2026-08-24 15:33:04.123337 | mon1 | 2026-08-24 15:33:04.123346 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-24 15:33:04.123355 | mon1 | Monday 24 August 2026 15:33:04 +0000 (0:00:04.615) 0:00:27.704 ********* 2026-08-24 15:33:05.069331 | mon1 | ok: [mon1] 2026-08-24 15:33:05.069375 | mon1 | 2026-08-24 15:33:05.069798 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-24 15:33:05.069855 | mon1 | Monday 24 August 2026 15:33:05 +0000 (0:00:00.946) 0:00:28.650 ********* 2026-08-24 15:33:05.491616 | mon1 | changed: [mon1] 2026-08-24 15:33:05.491673 | mon1 | 2026-08-24 15:33:05.491685 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-24 15:33:05.491696 | mon1 | Monday 24 August 2026 15:33:05 +0000 (0:00:00.421) 0:00:29.072 ********* 2026-08-24 15:33:06.067274 | mon1 | changed: [mon1] 2026-08-24 15:33:06.067323 | mon1 | 2026-08-24 15:33:06.067907 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-24 15:33:06.067959 | mon1 | Monday 24 August 2026 15:33:06 +0000 (0:00:00.576) 0:00:29.649 ********* 2026-08-24 15:33:06.751315 | mon1 | changed: [mon1] => (item={'path': '/etc/docker'}) 2026-08-24 15:33:06.751569 | mon1 | changed: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-24 15:33:06.751817 | mon1 | changed: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-24 15:33:06.752044 | mon1 | 2026-08-24 15:33:06.752344 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-24 15:33:06.752595 | mon1 | Monday 24 August 2026 15:33:06 +0000 (0:00:00.683) 0:00:30.332 ********* 2026-08-24 15:33:07.331663 | mon1 | changed: [mon1] 2026-08-24 15:33:07.331732 | mon1 | 2026-08-24 15:33:07.331852 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-24 15:33:07.332007 | mon1 | Monday 24 August 2026 15:33:07 +0000 (0:00:00.578) 0:00:30.911 ********* 2026-08-24 15:33:07.933937 | mon1 | changed: [mon1] 2026-08-24 15:33:07.934000 | mon1 | 2026-08-24 15:33:07.934107 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-24 15:33:07.934240 | mon1 | Monday 24 August 2026 15:33:07 +0000 (0:00:00.597) 0:00:31.508 ********* 2026-08-24 15:33:07.934347 | mon1 | 2026-08-24 15:33:07.934466 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-24 15:33:07.934574 | mon1 | Monday 24 August 2026 15:33:07 +0000 (0:00:00.007) 0:00:31.516 ********* 2026-08-24 15:33:08.844076 | mon1 | ok: [mon1] 2026-08-24 15:33:08.844342 | mon1 | 2026-08-24 15:33:08.844631 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-24 15:33:08.844911 | mon1 | Monday 24 August 2026 15:33:08 +0000 (0:00:00.909) 0:00:32.426 ********* 2026-08-24 15:33:09.755351 | mon1 | changed: [mon1] 2026-08-24 15:33:09.755414 | mon1 | 2026-08-24 15:33:09.755789 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-24 15:33:09.755823 | mon1 | Monday 24 August 2026 15:33:09 +0000 (0:00:00.910) 0:00:33.337 ********* 2026-08-24 15:33:10.411835 | mon1 | changed: [mon1] 2026-08-24 15:33:10.411896 | mon1 | 2026-08-24 15:33:10.411910 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-24 15:33:10.411922 | mon1 | Monday 24 August 2026 15:33:10 +0000 (0:00:00.655) 0:00:33.992 ********* 2026-08-24 15:33:10.481722 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-24 15:33:10.481772 | mon1 | 2026-08-24 15:33:10.481786 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-24 15:33:10.481798 | mon1 | Monday 24 August 2026 15:33:10 +0000 (0:00:00.070) 0:00:34.062 ********* 2026-08-24 15:33:30.034539 | mon1 | changed: [mon1] 2026-08-24 15:33:30.034666 | mon1 | 2026-08-24 15:33:30.034754 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-24 15:33:30.035065 | mon1 | Monday 24 August 2026 15:33:30 +0000 (0:00:19.552) 0:00:53.615 ********* 2026-08-24 15:33:30.909403 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-24 15:33:30.909494 | mon1 | ok: [mon1] => (item=ssh) 2026-08-24 15:33:30.909509 | mon1 | 2026-08-24 15:33:30.909523 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-24 15:33:30.909536 | mon1 | Monday 24 August 2026 15:33:30 +0000 (0:00:00.874) 0:00:54.489 ********* 2026-08-24 15:33:31.882323 | mon1 | changed: [mon1] 2026-08-24 15:33:31.882386 | mon1 | 2026-08-24 15:33:31.882401 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-24 15:33:31.882612 | mon1 | Monday 24 August 2026 15:33:31 +0000 (0:00:00.974) 0:00:55.463 ********* 2026-08-24 15:33:32.139908 | mon1 | ok: [mon1] 2026-08-24 15:33:32.139991 | mon1 | 2026-08-24 15:33:32.140013 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-24 15:33:32.140225 | mon1 | Monday 24 August 2026 15:33:32 +0000 (0:00:00.258) 0:00:55.721 ********* 2026-08-24 15:33:32.690119 | mon1 | changed: [mon1] 2026-08-24 15:33:32.690242 | mon1 | 2026-08-24 15:33:32.690262 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-24 15:33:32.690276 | mon1 | Monday 24 August 2026 15:33:32 +0000 (0:00:00.548) 0:00:56.269 ********* 2026-08-24 15:33:33.079455 | mon1 | changed: [mon1] 2026-08-24 15:33:33.079567 | mon1 | 2026-08-24 15:33:33.079638 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-24 15:33:33.079871 | mon1 | Monday 24 August 2026 15:33:33 +0000 (0:00:00.391) 0:00:56.661 ********* 2026-08-24 15:33:33.220708 | mon1 | ok: [mon1] 2026-08-24 15:33:33.220800 | mon1 | 2026-08-24 15:33:33.220863 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-24 15:33:33.220985 | mon1 | Monday 24 August 2026 15:33:33 +0000 (0:00:00.141) 0:00:56.802 ********* 2026-08-24 15:33:33.479732 | mon1 | ok: [mon1] => (item=mon1) 2026-08-24 15:33:33.479803 | mon1 | 2026-08-24 15:33:33.479930 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-24 15:33:33.480085 | mon1 | Monday 24 August 2026 15:33:33 +0000 (0:00:00.257) 0:00:57.060 ********* 2026-08-24 15:33:33.533122 | mon1 | ok: [mon1] 2026-08-24 15:33:33.533170 | mon1 | 2026-08-24 15:33:33.533176 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-24 15:33:33.533183 | mon1 | Monday 24 August 2026 15:33:33 +0000 (0:00:00.053) 0:00:57.114 ********* 2026-08-24 15:33:33.628101 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/mon/tasks/bootstrap-ceph.yml for mon1 2026-08-24 15:33:33.628180 | mon1 | 2026-08-24 15:33:33.628227 | mon1 | TASK [vexxhost.ceph.mon : Generate temporary file for "ceph.conf"] ************* 2026-08-24 15:33:33.628243 | mon1 | Monday 24 August 2026 15:33:33 +0000 (0:00:00.093) 0:00:57.208 ********* 2026-08-24 15:33:33.971163 | mon1 | changed: [mon1] 2026-08-24 15:33:33.971254 | mon1 | 2026-08-24 15:33:33.971268 | mon1 | TASK [vexxhost.ceph.mon : Include extra configuration values] ****************** 2026-08-24 15:33:33.971281 | mon1 | Monday 24 August 2026 15:33:33 +0000 (0:00:00.343) 0:00:57.551 ********* 2026-08-24 15:33:34.790317 | mon1 | changed: [mon1] => (item={'option': 'osd crush chooseleaf type', 'section': 'global', 'value': 0}) 2026-08-24 15:33:34.790386 | mon1 | changed: [mon1] => (item={'option': 'auth allow insecure global id reclaim', 'section': 'mon', 'value': False}) 2026-08-24 15:33:34.790397 | mon1 | changed: [mon1] => (item={'option': 'mon data avail warn', 'section': 'mon', 'value': 10}) 2026-08-24 15:33:34.790406 | mon1 | 2026-08-24 15:33:34.790415 | mon1 | TASK [vexxhost.ceph.mon : Run Bootstrap command] ******************************* 2026-08-24 15:33:34.790430 | mon1 | Monday 24 August 2026 15:33:34 +0000 (0:00:00.818) 0:00:58.369 ********* 2026-08-24 15:35:34.492651 | mon1 | ok: [mon1] 2026-08-24 15:35:34.492754 | mon1 | 2026-08-24 15:35:34.492836 | mon1 | TASK [vexxhost.ceph.mon : Remove temporary file for "ceph.conf"] *************** 2026-08-24 15:35:34.492951 | mon1 | Monday 24 August 2026 15:35:34 +0000 (0:01:59.703) 0:02:58.073 ********* 2026-08-24 15:35:34.746671 | mon1 | changed: [mon1] 2026-08-24 15:35:34.746737 | mon1 | 2026-08-24 15:35:34.746872 | mon1 | TASK [vexxhost.ceph.mon : Set bootstrap node] ********************************** 2026-08-24 15:35:34.747034 | mon1 | Monday 24 August 2026 15:35:34 +0000 (0:00:00.255) 0:02:58.329 ********* 2026-08-24 15:35:34.793276 | mon1 | ok: [mon1] 2026-08-24 15:35:34.793391 | mon1 | 2026-08-24 15:35:34.793745 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-24 15:35:34.793783 | mon1 | Monday 24 August 2026 15:35:34 +0000 (0:00:00.046) 0:02:58.375 ********* 2026-08-24 15:35:34.885862 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-24 15:35:34.885920 | mon1 | 2026-08-24 15:35:34.885948 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-24 15:35:34.885961 | mon1 | Monday 24 August 2026 15:35:34 +0000 (0:00:00.090) 0:02:58.466 ********* 2026-08-24 15:35:36.687719 | mon1 | ok: [mon1] 2026-08-24 15:35:36.687790 | mon1 | 2026-08-24 15:35:36.687985 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-24 15:35:36.688140 | mon1 | Monday 24 August 2026 15:35:36 +0000 (0:00:01.802) 0:03:00.268 ********* 2026-08-24 15:35:36.751682 | mon1 | ok: [mon1] => (item=mon1) 2026-08-24 15:35:36.751754 | mon1 | 2026-08-24 15:35:36.751883 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-24 15:35:36.752003 | mon1 | Monday 24 August 2026 15:35:36 +0000 (0:00:00.063) 0:03:00.332 ********* 2026-08-24 15:35:37.195948 | mon1 | ok: [mon1] 2026-08-24 15:35:37.195996 | mon1 | 2026-08-24 15:35:37.196010 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-24 15:35:37.196022 | mon1 | Monday 24 August 2026 15:35:37 +0000 (0:00:00.445) 0:03:00.777 ********* 2026-08-24 15:35:39.845788 | mon1 | ok: [mon1] 2026-08-24 15:35:39.845846 | mon1 | 2026-08-24 15:35:39.845860 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-24 15:35:39.845873 | mon1 | Monday 24 August 2026 15:35:39 +0000 (0:00:02.648) 0:03:03.426 ********* 2026-08-24 15:35:43.607778 | mon1 | changed: [mon1] 2026-08-24 15:35:43.607844 | mon1 | 2026-08-24 15:35:43.607858 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-24 15:35:43.607870 | mon1 | Monday 24 August 2026 15:35:43 +0000 (0:00:03.761) 0:03:07.188 ********* 2026-08-24 15:35:45.350286 | mon1 | ok: [mon1] 2026-08-24 15:35:45.350467 | mon1 | 2026-08-24 15:35:45.350841 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-24 15:35:45.351251 | mon1 | Monday 24 August 2026 15:35:45 +0000 (0:00:01.743) 0:03:08.931 ********* 2026-08-24 15:35:45.425907 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-24 15:35:45.425959 | mon1 | 2026-08-24 15:35:45.426101 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-24 15:35:45.426232 | mon1 | Monday 24 August 2026 15:35:45 +0000 (0:00:00.076) 0:03:09.008 ********* 2026-08-24 15:35:45.483818 | mon1 | skipping: [mon1] 2026-08-24 15:35:45.483924 | mon1 | 2026-08-24 15:35:45.483932 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-24 15:35:45.483938 | mon1 | Monday 24 August 2026 15:35:45 +0000 (0:00:00.055) 0:03:09.064 ********* 2026-08-24 15:35:45.541837 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-24 15:35:45.541928 | mon1 | skipping: [mon1] 2026-08-24 15:35:45.541939 | mon1 | 2026-08-24 15:35:45.542075 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-24 15:35:45.542187 | mon1 | Monday 24 August 2026 15:35:45 +0000 (0:00:00.057) 0:03:09.121 ********* 2026-08-24 15:35:45.885359 | mon1 | ok: [mon1] 2026-08-24 15:35:45.885467 | mon1 | 2026-08-24 15:35:45.885475 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-24 15:35:45.885613 | mon1 | Monday 24 August 2026 15:35:45 +0000 (0:00:00.346) 0:03:09.467 ********* 2026-08-24 15:35:48.519095 | mon1 | ok: [mon1] 2026-08-24 15:35:48.519171 | mon1 | 2026-08-24 15:35:48.520263 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-24 15:35:48.520303 | mon1 | Monday 24 August 2026 15:35:48 +0000 (0:00:02.633) 0:03:12.101 ********* 2026-08-24 15:35:51.764605 | mon1 | changed: [mon1] 2026-08-24 15:35:51.764674 | mon1 | 2026-08-24 15:35:51.764688 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-24 15:35:51.764700 | mon1 | Monday 24 August 2026 15:35:51 +0000 (0:00:03.244) 0:03:15.346 ********* 2026-08-24 15:35:53.492391 | mon1 | ok: [mon1] 2026-08-24 15:35:53.492468 | mon1 | 2026-08-24 15:35:53.492883 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-24 15:35:53.492931 | mon1 | Monday 24 August 2026 15:35:53 +0000 (0:00:01.727) 0:03:17.074 ********* 2026-08-24 15:36:00.966644 | mon1 | changed: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-24 15:36:00.966711 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-24 15:36:00.966811 | mon1 | changed: [mon1] => (item={'name': 'prometheus'}) 2026-08-24 15:36:00.966922 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-24 15:36:00.967026 | mon1 | 2026-08-24 15:36:00.967150 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-24 15:36:00.967273 | mon1 | 2026-08-24 15:36:00.967378 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:36:00.967491 | mon1 | Monday 24 August 2026 15:36:00 +0000 (0:00:07.472) 0:03:24.546 ********* 2026-08-24 15:36:02.149298 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-24 15:36:02.149359 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:36:02.149370 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:36:02.149381 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:36:02.149391 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:36:02.164932 | mon1 | ok: [osd1] 2026-08-24 15:36:02.164965 | mon1 | 2026-08-24 15:36:02.164972 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:36:02.164978 | mon1 | Monday 24 August 2026 15:36:02 +0000 (0:00:01.198) 0:03:25.744 ********* 2026-08-24 15:36:02.423412 | mon1 | ok: [osd1] 2026-08-24 15:36:02.423467 | mon1 | 2026-08-24 15:36:02.423631 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:36:02.423778 | mon1 | Monday 24 August 2026 15:36:02 +0000 (0:00:00.261) 0:03:26.005 ********* 2026-08-24 15:36:02.461990 | mon1 | skipping: [osd1] 2026-08-24 15:36:02.462073 | mon1 | 2026-08-24 15:36:02.462250 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-24 15:36:02.462388 | mon1 | Monday 24 August 2026 15:36:02 +0000 (0:00:00.038) 0:03:26.044 ********* 2026-08-24 15:36:02.729852 | mon1 | changed: [osd1] 2026-08-24 15:36:02.729904 | mon1 | 2026-08-24 15:36:02.729915 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:36:02.729925 | mon1 | Monday 24 August 2026 15:36:02 +0000 (0:00:00.265) 0:03:26.310 ********* 2026-08-24 15:36:02.791613 | mon1 | ok: [osd1] => { 2026-08-24 15:36:02.791661 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-24 15:36:02.791668 | mon1 | } 2026-08-24 15:36:02.791673 | mon1 | 2026-08-24 15:36:02.791679 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:36:02.791684 | mon1 | Monday 24 August 2026 15:36:02 +0000 (0:00:00.062) 0:03:26.372 ********* 2026-08-24 15:36:03.478270 | mon1 | changed: [osd1] 2026-08-24 15:36:03.478320 | mon1 | 2026-08-24 15:36:03.479117 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:36:03.479167 | mon1 | Monday 24 August 2026 15:36:03 +0000 (0:00:00.686) 0:03:27.059 ********* 2026-08-24 15:36:03.524859 | mon1 | skipping: [osd1] 2026-08-24 15:36:03.524917 | mon1 | 2026-08-24 15:36:03.524927 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:36:03.524937 | mon1 | Monday 24 August 2026 15:36:03 +0000 (0:00:00.046) 0:03:27.106 ********* 2026-08-24 15:36:03.570542 | mon1 | skipping: [osd1] 2026-08-24 15:36:03.570582 | mon1 | 2026-08-24 15:36:03.570592 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:36:03.570601 | mon1 | Monday 24 August 2026 15:36:03 +0000 (0:00:00.045) 0:03:27.151 ********* 2026-08-24 15:36:03.827844 | mon1 | ok: [osd1] 2026-08-24 15:36:03.827897 | mon1 | 2026-08-24 15:36:03.827908 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:36:03.827918 | mon1 | Monday 24 August 2026 15:36:03 +0000 (0:00:00.257) 0:03:27.408 ********* 2026-08-24 15:36:04.730380 | mon1 | ok: [osd1] 2026-08-24 15:36:04.730450 | mon1 | 2026-08-24 15:36:04.730768 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:36:04.731013 | mon1 | Monday 24 August 2026 15:36:04 +0000 (0:00:00.903) 0:03:28.312 ********* 2026-08-24 15:36:04.803817 | mon1 | ok: [osd1] => { 2026-08-24 15:36:04.804066 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-24 15:36:04.804440 | mon1 | } 2026-08-24 15:36:04.804626 | mon1 | 2026-08-24 15:36:04.804946 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:36:04.805186 | mon1 | Monday 24 August 2026 15:36:04 +0000 (0:00:00.073) 0:03:28.385 ********* 2026-08-24 15:36:05.619340 | mon1 | changed: [osd1] 2026-08-24 15:36:05.619597 | mon1 | 2026-08-24 15:36:05.619923 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:36:05.620345 | mon1 | Monday 24 August 2026 15:36:05 +0000 (0:00:00.815) 0:03:29.201 ********* 2026-08-24 15:36:08.459354 | mon1 | changed: [osd1] 2026-08-24 15:36:08.459413 | mon1 | 2026-08-24 15:36:08.459433 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-24 15:36:08.459594 | mon1 | Monday 24 August 2026 15:36:08 +0000 (0:00:02.839) 0:03:32.040 ********* 2026-08-24 15:36:08.497183 | mon1 | skipping: [osd1] 2026-08-24 15:36:08.497301 | mon1 | 2026-08-24 15:36:08.497316 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-24 15:36:08.497329 | mon1 | Monday 24 August 2026 15:36:08 +0000 (0:00:00.036) 0:03:32.077 ********* 2026-08-24 15:36:08.533772 | mon1 | skipping: [osd1] 2026-08-24 15:36:08.533850 | mon1 | 2026-08-24 15:36:08.533932 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-24 15:36:08.534048 | mon1 | Monday 24 August 2026 15:36:08 +0000 (0:00:00.036) 0:03:32.114 ********* 2026-08-24 15:36:08.576466 | mon1 | skipping: [osd1] 2026-08-24 15:36:08.576520 | mon1 | 2026-08-24 15:36:08.576648 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-24 15:36:08.576760 | mon1 | Monday 24 August 2026 15:36:08 +0000 (0:00:00.044) 0:03:32.158 ********* 2026-08-24 15:36:16.976450 | mon1 | changed: [osd1] 2026-08-24 15:36:16.976500 | mon1 | 2026-08-24 15:36:16.976507 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-24 15:36:16.976513 | mon1 | Monday 24 August 2026 15:36:16 +0000 (0:00:08.398) 0:03:40.557 ********* 2026-08-24 15:36:17.573159 | mon1 | changed: [osd1] 2026-08-24 15:36:17.574027 | mon1 | 2026-08-24 15:36:17.574054 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-24 15:36:17.574064 | mon1 | Monday 24 August 2026 15:36:17 +0000 (0:00:00.596) 0:03:41.154 ********* 2026-08-24 15:36:18.725051 | mon1 | changed: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-24 15:36:18.725101 | mon1 | changed: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-24 15:36:18.725113 | mon1 | changed: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-24 15:36:18.725123 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-24 15:36:18.725133 | mon1 | changed: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-24 15:36:18.725144 | mon1 | 2026-08-24 15:36:18.725156 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-24 15:36:18.725168 | mon1 | Monday 24 August 2026 15:36:18 +0000 (0:00:01.150) 0:03:42.304 ********* 2026-08-24 15:36:19.453331 | mon1 | changed: [osd1] 2026-08-24 15:36:19.453382 | mon1 | 2026-08-24 15:36:19.453389 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-24 15:36:19.453395 | mon1 | Monday 24 August 2026 15:36:19 +0000 (0:00:00.724) 0:03:43.028 ********* 2026-08-24 15:36:19.453400 | mon1 | 2026-08-24 15:36:19.453410 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-24 15:36:19.453558 | mon1 | Monday 24 August 2026 15:36:19 +0000 (0:00:00.006) 0:03:43.035 ********* 2026-08-24 15:36:20.387874 | mon1 | ok: [osd1] 2026-08-24 15:36:20.387933 | mon1 | 2026-08-24 15:36:20.387943 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Restart containerd] ********** 2026-08-24 15:36:20.387953 | mon1 | Monday 24 August 2026 15:36:20 +0000 (0:00:00.933) 0:03:43.968 ********* 2026-08-24 15:36:20.960583 | mon1 | changed: [osd1] 2026-08-24 15:36:20.960645 | mon1 | 2026-08-24 15:36:20.960658 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-24 15:36:20.961005 | mon1 | Monday 24 August 2026 15:36:20 +0000 (0:00:00.572) 0:03:44.541 ********* 2026-08-24 15:36:21.676896 | mon1 | changed: [osd1] 2026-08-24 15:36:21.676954 | mon1 | 2026-08-24 15:36:21.676964 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:36:21.676974 | mon1 | Monday 24 August 2026 15:36:21 +0000 (0:00:00.716) 0:03:45.257 ********* 2026-08-24 15:36:21.920963 | mon1 | ok: [osd1] 2026-08-24 15:36:21.921015 | mon1 | 2026-08-24 15:36:21.921027 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:36:21.921037 | mon1 | Monday 24 August 2026 15:36:21 +0000 (0:00:00.244) 0:03:45.502 ********* 2026-08-24 15:36:21.982353 | mon1 | ok: [osd1] => { 2026-08-24 15:36:21.982466 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-24 15:36:21.982488 | mon1 | } 2026-08-24 15:36:21.983313 | mon1 | 2026-08-24 15:36:21.983385 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:36:21.983397 | mon1 | Monday 24 August 2026 15:36:21 +0000 (0:00:00.061) 0:03:45.563 ********* 2026-08-24 15:36:22.952867 | mon1 | changed: [osd1] 2026-08-24 15:36:22.952930 | mon1 | 2026-08-24 15:36:22.952941 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:36:22.952950 | mon1 | Monday 24 August 2026 15:36:22 +0000 (0:00:00.969) 0:03:46.533 ********* 2026-08-24 15:36:27.532383 | mon1 | changed: [osd1] 2026-08-24 15:36:27.532547 | mon1 | 2026-08-24 15:36:27.532569 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-24 15:36:27.532580 | mon1 | Monday 24 August 2026 15:36:27 +0000 (0:00:04.580) 0:03:51.114 ********* 2026-08-24 15:36:28.511640 | mon1 | ok: [osd1] 2026-08-24 15:36:28.511716 | mon1 | 2026-08-24 15:36:28.511817 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-24 15:36:28.511938 | mon1 | Monday 24 August 2026 15:36:28 +0000 (0:00:00.979) 0:03:52.093 ********* 2026-08-24 15:36:28.818684 | mon1 | changed: [osd1] 2026-08-24 15:36:28.818796 | mon1 | 2026-08-24 15:36:28.818927 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-24 15:36:28.819095 | mon1 | Monday 24 August 2026 15:36:28 +0000 (0:00:00.307) 0:03:52.400 ********* 2026-08-24 15:36:29.439408 | mon1 | changed: [osd1] 2026-08-24 15:36:29.439460 | mon1 | 2026-08-24 15:36:29.439467 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-24 15:36:29.439472 | mon1 | Monday 24 August 2026 15:36:29 +0000 (0:00:00.619) 0:03:53.020 ********* 2026-08-24 15:36:30.138427 | mon1 | changed: [osd1] => (item={'path': '/etc/docker'}) 2026-08-24 15:36:30.138490 | mon1 | changed: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-24 15:36:30.138500 | mon1 | changed: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-24 15:36:30.138509 | mon1 | 2026-08-24 15:36:30.138518 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-24 15:36:30.138528 | mon1 | Monday 24 August 2026 15:36:30 +0000 (0:00:00.698) 0:03:53.718 ********* 2026-08-24 15:36:30.704387 | mon1 | changed: [osd1] 2026-08-24 15:36:30.704458 | mon1 | 2026-08-24 15:36:30.704747 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-24 15:36:30.705056 | mon1 | Monday 24 August 2026 15:36:30 +0000 (0:00:00.567) 0:03:54.286 ********* 2026-08-24 15:36:31.291232 | mon1 | changed: [osd1] 2026-08-24 15:36:31.292304 | mon1 | 2026-08-24 15:36:31.292392 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-24 15:36:31.292458 | mon1 | Monday 24 August 2026 15:36:31 +0000 (0:00:00.580) 0:03:54.866 ********* 2026-08-24 15:36:31.292475 | mon1 | 2026-08-24 15:36:31.292606 | mon1 | RUNNING HANDLER [vexxhost.containers.containerd : Reload systemd] ************** 2026-08-24 15:36:31.292867 | mon1 | Monday 24 August 2026 15:36:31 +0000 (0:00:00.006) 0:03:54.873 ********* 2026-08-24 15:36:32.223491 | mon1 | ok: [osd1] 2026-08-24 15:36:32.223564 | mon1 | 2026-08-24 15:36:32.223744 | mon1 | RUNNING HANDLER [vexxhost.containers.docker : Restart docker] ****************** 2026-08-24 15:36:32.223903 | mon1 | Monday 24 August 2026 15:36:32 +0000 (0:00:00.932) 0:03:55.805 ********* 2026-08-24 15:36:33.220947 | mon1 | changed: [osd1] 2026-08-24 15:36:33.221058 | mon1 | 2026-08-24 15:36:33.221274 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-24 15:36:33.221441 | mon1 | Monday 24 August 2026 15:36:33 +0000 (0:00:00.997) 0:03:56.803 ********* 2026-08-24 15:36:33.953397 | mon1 | changed: [osd1] 2026-08-24 15:36:33.953586 | mon1 | 2026-08-24 15:36:33.953868 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-24 15:36:33.954137 | mon1 | Monday 24 August 2026 15:36:33 +0000 (0:00:00.732) 0:03:57.535 ********* 2026-08-24 15:36:34.011907 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-24 15:36:34.012046 | mon1 | 2026-08-24 15:36:34.012361 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-24 15:36:34.012707 | mon1 | Monday 24 August 2026 15:36:34 +0000 (0:00:00.058) 0:03:57.594 ********* 2026-08-24 15:36:34.945366 | mon1 | ok: [osd1] 2026-08-24 15:36:34.946179 | mon1 | 2026-08-24 15:36:34.946248 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-24 15:36:34.946263 | mon1 | Monday 24 August 2026 15:36:34 +0000 (0:00:00.932) 0:03:58.527 ********* 2026-08-24 15:36:35.756091 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-08-24 15:36:35.756169 | mon1 | ok: [osd1] => (item=ssh) 2026-08-24 15:36:35.756180 | mon1 | 2026-08-24 15:36:35.756224 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-24 15:36:35.756242 | mon1 | Monday 24 August 2026 15:36:35 +0000 (0:00:00.809) 0:03:59.336 ********* 2026-08-24 15:36:37.032002 | mon1 | changed: [osd1] 2026-08-24 15:36:37.032081 | mon1 | 2026-08-24 15:36:37.032092 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-24 15:36:37.032102 | mon1 | Monday 24 August 2026 15:36:37 +0000 (0:00:01.276) 0:04:00.612 ********* 2026-08-24 15:36:37.279734 | mon1 | ok: [osd1] 2026-08-24 15:36:37.279836 | mon1 | 2026-08-24 15:36:37.280005 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-24 15:36:37.280169 | mon1 | Monday 24 August 2026 15:36:37 +0000 (0:00:00.248) 0:04:00.860 ********* 2026-08-24 15:36:37.680704 | mon1 | changed: [osd1] 2026-08-24 15:36:37.680752 | mon1 | 2026-08-24 15:36:37.680762 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-24 15:36:37.680786 | mon1 | Monday 24 August 2026 15:36:37 +0000 (0:00:00.400) 0:04:01.261 ********* 2026-08-24 15:36:37.957400 | mon1 | changed: [osd1] 2026-08-24 15:36:37.957464 | mon1 | 2026-08-24 15:36:37.957481 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-24 15:36:37.957778 | mon1 | Monday 24 August 2026 15:36:37 +0000 (0:00:00.277) 0:04:01.538 ********* 2026-08-24 15:36:38.281302 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-24 15:36:38.281361 | mon1 | 2026-08-24 15:36:38.281919 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-24 15:36:38.281957 | mon1 | Monday 24 August 2026 15:36:38 +0000 (0:00:00.323) 0:04:01.862 ********* 2026-08-24 15:36:38.338641 | mon1 | ok: [osd1] 2026-08-24 15:36:38.338688 | mon1 | 2026-08-24 15:36:38.338699 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-24 15:36:38.338708 | mon1 | Monday 24 August 2026 15:36:38 +0000 (0:00:00.057) 0:04:01.919 ********* 2026-08-24 15:36:38.462639 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-24 15:36:38.462693 | mon1 | 2026-08-24 15:36:38.462807 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-24 15:36:38.462915 | mon1 | Monday 24 August 2026 15:36:38 +0000 (0:00:00.124) 0:04:02.043 ********* 2026-08-24 15:36:40.254138 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:36:40.254181 | mon1 | 2026-08-24 15:36:40.254188 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-24 15:36:40.254212 | mon1 | Monday 24 August 2026 15:36:40 +0000 (0:00:01.791) 0:04:03.835 ********* 2026-08-24 15:36:40.323897 | mon1 | ok: [osd1] => (item=osd1) 2026-08-24 15:36:40.323949 | mon1 | 2026-08-24 15:36:40.323963 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-24 15:36:40.323976 | mon1 | Monday 24 August 2026 15:36:40 +0000 (0:00:00.068) 0:04:03.904 ********* 2026-08-24 15:36:40.646874 | mon1 | changed: [osd1] 2026-08-24 15:36:40.646926 | mon1 | 2026-08-24 15:36:40.646943 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-24 15:36:40.646956 | mon1 | Monday 24 August 2026 15:36:40 +0000 (0:00:00.323) 0:04:04.227 ********* 2026-08-24 15:36:46.501382 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:36:46.501471 | mon1 | 2026-08-24 15:36:46.501952 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-24 15:36:46.502006 | mon1 | Monday 24 August 2026 15:36:46 +0000 (0:00:05.855) 0:04:10.083 ********* 2026-08-24 15:36:47.442832 | mon1 | ok: [osd1] 2026-08-24 15:36:47.442894 | mon1 | 2026-08-24 15:36:47.442908 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-24 15:36:47.442920 | mon1 | Monday 24 August 2026 15:36:47 +0000 (0:00:00.940) 0:04:11.023 ********* 2026-08-24 15:37:30.303021 | mon1 | ok: [osd1] 2026-08-24 15:37:30.303123 | mon1 | 2026-08-24 15:37:30.303139 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-24 15:37:30.303174 | mon1 | Monday 24 August 2026 15:37:30 +0000 (0:00:42.859) 0:04:53.883 ********* 2026-08-24 15:38:16.397771 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd0/data) 2026-08-24 15:38:16.397835 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd1/data) 2026-08-24 15:38:16.397844 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=/dev/ceph-osd1-osd2/data) 2026-08-24 15:38:16.397852 | mon1 | 2026-08-24 15:38:16.397860 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-24 15:38:16.397869 | mon1 | Monday 24 August 2026 15:38:16 +0000 (0:00:46.095) 0:05:39.978 ********* 2026-08-24 15:38:18.301110 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:38:18.301178 | mon1 | 2026-08-24 15:38:18.301225 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-24 15:38:18.301243 | mon1 | Monday 24 August 2026 15:38:18 +0000 (0:00:01.903) 0:05:41.881 ********* 2026-08-24 15:38:20.063144 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:38:20.063286 | mon1 | 2026-08-24 15:38:20.063305 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-24 15:38:20.063318 | mon1 | Monday 24 August 2026 15:38:20 +0000 (0:00:01.762) 0:05:43.643 ********* 2026-08-24 15:38:20.123418 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-24 15:38:20.123497 | mon1 | 2026-08-24 15:38:20.123519 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-24 15:38:20.123739 | mon1 | Monday 24 August 2026 15:38:20 +0000 (0:00:00.061) 0:05:43.705 ********* 2026-08-24 15:38:20.169084 | mon1 | ok: [osd1] 2026-08-24 15:38:20.169154 | mon1 | 2026-08-24 15:38:20.169168 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-24 15:38:20.169181 | mon1 | Monday 24 August 2026 15:38:20 +0000 (0:00:00.045) 0:05:43.750 ********* 2026-08-24 15:38:21.961001 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:38:21.961059 | mon1 | 2026-08-24 15:38:21.961070 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-24 15:38:21.961079 | mon1 | Monday 24 August 2026 15:38:21 +0000 (0:00:01.791) 0:05:45.541 ********* 2026-08-24 15:38:22.003997 | mon1 | ok: [osd1] 2026-08-24 15:38:22.004050 | mon1 | 2026-08-24 15:38:22.004065 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-24 15:38:22.004079 | mon1 | Monday 24 August 2026 15:38:22 +0000 (0:00:00.042) 0:05:45.584 ********* 2026-08-24 15:38:22.043347 | mon1 | failed: [osd1] (item=2) => {"ansible_loop_var": "item", "changed": false, "item": 2, "msg": "Failed as requested from task"} 2026-08-24 15:38:22.065287 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:38:22.065353 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:38:22.065366 | mon1 | 2026-08-24 15:38:22.065379 | mon1 | TASK [vexxhost.ceph.osd : Failed after retry] ********************************** 2026-08-24 15:38:22.065392 | mon1 | Monday 24 August 2026 15:38:22 +0000 (0:00:00.060) 0:05:45.644 ********* 2026-08-24 15:38:22.107136 | mon1 | skipping: [osd1] 2026-08-24 15:38:22.107169 | mon1 | 2026-08-24 15:38:22.107175 | mon1 | TASK [vexxhost.ceph.osd : Give 5 seconds pause before retry] ******************* 2026-08-24 15:38:22.107182 | mon1 | Monday 24 August 2026 15:38:22 +0000 (0:00:00.043) 0:05:45.688 ********* 2026-08-24 15:38:27.155382 | mon1 | Pausing for 5 seconds 2026-08-24 15:38:27.156459 | mon1 | ok: [osd1] 2026-08-24 15:38:27.156559 | mon1 | 2026-08-24 15:38:27.156573 | mon1 | TASK [vexxhost.ceph.osd : Recheck OSDs] **************************************** 2026-08-24 15:38:27.156588 | mon1 | Monday 24 August 2026 15:38:27 +0000 (0:00:05.047) 0:05:50.736 ********* 2026-08-24 15:38:27.218247 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-24 15:38:27.218313 | mon1 | 2026-08-24 15:38:27.218327 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-24 15:38:27.218376 | mon1 | Monday 24 August 2026 15:38:27 +0000 (0:00:00.062) 0:05:50.799 ********* 2026-08-24 15:38:27.270654 | mon1 | ok: [osd1] 2026-08-24 15:38:27.270693 | mon1 | 2026-08-24 15:38:27.270703 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-24 15:38:27.270712 | mon1 | Monday 24 August 2026 15:38:27 +0000 (0:00:00.052) 0:05:50.851 ********* 2026-08-24 15:38:28.991032 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:38:28.991097 | mon1 | 2026-08-24 15:38:28.991112 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-24 15:38:28.991125 | mon1 | Monday 24 August 2026 15:38:28 +0000 (0:00:01.719) 0:05:52.571 ********* 2026-08-24 15:38:29.042215 | mon1 | ok: [osd1] 2026-08-24 15:38:29.042237 | mon1 | 2026-08-24 15:38:29.042577 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-24 15:38:29.042850 | mon1 | Monday 24 August 2026 15:38:29 +0000 (0:00:00.052) 0:05:52.623 ********* 2026-08-24 15:38:29.090865 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:38:29.091122 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:38:29.091429 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:38:29.091681 | mon1 | skipping: [osd1] 2026-08-24 15:38:29.091907 | mon1 | 2026-08-24 15:38:29.092167 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-24 15:38:29.092480 | mon1 | Monday 24 August 2026 15:38:29 +0000 (0:00:00.049) 0:05:52.673 ********* 2026-08-24 15:38:29.161449 | mon1 | skipping: [osd1] 2026-08-24 15:38:29.162385 | mon1 | 2026-08-24 15:38:29.162422 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-24 15:38:29.162436 | mon1 | 2026-08-24 15:38:29.162608 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:38:29.162894 | mon1 | Monday 24 August 2026 15:38:29 +0000 (0:00:00.070) 0:05:52.743 ********* 2026-08-24 15:38:30.100303 | mon1 | ok: [mon1] 2026-08-24 15:38:30.100709 | mon1 | 2026-08-24 15:38:30.101146 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:38:30.101529 | mon1 | Monday 24 August 2026 15:38:30 +0000 (0:00:00.938) 0:05:53.682 ********* 2026-08-24 15:38:30.352009 | mon1 | ok: [mon1] 2026-08-24 15:38:30.352300 | mon1 | 2026-08-24 15:38:30.352569 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:38:30.352829 | mon1 | Monday 24 August 2026 15:38:30 +0000 (0:00:00.251) 0:05:53.934 ********* 2026-08-24 15:38:30.397642 | mon1 | skipping: [mon1] 2026-08-24 15:38:30.397840 | mon1 | 2026-08-24 15:38:30.398115 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-24 15:38:30.398395 | mon1 | Monday 24 August 2026 15:38:30 +0000 (0:00:00.045) 0:05:53.979 ********* 2026-08-24 15:38:30.660786 | mon1 | ok: [mon1] 2026-08-24 15:38:30.660907 | mon1 | 2026-08-24 15:38:30.661079 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:38:30.661269 | mon1 | Monday 24 August 2026 15:38:30 +0000 (0:00:00.262) 0:05:54.242 ********* 2026-08-24 15:38:30.724093 | mon1 | ok: [mon1] => { 2026-08-24 15:38:30.724310 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-24 15:38:30.724529 | mon1 | } 2026-08-24 15:38:30.724727 | mon1 | 2026-08-24 15:38:30.724954 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:38:30.725159 | mon1 | Monday 24 August 2026 15:38:30 +0000 (0:00:00.063) 0:05:54.306 ********* 2026-08-24 15:38:31.104241 | mon1 | ok: [mon1] 2026-08-24 15:38:31.104283 | mon1 | 2026-08-24 15:38:31.104550 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:38:31.104816 | mon1 | Monday 24 August 2026 15:38:31 +0000 (0:00:00.379) 0:05:54.686 ********* 2026-08-24 15:38:31.152426 | mon1 | skipping: [mon1] 2026-08-24 15:38:31.152644 | mon1 | 2026-08-24 15:38:31.152930 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:38:31.153187 | mon1 | Monday 24 August 2026 15:38:31 +0000 (0:00:00.048) 0:05:54.734 ********* 2026-08-24 15:38:31.198340 | mon1 | skipping: [mon1] 2026-08-24 15:38:31.198406 | mon1 | 2026-08-24 15:38:31.198418 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:38:31.198427 | mon1 | Monday 24 August 2026 15:38:31 +0000 (0:00:00.044) 0:05:54.779 ********* 2026-08-24 15:38:31.449758 | mon1 | ok: [mon1] 2026-08-24 15:38:31.449959 | mon1 | 2026-08-24 15:38:31.450314 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:38:31.450629 | mon1 | Monday 24 August 2026 15:38:31 +0000 (0:00:00.252) 0:05:55.031 ********* 2026-08-24 15:38:32.347385 | mon1 | ok: [mon1] 2026-08-24 15:38:32.347447 | mon1 | 2026-08-24 15:38:32.347458 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:38:32.347467 | mon1 | Monday 24 August 2026 15:38:32 +0000 (0:00:00.896) 0:05:55.928 ********* 2026-08-24 15:38:32.427845 | mon1 | ok: [mon1] => { 2026-08-24 15:38:32.427896 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-24 15:38:32.427903 | mon1 | } 2026-08-24 15:38:32.427909 | mon1 | 2026-08-24 15:38:32.427915 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:38:32.427921 | mon1 | Monday 24 August 2026 15:38:32 +0000 (0:00:00.079) 0:05:56.008 ********* 2026-08-24 15:38:32.866573 | mon1 | ok: [mon1] 2026-08-24 15:38:32.866611 | mon1 | 2026-08-24 15:38:32.866618 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:38:32.866629 | mon1 | Monday 24 August 2026 15:38:32 +0000 (0:00:00.438) 0:05:56.446 ********* 2026-08-24 15:38:35.032288 | mon1 | ok: [mon1] 2026-08-24 15:38:35.032341 | mon1 | 2026-08-24 15:38:35.032358 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-24 15:38:35.032650 | mon1 | Monday 24 August 2026 15:38:35 +0000 (0:00:02.167) 0:05:58.613 ********* 2026-08-24 15:38:35.071874 | mon1 | skipping: [mon1] 2026-08-24 15:38:35.071925 | mon1 | 2026-08-24 15:38:35.071936 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-24 15:38:35.071947 | mon1 | Monday 24 August 2026 15:38:35 +0000 (0:00:00.038) 0:05:58.651 ********* 2026-08-24 15:38:35.106996 | mon1 | skipping: [mon1] 2026-08-24 15:38:35.107021 | mon1 | 2026-08-24 15:38:35.107035 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-24 15:38:35.107040 | mon1 | Monday 24 August 2026 15:38:35 +0000 (0:00:00.037) 0:05:58.689 ********* 2026-08-24 15:38:35.146445 | mon1 | skipping: [mon1] 2026-08-24 15:38:35.146514 | mon1 | 2026-08-24 15:38:35.146518 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-24 15:38:35.146524 | mon1 | Monday 24 August 2026 15:38:35 +0000 (0:00:00.038) 0:05:58.727 ********* 2026-08-24 15:38:36.174841 | mon1 | ok: [mon1] 2026-08-24 15:38:36.174905 | mon1 | 2026-08-24 15:38:36.174916 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-24 15:38:36.174925 | mon1 | Monday 24 August 2026 15:38:36 +0000 (0:00:01.027) 0:05:59.755 ********* 2026-08-24 15:38:36.730925 | mon1 | ok: [mon1] 2026-08-24 15:38:36.730980 | mon1 | 2026-08-24 15:38:36.730992 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-24 15:38:36.731002 | mon1 | Monday 24 August 2026 15:38:36 +0000 (0:00:00.556) 0:06:00.311 ********* 2026-08-24 15:38:37.903371 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-24 15:38:37.903439 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-24 15:38:37.904328 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-24 15:38:37.904402 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-24 15:38:37.904422 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-24 15:38:37.905249 | mon1 | 2026-08-24 15:38:37.905286 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-24 15:38:37.905412 | mon1 | Monday 24 August 2026 15:38:37 +0000 (0:00:01.172) 0:06:01.483 ********* 2026-08-24 15:38:38.597300 | mon1 | ok: [mon1] 2026-08-24 15:38:38.597717 | mon1 | 2026-08-24 15:38:38.598046 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-24 15:38:38.598395 | mon1 | Monday 24 August 2026 15:38:38 +0000 (0:00:00.687) 0:06:02.171 ********* 2026-08-24 15:38:38.598686 | mon1 | 2026-08-24 15:38:38.598991 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-24 15:38:38.599329 | mon1 | Monday 24 August 2026 15:38:38 +0000 (0:00:00.007) 0:06:02.179 ********* 2026-08-24 15:38:39.046942 | mon1 | ok: [mon1] 2026-08-24 15:38:39.047917 | mon1 | 2026-08-24 15:38:39.047947 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:38:39.047958 | mon1 | Monday 24 August 2026 15:38:39 +0000 (0:00:00.449) 0:06:02.628 ********* 2026-08-24 15:38:39.316010 | mon1 | ok: [mon1] 2026-08-24 15:38:39.316043 | mon1 | 2026-08-24 15:38:39.316048 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:38:39.316052 | mon1 | Monday 24 August 2026 15:38:39 +0000 (0:00:00.268) 0:06:02.897 ********* 2026-08-24 15:38:39.389363 | mon1 | ok: [mon1] => { 2026-08-24 15:38:39.389528 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-24 15:38:39.389855 | mon1 | } 2026-08-24 15:38:39.390159 | mon1 | 2026-08-24 15:38:39.390549 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:38:39.390938 | mon1 | Monday 24 August 2026 15:38:39 +0000 (0:00:00.072) 0:06:02.969 ********* 2026-08-24 15:38:39.804692 | mon1 | ok: [mon1] 2026-08-24 15:38:39.804751 | mon1 | 2026-08-24 15:38:39.804868 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:38:39.805001 | mon1 | Monday 24 August 2026 15:38:39 +0000 (0:00:00.417) 0:06:03.387 ********* 2026-08-24 15:38:43.162227 | mon1 | ok: [mon1] 2026-08-24 15:38:43.162299 | mon1 | 2026-08-24 15:38:43.162310 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-24 15:38:43.162321 | mon1 | Monday 24 August 2026 15:38:43 +0000 (0:00:03.355) 0:06:06.742 ********* 2026-08-24 15:38:44.114837 | mon1 | ok: [mon1] 2026-08-24 15:38:44.114896 | mon1 | 2026-08-24 15:38:44.114907 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-24 15:38:44.114916 | mon1 | Monday 24 August 2026 15:38:44 +0000 (0:00:00.952) 0:06:07.695 ********* 2026-08-24 15:38:44.365956 | mon1 | ok: [mon1] 2026-08-24 15:38:44.366005 | mon1 | 2026-08-24 15:38:44.366017 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-24 15:38:44.366027 | mon1 | Monday 24 August 2026 15:38:44 +0000 (0:00:00.251) 0:06:07.946 ********* 2026-08-24 15:38:44.922364 | mon1 | ok: [mon1] 2026-08-24 15:38:44.922425 | mon1 | 2026-08-24 15:38:44.922432 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-24 15:38:44.922438 | mon1 | Monday 24 August 2026 15:38:44 +0000 (0:00:00.555) 0:06:08.502 ********* 2026-08-24 15:38:45.635446 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-24 15:38:45.635539 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-24 15:38:45.635653 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-24 15:38:45.635757 | mon1 | 2026-08-24 15:38:45.635867 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-24 15:38:45.635980 | mon1 | Monday 24 August 2026 15:38:45 +0000 (0:00:00.713) 0:06:09.215 ********* 2026-08-24 15:38:46.185256 | mon1 | ok: [mon1] 2026-08-24 15:38:46.185293 | mon1 | 2026-08-24 15:38:46.185300 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-24 15:38:46.185306 | mon1 | Monday 24 August 2026 15:38:46 +0000 (0:00:00.551) 0:06:09.766 ********* 2026-08-24 15:38:46.729732 | mon1 | ok: [mon1] 2026-08-24 15:38:46.729829 | mon1 | 2026-08-24 15:38:46.730069 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-24 15:38:46.730322 | mon1 | Monday 24 August 2026 15:38:46 +0000 (0:00:00.530) 0:06:10.297 ********* 2026-08-24 15:38:46.730488 | mon1 | 2026-08-24 15:38:46.730714 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-24 15:38:46.730898 | mon1 | Monday 24 August 2026 15:38:46 +0000 (0:00:00.014) 0:06:10.311 ********* 2026-08-24 15:38:47.197336 | mon1 | ok: [mon1] 2026-08-24 15:38:47.197403 | mon1 | 2026-08-24 15:38:47.197414 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-24 15:38:47.197431 | mon1 | Monday 24 August 2026 15:38:47 +0000 (0:00:00.466) 0:06:10.778 ********* 2026-08-24 15:38:47.255703 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-24 15:38:47.255754 | mon1 | 2026-08-24 15:38:47.255764 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-24 15:38:47.255774 | mon1 | Monday 24 August 2026 15:38:47 +0000 (0:00:00.058) 0:06:10.836 ********* 2026-08-24 15:38:48.292789 | mon1 | ok: [mon1] 2026-08-24 15:38:48.292843 | mon1 | 2026-08-24 15:38:48.292854 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-24 15:38:48.292864 | mon1 | Monday 24 August 2026 15:38:48 +0000 (0:00:01.036) 0:06:11.873 ********* 2026-08-24 15:38:49.129386 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-24 15:38:49.129446 | mon1 | ok: [mon1] => (item=ssh) 2026-08-24 15:38:49.129457 | mon1 | 2026-08-24 15:38:49.129482 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-24 15:38:49.129496 | mon1 | Monday 24 August 2026 15:38:49 +0000 (0:00:00.836) 0:06:12.710 ********* 2026-08-24 15:38:50.449343 | mon1 | ok: [mon1] 2026-08-24 15:38:50.449384 | mon1 | 2026-08-24 15:38:50.449391 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-24 15:38:50.449397 | mon1 | Monday 24 August 2026 15:38:50 +0000 (0:00:01.320) 0:06:14.030 ********* 2026-08-24 15:38:50.729226 | mon1 | ok: [mon1] 2026-08-24 15:38:50.729303 | mon1 | 2026-08-24 15:38:50.729465 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-24 15:38:50.729661 | mon1 | Monday 24 August 2026 15:38:50 +0000 (0:00:00.279) 0:06:14.310 ********* 2026-08-24 15:38:51.070323 | mon1 | ok: [mon1] 2026-08-24 15:38:51.070374 | mon1 | 2026-08-24 15:38:51.070935 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-24 15:38:51.070979 | mon1 | Monday 24 August 2026 15:38:51 +0000 (0:00:00.341) 0:06:14.651 ********* 2026-08-24 15:38:51.346321 | mon1 | ok: [mon1] 2026-08-24 15:38:51.346375 | mon1 | 2026-08-24 15:38:51.346381 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-24 15:38:51.346387 | mon1 | Monday 24 August 2026 15:38:51 +0000 (0:00:00.276) 0:06:14.928 ********* 2026-08-24 15:38:54.750247 | mon1 | changed: [mon1] 2026-08-24 15:38:54.750287 | mon1 | 2026-08-24 15:38:54.750296 | mon1 | PLAY RECAP ********************************************************************* 2026-08-24 15:38:54.750304 | mon1 | mon1 : ok=93 changed=30 unreachable=0 failed=0 skipped=14 rescued=0 ignored=0 2026-08-24 15:38:54.750311 | mon1 | osd1 : ok=58 changed=23 unreachable=0 failed=0 skipped=9 rescued=1 ignored=0 2026-08-24 15:38:54.750318 | mon1 | 2026-08-24 15:38:54.750325 | mon1 | 2026-08-24 15:38:54.750332 | mon1 | TASKS RECAP ******************************************************************** 2026-08-24 15:38:54.750339 | mon1 | Monday 24 August 2026 15:38:54 +0000 (0:00:03.399) 0:06:18.327 ********* 2026-08-24 15:38:54.750346 | mon1 | =============================================================================== 2026-08-24 15:38:54.750352 | mon1 | vexxhost.ceph.mon : Run Bootstrap command ----------------------------- 119.70s 2026-08-24 15:38:54.750359 | mon1 | vexxhost.ceph.osd : Install OSDs --------------------------------------- 46.10s 2026-08-24 15:38:54.750366 | mon1 | vexxhost.ceph.osd : Get `ceph-volume lvm list` status ------------------ 42.86s 2026-08-24 15:38:54.750380 | mon1 | vexxhost.ceph.cephadm : Install packages ------------------------------- 19.55s 2026-08-24 15:38:54.750398 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.40s 2026-08-24 15:38:54.750403 | mon1 | vexxhost.containers.containerd : Install AppArmor packages -------------- 8.11s 2026-08-24 15:38:54.756710 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 7.47s 2026-08-24 15:38:54.756727 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 5.86s 2026-08-24 15:38:54.756733 | mon1 | vexxhost.ceph.osd : Give 5 seconds pause before retry ------------------- 5.05s 2026-08-24 15:38:54.756738 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.62s 2026-08-24 15:38:54.756743 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 4.58s 2026-08-24 15:38:54.756747 | mon1 | vexxhost.ceph.mon : Configure "mon" label for monitors ------------------ 3.76s 2026-08-24 15:38:54.756752 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 3.40s 2026-08-24 15:38:54.756757 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.36s 2026-08-24 15:38:54.756763 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 3.24s 2026-08-24 15:38:54.756768 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.17s 2026-08-24 15:38:54.756773 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.84s 2026-08-24 15:38:54.756778 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.65s 2026-08-24 15:38:54.756783 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.63s 2026-08-24 15:38:54.756789 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.17s 2026-08-24 15:38:54.841972 | mon1 | INFO [default > converge] Executed: Successful 2026-08-24 15:38:54.848348 | mon1 | INFO [default > idempotence] Executing 2026-08-24 15:38:55.866597 | mon1 | 2026-08-24 15:38:55.867014 | mon1 | PLAY [Deploy Ceph monitors & managers] ***************************************** 2026-08-24 15:38:55.867367 | mon1 | 2026-08-24 15:38:55.867810 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:38:55.868276 | mon1 | Monday 24 August 2026 15:38:55 +0000 (0:00:00.052) 0:00:00.052 ********* 2026-08-24 15:38:58.084157 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-24 15:38:58.084575 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:38:58.084902 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:38:58.085273 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:38:58.085600 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:38:58.099480 | mon1 | ok: [mon1] 2026-08-24 15:38:58.099808 | mon1 | 2026-08-24 15:38:58.100162 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:38:58.100501 | mon1 | Monday 24 August 2026 15:38:58 +0000 (0:00:02.232) 0:00:02.285 ********* 2026-08-24 15:38:58.437390 | mon1 | ok: [mon1] 2026-08-24 15:38:58.437620 | mon1 | 2026-08-24 15:38:58.437792 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:38:58.437956 | mon1 | Monday 24 August 2026 15:38:58 +0000 (0:00:00.337) 0:00:02.623 ********* 2026-08-24 15:38:58.479033 | mon1 | skipping: [mon1] 2026-08-24 15:38:58.479599 | mon1 | 2026-08-24 15:38:58.480141 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-24 15:38:58.480539 | mon1 | Monday 24 August 2026 15:38:58 +0000 (0:00:00.041) 0:00:02.664 ********* 2026-08-24 15:38:58.830730 | mon1 | ok: [mon1] 2026-08-24 15:38:58.831034 | mon1 | 2026-08-24 15:38:58.831421 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:38:58.831725 | mon1 | Monday 24 August 2026 15:38:58 +0000 (0:00:00.350) 0:00:03.015 ********* 2026-08-24 15:38:58.914185 | mon1 | ok: [mon1] => { 2026-08-24 15:38:58.914504 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-24 15:38:58.914872 | mon1 | } 2026-08-24 15:38:58.915152 | mon1 | 2026-08-24 15:38:58.915464 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:38:58.915768 | mon1 | Monday 24 August 2026 15:38:58 +0000 (0:00:00.084) 0:00:03.099 ********* 2026-08-24 15:38:59.412461 | mon1 | ok: [mon1] 2026-08-24 15:38:59.412655 | mon1 | 2026-08-24 15:38:59.412915 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:38:59.413168 | mon1 | Monday 24 August 2026 15:38:59 +0000 (0:00:00.498) 0:00:03.598 ********* 2026-08-24 15:38:59.463223 | mon1 | skipping: [mon1] 2026-08-24 15:38:59.463455 | mon1 | 2026-08-24 15:38:59.463709 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:38:59.463967 | mon1 | Monday 24 August 2026 15:38:59 +0000 (0:00:00.050) 0:00:03.648 ********* 2026-08-24 15:38:59.516376 | mon1 | skipping: [mon1] 2026-08-24 15:38:59.516590 | mon1 | 2026-08-24 15:38:59.516844 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:38:59.517095 | mon1 | Monday 24 August 2026 15:38:59 +0000 (0:00:00.053) 0:00:03.702 ********* 2026-08-24 15:38:59.777233 | mon1 | ok: [mon1] 2026-08-24 15:38:59.777391 | mon1 | 2026-08-24 15:38:59.777665 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:38:59.777926 | mon1 | Monday 24 August 2026 15:38:59 +0000 (0:00:00.260) 0:00:03.962 ********* 2026-08-24 15:39:00.989754 | mon1 | ok: [mon1] 2026-08-24 15:39:00.989973 | mon1 | 2026-08-24 15:39:00.990318 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:39:00.990604 | mon1 | Monday 24 August 2026 15:39:00 +0000 (0:00:01.212) 0:00:05.175 ********* 2026-08-24 15:39:01.182416 | mon1 | ok: [mon1] => { 2026-08-24 15:39:01.182529 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-24 15:39:01.182693 | mon1 | } 2026-08-24 15:39:01.182844 | mon1 | 2026-08-24 15:39:01.183023 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:39:01.183307 | mon1 | Monday 24 August 2026 15:39:01 +0000 (0:00:00.192) 0:00:05.368 ********* 2026-08-24 15:39:01.742864 | mon1 | ok: [mon1] 2026-08-24 15:39:01.742946 | mon1 | 2026-08-24 15:39:01.743072 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:39:01.743207 | mon1 | Monday 24 August 2026 15:39:01 +0000 (0:00:00.560) 0:00:05.928 ********* 2026-08-24 15:39:04.258757 | mon1 | ok: [mon1] 2026-08-24 15:39:04.258983 | mon1 | 2026-08-24 15:39:04.259289 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-24 15:39:04.259561 | mon1 | Monday 24 August 2026 15:39:04 +0000 (0:00:02.516) 0:00:08.444 ********* 2026-08-24 15:39:04.295165 | mon1 | skipping: [mon1] 2026-08-24 15:39:04.295446 | mon1 | 2026-08-24 15:39:04.295689 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-24 15:39:04.295941 | mon1 | Monday 24 August 2026 15:39:04 +0000 (0:00:00.036) 0:00:08.480 ********* 2026-08-24 15:39:04.331148 | mon1 | skipping: [mon1] 2026-08-24 15:39:04.331400 | mon1 | 2026-08-24 15:39:04.331655 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-24 15:39:04.331903 | mon1 | Monday 24 August 2026 15:39:04 +0000 (0:00:00.036) 0:00:08.517 ********* 2026-08-24 15:39:04.368745 | mon1 | skipping: [mon1] 2026-08-24 15:39:04.368968 | mon1 | 2026-08-24 15:39:04.369260 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-24 15:39:04.369515 | mon1 | Monday 24 August 2026 15:39:04 +0000 (0:00:00.037) 0:00:08.554 ********* 2026-08-24 15:39:05.300161 | mon1 | ok: [mon1] 2026-08-24 15:39:05.300393 | mon1 | 2026-08-24 15:39:05.300672 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-24 15:39:05.300934 | mon1 | Monday 24 August 2026 15:39:05 +0000 (0:00:00.930) 0:00:09.485 ********* 2026-08-24 15:39:05.862276 | mon1 | ok: [mon1] 2026-08-24 15:39:05.862554 | mon1 | 2026-08-24 15:39:05.862821 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-24 15:39:05.863083 | mon1 | Monday 24 August 2026 15:39:05 +0000 (0:00:00.562) 0:00:10.047 ********* 2026-08-24 15:39:07.006229 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-24 15:39:07.006263 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-24 15:39:07.006268 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-24 15:39:07.006454 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-24 15:39:07.006798 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-24 15:39:07.007053 | mon1 | 2026-08-24 15:39:07.007313 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-24 15:39:07.007476 | mon1 | Monday 24 August 2026 15:39:07 +0000 (0:00:01.143) 0:00:11.191 ********* 2026-08-24 15:39:07.675707 | mon1 | ok: [mon1] 2026-08-24 15:39:07.675760 | mon1 | 2026-08-24 15:39:07.675884 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-24 15:39:07.676029 | mon1 | Monday 24 August 2026 15:39:07 +0000 (0:00:00.659) 0:00:11.851 ********* 2026-08-24 15:39:07.676144 | mon1 | 2026-08-24 15:39:07.676277 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-24 15:39:07.676390 | mon1 | Monday 24 August 2026 15:39:07 +0000 (0:00:00.009) 0:00:11.861 ********* 2026-08-24 15:39:08.359661 | mon1 | ok: [mon1] 2026-08-24 15:39:08.359967 | mon1 | 2026-08-24 15:39:08.360394 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:39:08.360772 | mon1 | Monday 24 August 2026 15:39:08 +0000 (0:00:00.683) 0:00:12.545 ********* 2026-08-24 15:39:08.618084 | mon1 | ok: [mon1] 2026-08-24 15:39:08.618133 | mon1 | 2026-08-24 15:39:08.618143 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:39:08.618153 | mon1 | Monday 24 August 2026 15:39:08 +0000 (0:00:00.256) 0:00:12.801 ********* 2026-08-24 15:39:08.699341 | mon1 | ok: [mon1] => { 2026-08-24 15:39:08.699386 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-24 15:39:08.699396 | mon1 | } 2026-08-24 15:39:08.699406 | mon1 | 2026-08-24 15:39:08.700004 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:39:08.700047 | mon1 | Monday 24 August 2026 15:39:08 +0000 (0:00:00.082) 0:00:12.884 ********* 2026-08-24 15:39:09.137276 | mon1 | ok: [mon1] 2026-08-24 15:39:09.137331 | mon1 | 2026-08-24 15:39:09.137815 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:39:09.137858 | mon1 | Monday 24 August 2026 15:39:09 +0000 (0:00:00.438) 0:00:13.322 ********* 2026-08-24 15:39:12.574856 | mon1 | ok: [mon1] 2026-08-24 15:39:12.574907 | mon1 | 2026-08-24 15:39:12.574918 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-24 15:39:12.574928 | mon1 | Monday 24 August 2026 15:39:12 +0000 (0:00:03.437) 0:00:16.759 ********* 2026-08-24 15:39:13.546714 | mon1 | ok: [mon1] 2026-08-24 15:39:13.546788 | mon1 | 2026-08-24 15:39:13.546799 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-24 15:39:13.546808 | mon1 | Monday 24 August 2026 15:39:13 +0000 (0:00:00.971) 0:00:17.730 ********* 2026-08-24 15:39:13.900820 | mon1 | ok: [mon1] 2026-08-24 15:39:13.900890 | mon1 | 2026-08-24 15:39:13.900967 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-24 15:39:13.901122 | mon1 | Monday 24 August 2026 15:39:13 +0000 (0:00:00.353) 0:00:18.084 ********* 2026-08-24 15:39:14.453099 | mon1 | ok: [mon1] 2026-08-24 15:39:14.453158 | mon1 | 2026-08-24 15:39:14.453169 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-24 15:39:14.453178 | mon1 | Monday 24 August 2026 15:39:14 +0000 (0:00:00.552) 0:00:18.637 ********* 2026-08-24 15:39:15.196420 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-24 15:39:15.196530 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-24 15:39:15.196578 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-24 15:39:15.196587 | mon1 | 2026-08-24 15:39:15.196597 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-24 15:39:15.196607 | mon1 | Monday 24 August 2026 15:39:15 +0000 (0:00:00.743) 0:00:19.380 ********* 2026-08-24 15:39:15.761701 | mon1 | ok: [mon1] 2026-08-24 15:39:15.761811 | mon1 | 2026-08-24 15:39:15.761822 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-24 15:39:15.761912 | mon1 | Monday 24 August 2026 15:39:15 +0000 (0:00:00.566) 0:00:19.946 ********* 2026-08-24 15:39:16.334346 | mon1 | ok: [mon1] 2026-08-24 15:39:16.334431 | mon1 | 2026-08-24 15:39:16.334551 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-24 15:39:16.334671 | mon1 | Monday 24 August 2026 15:39:16 +0000 (0:00:00.565) 0:00:20.512 ********* 2026-08-24 15:39:16.334776 | mon1 | 2026-08-24 15:39:16.334894 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-24 15:39:16.335003 | mon1 | Monday 24 August 2026 15:39:16 +0000 (0:00:00.007) 0:00:20.520 ********* 2026-08-24 15:39:16.865818 | mon1 | ok: [mon1] 2026-08-24 15:39:16.865869 | mon1 | 2026-08-24 15:39:16.865880 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-24 15:39:16.865890 | mon1 | Monday 24 August 2026 15:39:16 +0000 (0:00:00.530) 0:00:21.050 ********* 2026-08-24 15:39:16.928351 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-24 15:39:16.928467 | mon1 | 2026-08-24 15:39:16.928478 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-24 15:39:16.928497 | mon1 | Monday 24 August 2026 15:39:16 +0000 (0:00:00.062) 0:00:21.113 ********* 2026-08-24 15:39:17.940808 | mon1 | ok: [mon1] 2026-08-24 15:39:17.940922 | mon1 | 2026-08-24 15:39:17.941091 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-24 15:39:17.941322 | mon1 | Monday 24 August 2026 15:39:17 +0000 (0:00:01.013) 0:00:22.126 ********* 2026-08-24 15:39:18.817316 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-24 15:39:18.817383 | mon1 | ok: [mon1] => (item=ssh) 2026-08-24 15:39:18.817398 | mon1 | 2026-08-24 15:39:18.817411 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-24 15:39:18.817422 | mon1 | Monday 24 August 2026 15:39:18 +0000 (0:00:00.874) 0:00:23.000 ********* 2026-08-24 15:39:19.824715 | mon1 | ok: [mon1] 2026-08-24 15:39:19.824824 | mon1 | 2026-08-24 15:39:19.825042 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-24 15:39:19.825235 | mon1 | Monday 24 August 2026 15:39:19 +0000 (0:00:01.006) 0:00:24.007 ********* 2026-08-24 15:39:20.079313 | mon1 | ok: [mon1] 2026-08-24 15:39:20.079424 | mon1 | 2026-08-24 15:39:20.079593 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-24 15:39:20.079761 | mon1 | Monday 24 August 2026 15:39:20 +0000 (0:00:00.257) 0:00:24.264 ********* 2026-08-24 15:39:20.607812 | mon1 | ok: [mon1] 2026-08-24 15:39:20.607866 | mon1 | 2026-08-24 15:39:20.607877 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-24 15:39:20.607886 | mon1 | Monday 24 August 2026 15:39:20 +0000 (0:00:00.527) 0:00:24.791 ********* 2026-08-24 15:39:20.969633 | mon1 | ok: [mon1] 2026-08-24 15:39:20.969698 | mon1 | 2026-08-24 15:39:20.969812 | mon1 | TASK [vexxhost.ceph.mon : Set Ceph Monitor IP address] ************************* 2026-08-24 15:39:20.969926 | mon1 | Monday 24 August 2026 15:39:20 +0000 (0:00:00.362) 0:00:25.154 ********* 2026-08-24 15:39:21.053646 | mon1 | ok: [mon1] 2026-08-24 15:39:21.053713 | mon1 | 2026-08-24 15:39:21.053805 | mon1 | TASK [vexxhost.ceph.mon : Check if any node is bootstrapped] ******************* 2026-08-24 15:39:21.053920 | mon1 | Monday 24 August 2026 15:39:21 +0000 (0:00:00.084) 0:00:25.238 ********* 2026-08-24 15:39:21.345275 | mon1 | ok: [mon1] => (item=mon1) 2026-08-24 15:39:21.346082 | mon1 | 2026-08-24 15:39:21.346136 | mon1 | TASK [vexxhost.ceph.mon : Select pre-existing bootstrap node if exists] ******** 2026-08-24 15:39:21.346147 | mon1 | Monday 24 August 2026 15:39:21 +0000 (0:00:00.290) 0:00:25.529 ********* 2026-08-24 15:39:21.401595 | mon1 | ok: [mon1] 2026-08-24 15:39:21.401647 | mon1 | 2026-08-24 15:39:21.401657 | mon1 | TASK [vexxhost.ceph.mon : Bootstrap cluster] *********************************** 2026-08-24 15:39:21.401666 | mon1 | Monday 24 August 2026 15:39:21 +0000 (0:00:00.056) 0:00:25.586 ********* 2026-08-24 15:39:21.448428 | mon1 | skipping: [mon1] 2026-08-24 15:39:21.448473 | mon1 | 2026-08-24 15:39:21.448480 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-24 15:39:21.448509 | mon1 | Monday 24 August 2026 15:39:21 +0000 (0:00:00.047) 0:00:25.633 ********* 2026-08-24 15:39:21.527636 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-24 15:39:21.527708 | mon1 | 2026-08-24 15:39:21.527787 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-24 15:39:21.527900 | mon1 | Monday 24 August 2026 15:39:21 +0000 (0:00:00.079) 0:00:25.712 ********* 2026-08-24 15:39:23.364130 | mon1 | ok: [mon1] 2026-08-24 15:39:23.364353 | mon1 | 2026-08-24 15:39:23.364382 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-24 15:39:23.364395 | mon1 | Monday 24 August 2026 15:39:23 +0000 (0:00:01.835) 0:00:27.548 ********* 2026-08-24 15:39:23.430142 | mon1 | ok: [mon1] => (item=mon1) 2026-08-24 15:39:23.430180 | mon1 | 2026-08-24 15:39:23.430186 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-24 15:39:23.430209 | mon1 | Monday 24 August 2026 15:39:23 +0000 (0:00:00.066) 0:00:27.614 ********* 2026-08-24 15:39:23.878650 | mon1 | ok: [mon1] 2026-08-24 15:39:23.878764 | mon1 | 2026-08-24 15:39:23.878784 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-24 15:39:23.878922 | mon1 | Monday 24 August 2026 15:39:23 +0000 (0:00:00.447) 0:00:28.062 ********* 2026-08-24 15:39:26.395137 | mon1 | ok: [mon1] 2026-08-24 15:39:26.395227 | mon1 | 2026-08-24 15:39:26.395499 | mon1 | TASK [vexxhost.ceph.mon : Configure "mon" label for monitors] ****************** 2026-08-24 15:39:26.395531 | mon1 | Monday 24 August 2026 15:39:26 +0000 (0:00:02.518) 0:00:30.581 ********* 2026-08-24 15:39:28.210937 | mon1 | ok: [mon1] 2026-08-24 15:39:28.210995 | mon1 | 2026-08-24 15:39:28.211009 | mon1 | TASK [vexxhost.ceph.mon : Validate monitor exist] ****************************** 2026-08-24 15:39:28.211022 | mon1 | Monday 24 August 2026 15:39:28 +0000 (0:00:01.814) 0:00:32.395 ********* 2026-08-24 15:39:29.963752 | mon1 | ok: [mon1] 2026-08-24 15:39:29.963816 | mon1 | 2026-08-24 15:39:29.963831 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-24 15:39:29.963843 | mon1 | Monday 24 August 2026 15:39:29 +0000 (0:00:01.752) 0:00:34.147 ********* 2026-08-24 15:39:30.048824 | mon1 | included: vexxhost.ceph.cephadm_host for mon1 2026-08-24 15:39:30.048883 | mon1 | 2026-08-24 15:39:30.048896 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-24 15:39:30.048909 | mon1 | Monday 24 August 2026 15:39:30 +0000 (0:00:00.085) 0:00:34.233 ********* 2026-08-24 15:39:30.102845 | mon1 | skipping: [mon1] 2026-08-24 15:39:30.103015 | mon1 | 2026-08-24 15:39:30.103221 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-24 15:39:30.103381 | mon1 | Monday 24 August 2026 15:39:30 +0000 (0:00:00.054) 0:00:34.287 ********* 2026-08-24 15:39:30.161938 | mon1 | skipping: [mon1] => (item=mon1) 2026-08-24 15:39:30.161972 | mon1 | skipping: [mon1] 2026-08-24 15:39:30.161985 | mon1 | 2026-08-24 15:39:30.161997 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-24 15:39:30.162009 | mon1 | Monday 24 August 2026 15:39:30 +0000 (0:00:00.059) 0:00:34.346 ********* 2026-08-24 15:39:30.484236 | mon1 | ok: [mon1] 2026-08-24 15:39:30.484266 | mon1 | 2026-08-24 15:39:30.484273 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-24 15:39:30.484279 | mon1 | Monday 24 August 2026 15:39:30 +0000 (0:00:00.320) 0:00:34.667 ********* 2026-08-24 15:39:33.054227 | mon1 | ok: [mon1] 2026-08-24 15:39:33.054285 | mon1 | 2026-08-24 15:39:33.054300 | mon1 | TASK [vexxhost.ceph.mgr : Configure "mgr" label for managers] ****************** 2026-08-24 15:39:33.054312 | mon1 | Monday 24 August 2026 15:39:33 +0000 (0:00:02.570) 0:00:37.237 ********* 2026-08-24 15:39:34.869379 | mon1 | ok: [mon1] 2026-08-24 15:39:34.869459 | mon1 | 2026-08-24 15:39:34.869480 | mon1 | TASK [vexxhost.ceph.mgr : Validate manager exist] ****************************** 2026-08-24 15:39:34.869789 | mon1 | Monday 24 August 2026 15:39:34 +0000 (0:00:01.816) 0:00:39.054 ********* 2026-08-24 15:39:36.707063 | mon1 | ok: [mon1] 2026-08-24 15:39:36.707133 | mon1 | 2026-08-24 15:39:36.707147 | mon1 | TASK [vexxhost.ceph.mgr : Configure manager modules] *************************** 2026-08-24 15:39:36.707159 | mon1 | Monday 24 August 2026 15:39:36 +0000 (0:00:01.836) 0:00:40.890 ********* 2026-08-24 15:39:45.198377 | mon1 | ok: [mon1] => (item={'name': 'diskprediction_local'}) 2026-08-24 15:39:45.198479 | mon1 | ok: [mon1] => (item={'name': 'dashboard'}) 2026-08-24 15:39:45.199281 | mon1 | ok: [mon1] => (item={'name': 'prometheus'}) 2026-08-24 15:39:45.199367 | mon1 | ok: [mon1] => (item={'name': 'iostat'}) 2026-08-24 15:39:45.199381 | mon1 | 2026-08-24 15:39:45.199400 | mon1 | PLAY [Deploy Ceph OSDs] ******************************************************** 2026-08-24 15:39:45.200128 | mon1 | 2026-08-24 15:39:45.200162 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:39:45.200175 | mon1 | Monday 24 August 2026 15:39:45 +0000 (0:00:08.492) 0:00:49.383 ********* 2026-08-24 15:39:46.451392 | mon1 | [WARNING]: Platform linux on host osd1 is using the discovered Python 2026-08-24 15:39:46.451475 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:39:46.452309 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:39:46.452376 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:39:46.452391 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:39:46.463856 | mon1 | ok: [osd1] 2026-08-24 15:39:46.463891 | mon1 | 2026-08-24 15:39:46.463904 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:39:46.463917 | mon1 | Monday 24 August 2026 15:39:46 +0000 (0:00:01.264) 0:00:50.647 ********* 2026-08-24 15:39:46.723867 | mon1 | ok: [osd1] 2026-08-24 15:39:46.723929 | mon1 | 2026-08-24 15:39:46.723943 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:39:46.723956 | mon1 | Monday 24 August 2026 15:39:46 +0000 (0:00:00.260) 0:00:50.908 ********* 2026-08-24 15:39:46.766300 | mon1 | skipping: [osd1] 2026-08-24 15:39:46.766367 | mon1 | 2026-08-24 15:39:46.766387 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-24 15:39:46.766633 | mon1 | Monday 24 August 2026 15:39:46 +0000 (0:00:00.043) 0:00:50.951 ********* 2026-08-24 15:39:47.052122 | mon1 | ok: [osd1] 2026-08-24 15:39:47.052233 | mon1 | 2026-08-24 15:39:47.052257 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:39:47.052271 | mon1 | Monday 24 August 2026 15:39:47 +0000 (0:00:00.284) 0:00:51.235 ********* 2026-08-24 15:39:47.138300 | mon1 | ok: [osd1] => { 2026-08-24 15:39:47.139241 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-24 15:39:47.139259 | mon1 | } 2026-08-24 15:39:47.139265 | mon1 | 2026-08-24 15:39:47.139519 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:39:47.139801 | mon1 | Monday 24 August 2026 15:39:47 +0000 (0:00:00.086) 0:00:51.322 ********* 2026-08-24 15:39:47.548839 | mon1 | ok: [osd1] 2026-08-24 15:39:47.548895 | mon1 | 2026-08-24 15:39:47.548909 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:39:47.548922 | mon1 | Monday 24 August 2026 15:39:47 +0000 (0:00:00.410) 0:00:51.733 ********* 2026-08-24 15:39:47.599385 | mon1 | skipping: [osd1] 2026-08-24 15:39:47.599441 | mon1 | 2026-08-24 15:39:47.599450 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:39:47.599480 | mon1 | Monday 24 August 2026 15:39:47 +0000 (0:00:00.051) 0:00:51.784 ********* 2026-08-24 15:39:47.647586 | mon1 | skipping: [osd1] 2026-08-24 15:39:47.647632 | mon1 | 2026-08-24 15:39:47.647642 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:39:47.647651 | mon1 | Monday 24 August 2026 15:39:47 +0000 (0:00:00.048) 0:00:51.832 ********* 2026-08-24 15:39:47.912918 | mon1 | ok: [osd1] 2026-08-24 15:39:47.912949 | mon1 | 2026-08-24 15:39:47.912954 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:39:47.912959 | mon1 | Monday 24 August 2026 15:39:47 +0000 (0:00:00.264) 0:00:52.097 ********* 2026-08-24 15:39:48.840880 | mon1 | ok: [osd1] 2026-08-24 15:39:48.841572 | mon1 | 2026-08-24 15:39:48.841590 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:39:48.841597 | mon1 | Monday 24 August 2026 15:39:48 +0000 (0:00:00.928) 0:00:53.026 ********* 2026-08-24 15:39:49.042181 | mon1 | ok: [osd1] => { 2026-08-24 15:39:49.042230 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-24 15:39:49.042244 | mon1 | } 2026-08-24 15:39:49.042249 | mon1 | 2026-08-24 15:39:49.042253 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:39:49.042257 | mon1 | Monday 24 August 2026 15:39:49 +0000 (0:00:00.200) 0:00:53.226 ********* 2026-08-24 15:39:49.575838 | mon1 | ok: [osd1] 2026-08-24 15:39:49.575912 | mon1 | 2026-08-24 15:39:49.575927 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:39:49.576063 | mon1 | Monday 24 August 2026 15:39:49 +0000 (0:00:00.533) 0:00:53.760 ********* 2026-08-24 15:39:51.873048 | mon1 | ok: [osd1] 2026-08-24 15:39:51.873122 | mon1 | 2026-08-24 15:39:51.873143 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-24 15:39:51.873154 | mon1 | Monday 24 August 2026 15:39:51 +0000 (0:00:02.296) 0:00:56.057 ********* 2026-08-24 15:39:51.909538 | mon1 | skipping: [osd1] 2026-08-24 15:39:51.909589 | mon1 | 2026-08-24 15:39:51.909597 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-24 15:39:51.909604 | mon1 | Monday 24 August 2026 15:39:51 +0000 (0:00:00.036) 0:00:56.093 ********* 2026-08-24 15:39:51.944689 | mon1 | skipping: [osd1] 2026-08-24 15:39:51.944743 | mon1 | 2026-08-24 15:39:51.944755 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-24 15:39:51.944765 | mon1 | Monday 24 August 2026 15:39:51 +0000 (0:00:00.034) 0:00:56.128 ********* 2026-08-24 15:39:51.983360 | mon1 | skipping: [osd1] 2026-08-24 15:39:51.983423 | mon1 | 2026-08-24 15:39:51.983430 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-24 15:39:51.983442 | mon1 | Monday 24 August 2026 15:39:51 +0000 (0:00:00.039) 0:00:56.168 ********* 2026-08-24 15:39:52.946164 | mon1 | ok: [osd1] 2026-08-24 15:39:52.946406 | mon1 | 2026-08-24 15:39:52.946684 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-24 15:39:52.946973 | mon1 | Monday 24 August 2026 15:39:52 +0000 (0:00:00.963) 0:00:57.131 ********* 2026-08-24 15:39:53.507425 | mon1 | ok: [osd1] 2026-08-24 15:39:53.507523 | mon1 | 2026-08-24 15:39:53.507534 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-24 15:39:53.507612 | mon1 | Monday 24 August 2026 15:39:53 +0000 (0:00:00.560) 0:00:57.692 ********* 2026-08-24 15:39:54.655814 | mon1 | ok: [osd1] => (item={'path': '/etc/containerd'}) 2026-08-24 15:39:54.655939 | mon1 | ok: [osd1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-24 15:39:54.655952 | mon1 | ok: [osd1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-24 15:39:54.657274 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-24 15:39:54.657320 | mon1 | ok: [osd1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-24 15:39:54.657338 | mon1 | 2026-08-24 15:39:54.657350 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-24 15:39:54.657354 | mon1 | Monday 24 August 2026 15:39:54 +0000 (0:00:01.149) 0:00:58.841 ********* 2026-08-24 15:39:55.368300 | mon1 | ok: [osd1] 2026-08-24 15:39:55.368362 | mon1 | 2026-08-24 15:39:55.368372 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-24 15:39:55.368382 | mon1 | Monday 24 August 2026 15:39:55 +0000 (0:00:00.703) 0:00:59.545 ********* 2026-08-24 15:39:55.368397 | mon1 | 2026-08-24 15:39:55.369100 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-24 15:39:55.369175 | mon1 | Monday 24 August 2026 15:39:55 +0000 (0:00:00.006) 0:00:59.551 ********* 2026-08-24 15:39:55.851337 | mon1 | ok: [osd1] 2026-08-24 15:39:55.851417 | mon1 | 2026-08-24 15:39:55.851427 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:39:55.851437 | mon1 | Monday 24 August 2026 15:39:55 +0000 (0:00:00.483) 0:01:00.034 ********* 2026-08-24 15:39:56.110058 | mon1 | ok: [osd1] 2026-08-24 15:39:56.110137 | mon1 | 2026-08-24 15:39:56.110147 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:39:56.110157 | mon1 | Monday 24 August 2026 15:39:56 +0000 (0:00:00.259) 0:01:00.294 ********* 2026-08-24 15:39:56.206183 | mon1 | ok: [osd1] => { 2026-08-24 15:39:56.206295 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-24 15:39:56.206307 | mon1 | } 2026-08-24 15:39:56.206318 | mon1 | 2026-08-24 15:39:56.206328 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:39:56.206338 | mon1 | Monday 24 August 2026 15:39:56 +0000 (0:00:00.095) 0:01:00.389 ********* 2026-08-24 15:39:56.661056 | mon1 | ok: [osd1] 2026-08-24 15:39:56.661156 | mon1 | 2026-08-24 15:39:56.661167 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:39:56.661176 | mon1 | Monday 24 August 2026 15:39:56 +0000 (0:00:00.455) 0:01:00.845 ********* 2026-08-24 15:40:00.005934 | mon1 | ok: [osd1] 2026-08-24 15:40:00.005999 | mon1 | 2026-08-24 15:40:00.006011 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-24 15:40:00.006020 | mon1 | Monday 24 August 2026 15:40:00 +0000 (0:00:03.343) 0:01:04.188 ********* 2026-08-24 15:40:00.972138 | mon1 | ok: [osd1] 2026-08-24 15:40:00.972257 | mon1 | 2026-08-24 15:40:00.972273 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-24 15:40:00.972283 | mon1 | Monday 24 August 2026 15:40:00 +0000 (0:00:00.967) 0:01:05.156 ********* 2026-08-24 15:40:01.236714 | mon1 | ok: [osd1] 2026-08-24 15:40:01.236770 | mon1 | 2026-08-24 15:40:01.236780 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-24 15:40:01.236788 | mon1 | Monday 24 August 2026 15:40:01 +0000 (0:00:00.264) 0:01:05.420 ********* 2026-08-24 15:40:01.816384 | mon1 | ok: [osd1] 2026-08-24 15:40:01.816455 | mon1 | 2026-08-24 15:40:01.816467 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-24 15:40:01.816792 | mon1 | Monday 24 August 2026 15:40:01 +0000 (0:00:00.579) 0:01:05.999 ********* 2026-08-24 15:40:02.549100 | mon1 | ok: [osd1] => (item={'path': '/etc/docker'}) 2026-08-24 15:40:02.549366 | mon1 | ok: [osd1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-24 15:40:02.549628 | mon1 | ok: [osd1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-24 15:40:02.549861 | mon1 | 2026-08-24 15:40:02.550120 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-24 15:40:02.550413 | mon1 | Monday 24 August 2026 15:40:02 +0000 (0:00:00.734) 0:01:06.734 ********* 2026-08-24 15:40:03.117011 | mon1 | ok: [osd1] 2026-08-24 15:40:03.117167 | mon1 | 2026-08-24 15:40:03.117440 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-24 15:40:03.117662 | mon1 | Monday 24 August 2026 15:40:03 +0000 (0:00:00.567) 0:01:07.301 ********* 2026-08-24 15:40:03.684303 | mon1 | ok: [osd1] 2026-08-24 15:40:03.684365 | mon1 | 2026-08-24 15:40:03.684407 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-24 15:40:03.684432 | mon1 | Monday 24 August 2026 15:40:03 +0000 (0:00:00.559) 0:01:07.861 ********* 2026-08-24 15:40:03.684442 | mon1 | 2026-08-24 15:40:03.684452 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-24 15:40:03.684461 | mon1 | Monday 24 August 2026 15:40:03 +0000 (0:00:00.006) 0:01:07.868 ********* 2026-08-24 15:40:04.196860 | mon1 | ok: [osd1] 2026-08-24 15:40:04.196919 | mon1 | 2026-08-24 15:40:04.196933 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-24 15:40:04.196945 | mon1 | Monday 24 August 2026 15:40:04 +0000 (0:00:00.513) 0:01:08.381 ********* 2026-08-24 15:40:04.255942 | mon1 | ok: [osd1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-24 15:40:04.256000 | mon1 | 2026-08-24 15:40:04.256010 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-24 15:40:04.256020 | mon1 | Monday 24 August 2026 15:40:04 +0000 (0:00:00.058) 0:01:08.440 ********* 2026-08-24 15:40:05.199804 | mon1 | ok: [osd1] 2026-08-24 15:40:05.199860 | mon1 | 2026-08-24 15:40:05.199871 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-24 15:40:05.199880 | mon1 | Monday 24 August 2026 15:40:05 +0000 (0:00:00.943) 0:01:09.384 ********* 2026-08-24 15:40:06.054104 | mon1 | ok: [osd1] => (item=systemd-timesyncd) 2026-08-24 15:40:06.054169 | mon1 | ok: [osd1] => (item=ssh) 2026-08-24 15:40:06.054180 | mon1 | 2026-08-24 15:40:06.054190 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-24 15:40:06.054233 | mon1 | Monday 24 August 2026 15:40:06 +0000 (0:00:00.854) 0:01:10.238 ********* 2026-08-24 15:40:06.997329 | mon1 | ok: [osd1] 2026-08-24 15:40:06.998137 | mon1 | 2026-08-24 15:40:06.998247 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-24 15:40:06.998281 | mon1 | Monday 24 August 2026 15:40:06 +0000 (0:00:00.943) 0:01:11.182 ********* 2026-08-24 15:40:07.261295 | mon1 | ok: [osd1] 2026-08-24 15:40:07.261369 | mon1 | 2026-08-24 15:40:07.261882 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-24 15:40:07.261933 | mon1 | Monday 24 August 2026 15:40:07 +0000 (0:00:00.264) 0:01:11.446 ********* 2026-08-24 15:40:07.589237 | mon1 | ok: [osd1] 2026-08-24 15:40:07.589327 | mon1 | 2026-08-24 15:40:07.589338 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-24 15:40:07.589348 | mon1 | Monday 24 August 2026 15:40:07 +0000 (0:00:00.325) 0:01:11.771 ********* 2026-08-24 15:40:07.844810 | mon1 | ok: [osd1] 2026-08-24 15:40:07.844889 | mon1 | 2026-08-24 15:40:07.844897 | mon1 | TASK [vexxhost.ceph.osd : Get monitor status] ********************************** 2026-08-24 15:40:07.844905 | mon1 | Monday 24 August 2026 15:40:07 +0000 (0:00:00.257) 0:01:12.029 ********* 2026-08-24 15:40:08.121900 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] => (item=mon1) 2026-08-24 15:40:08.121959 | mon1 | 2026-08-24 15:40:08.121970 | mon1 | TASK [vexxhost.ceph.osd : Select admin host] *********************************** 2026-08-24 15:40:08.121980 | mon1 | Monday 24 August 2026 15:40:08 +0000 (0:00:00.277) 0:01:12.306 ********* 2026-08-24 15:40:08.175926 | mon1 | ok: [osd1] 2026-08-24 15:40:08.175980 | mon1 | 2026-08-24 15:40:08.175992 | mon1 | TASK [Install Ceph host] ******************************************************* 2026-08-24 15:40:08.176003 | mon1 | Monday 24 August 2026 15:40:08 +0000 (0:00:00.054) 0:01:12.360 ********* 2026-08-24 15:40:08.232698 | mon1 | included: vexxhost.ceph.cephadm_host for osd1 2026-08-24 15:40:08.232741 | mon1 | 2026-08-24 15:40:08.232752 | mon1 | TASK [vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user] ****** 2026-08-24 15:40:08.232761 | mon1 | Monday 24 August 2026 15:40:08 +0000 (0:00:00.057) 0:01:12.417 ********* 2026-08-24 15:40:10.012318 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:40:10.012400 | mon1 | 2026-08-24 15:40:10.012414 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set fact with public SSH key for "cephadm" user] *** 2026-08-24 15:40:10.012457 | mon1 | Monday 24 August 2026 15:40:10 +0000 (0:00:01.779) 0:01:14.196 ********* 2026-08-24 15:40:10.079019 | mon1 | ok: [osd1] => (item=osd1) 2026-08-24 15:40:10.079066 | mon1 | 2026-08-24 15:40:10.079077 | mon1 | TASK [vexxhost.ceph.cephadm_host : Set authorized key for "cephadm"] *********** 2026-08-24 15:40:10.079086 | mon1 | Monday 24 August 2026 15:40:10 +0000 (0:00:00.066) 0:01:14.263 ********* 2026-08-24 15:40:10.412460 | mon1 | ok: [osd1] 2026-08-24 15:40:10.412559 | mon1 | 2026-08-24 15:40:10.412575 | mon1 | TASK [vexxhost.ceph.cephadm_host : Add new host to Ceph] *********************** 2026-08-24 15:40:10.412589 | mon1 | Monday 24 August 2026 15:40:10 +0000 (0:00:00.331) 0:01:14.595 ********* 2026-08-24 15:40:13.008848 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:40:13.008891 | mon1 | 2026-08-24 15:40:13.008898 | mon1 | TASK [vexxhost.ceph.osd : Ensure all OSDs are non-legacy] ********************** 2026-08-24 15:40:13.008904 | mon1 | Monday 24 August 2026 15:40:13 +0000 (0:00:02.596) 0:01:17.191 ********* 2026-08-24 15:40:18.975184 | mon1 | ok: [osd1] 2026-08-24 15:40:18.975341 | mon1 | 2026-08-24 15:40:18.975356 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph-volume lvm list` status] ******************* 2026-08-24 15:40:18.975373 | mon1 | Monday 24 August 2026 15:40:18 +0000 (0:00:05.969) 0:01:23.161 ********* 2026-08-24 15:40:20.434124 | mon1 | ok: [osd1] 2026-08-24 15:40:20.434231 | mon1 | 2026-08-24 15:40:20.434257 | mon1 | TASK [vexxhost.ceph.osd : Install OSDs] **************************************** 2026-08-24 15:40:20.434271 | mon1 | Monday 24 August 2026 15:40:20 +0000 (0:00:01.456) 0:01:24.617 ********* 2026-08-24 15:40:20.515274 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd0/data) 2026-08-24 15:40:20.515336 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd1/data) 2026-08-24 15:40:20.515348 | mon1 | skipping: [osd1] => (item=/dev/ceph-osd1-osd2/data) 2026-08-24 15:40:20.515360 | mon1 | skipping: [osd1] 2026-08-24 15:40:20.515372 | mon1 | 2026-08-24 15:40:20.515384 | mon1 | TASK [vexxhost.ceph.osd : Get mon dump] **************************************** 2026-08-24 15:40:20.515528 | mon1 | Monday 24 August 2026 15:40:20 +0000 (0:00:00.080) 0:01:24.697 ********* 2026-08-24 15:40:22.494024 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:40:22.494429 | mon1 | 2026-08-24 15:40:22.494775 | mon1 | TASK [vexxhost.ceph.osd : Mark require osd release] **************************** 2026-08-24 15:40:22.495101 | mon1 | Monday 24 August 2026 15:40:22 +0000 (0:00:01.981) 0:01:26.679 ********* 2026-08-24 15:40:24.611605 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:40:24.612057 | mon1 | 2026-08-24 15:40:24.612503 | mon1 | TASK [vexxhost.ceph.osd : Wait for all OSD to be running] ********************** 2026-08-24 15:40:24.612879 | mon1 | Monday 24 August 2026 15:40:24 +0000 (0:00:02.116) 0:01:28.795 ********* 2026-08-24 15:40:24.680738 | mon1 | included: /home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/osd/tasks/check-osds.yml for osd1 2026-08-24 15:40:24.680810 | mon1 | 2026-08-24 15:40:24.680940 | mon1 | TASK [vexxhost.ceph.osd : Set the retry count] ********************************* 2026-08-24 15:40:24.681087 | mon1 | Monday 24 August 2026 15:40:24 +0000 (0:00:00.071) 0:01:28.866 ********* 2026-08-24 15:40:24.738586 | mon1 | ok: [osd1] 2026-08-24 15:40:24.738699 | mon1 | 2026-08-24 15:40:24.739013 | mon1 | TASK [vexxhost.ceph.osd : Get `ceph orch ps`] ********************************** 2026-08-24 15:40:24.739314 | mon1 | Monday 24 August 2026 15:40:24 +0000 (0:00:00.056) 0:01:28.923 ********* 2026-08-24 15:40:26.693502 | mon1 | ok: [osd1 -> mon1({{ nodepool.private_ipv4 }})] 2026-08-24 15:40:26.693867 | mon1 | 2026-08-24 15:40:26.694151 | mon1 | TASK [vexxhost.ceph.osd : OSD daemon list] ************************************* 2026-08-24 15:40:26.694477 | mon1 | Monday 24 August 2026 15:40:26 +0000 (0:00:01.955) 0:01:30.879 ********* 2026-08-24 15:40:26.754610 | mon1 | ok: [osd1] 2026-08-24 15:40:26.754802 | mon1 | 2026-08-24 15:40:26.755090 | mon1 | TASK [vexxhost.ceph.osd : Fail if any OSD not running] ************************* 2026-08-24 15:40:26.755423 | mon1 | Monday 24 August 2026 15:40:26 +0000 (0:00:00.060) 0:01:30.939 ********* 2026-08-24 15:40:26.802332 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:40:26.802408 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:40:26.802530 | mon1 | skipping: [osd1] => (item=1) 2026-08-24 15:40:26.802637 | mon1 | skipping: [osd1] 2026-08-24 15:40:26.802741 | mon1 | 2026-08-24 15:40:26.802863 | mon1 | TASK [vexxhost.ceph.osd : Fail if any duplicate OSD ID] ************************ 2026-08-24 15:40:26.802971 | mon1 | Monday 24 August 2026 15:40:26 +0000 (0:00:00.047) 0:01:30.987 ********* 2026-08-24 15:40:26.877980 | mon1 | skipping: [osd1] 2026-08-24 15:40:26.878285 | mon1 | 2026-08-24 15:40:26.878592 | mon1 | PLAY [Deploy Ceph exporters] *************************************************** 2026-08-24 15:40:26.878846 | mon1 | 2026-08-24 15:40:26.879149 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:40:26.879464 | mon1 | Monday 24 August 2026 15:40:26 +0000 (0:00:00.076) 0:01:31.063 ********* 2026-08-24 15:40:28.933418 | mon1 | ok: [mon1] 2026-08-24 15:40:28.933598 | mon1 | 2026-08-24 15:40:28.933935 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:40:28.934232 | mon1 | Monday 24 August 2026 15:40:28 +0000 (0:00:02.055) 0:01:33.118 ********* 2026-08-24 15:40:29.205104 | mon1 | ok: [mon1] 2026-08-24 15:40:29.205238 | mon1 | 2026-08-24 15:40:29.205319 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:40:29.205472 | mon1 | Monday 24 August 2026 15:40:29 +0000 (0:00:00.271) 0:01:33.390 ********* 2026-08-24 15:40:29.291184 | mon1 | skipping: [mon1] 2026-08-24 15:40:29.291299 | mon1 | 2026-08-24 15:40:29.291446 | mon1 | TASK [vexxhost.containers.directory : Create directory (/var/lib/downloads)] *** 2026-08-24 15:40:29.291596 | mon1 | Monday 24 August 2026 15:40:29 +0000 (0:00:00.086) 0:01:33.477 ********* 2026-08-24 15:40:29.568140 | mon1 | ok: [mon1] 2026-08-24 15:40:29.568301 | mon1 | 2026-08-24 15:40:29.568656 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:40:29.568925 | mon1 | Monday 24 August 2026 15:40:29 +0000 (0:00:00.276) 0:01:33.753 ********* 2026-08-24 15:40:29.652707 | mon1 | ok: [mon1] => { 2026-08-24 15:40:29.652924 | mon1 | "msg": "https://github.com/opencontainers/runc/releases/download/v1.4.2/runc.amd64" 2026-08-24 15:40:29.653189 | mon1 | } 2026-08-24 15:40:29.653452 | mon1 | 2026-08-24 15:40:29.653799 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:40:29.654050 | mon1 | Monday 24 August 2026 15:40:29 +0000 (0:00:00.084) 0:01:33.838 ********* 2026-08-24 15:40:30.066388 | mon1 | ok: [mon1] 2026-08-24 15:40:30.066447 | mon1 | 2026-08-24 15:40:30.066870 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:40:30.066914 | mon1 | Monday 24 August 2026 15:40:30 +0000 (0:00:00.413) 0:01:34.251 ********* 2026-08-24 15:40:30.115932 | mon1 | skipping: [mon1] 2026-08-24 15:40:30.115993 | mon1 | 2026-08-24 15:40:30.116004 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:40:30.116014 | mon1 | Monday 24 August 2026 15:40:30 +0000 (0:00:00.048) 0:01:34.299 ********* 2026-08-24 15:40:30.170441 | mon1 | skipping: [mon1] 2026-08-24 15:40:30.170547 | mon1 | 2026-08-24 15:40:30.170560 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:40:30.170595 | mon1 | Monday 24 August 2026 15:40:30 +0000 (0:00:00.054) 0:01:34.354 ********* 2026-08-24 15:40:30.428764 | mon1 | ok: [mon1] 2026-08-24 15:40:30.428819 | mon1 | 2026-08-24 15:40:30.428939 | mon1 | TASK [vexxhost.containers.package : Update state for tar] ********************** 2026-08-24 15:40:30.429056 | mon1 | Monday 24 August 2026 15:40:30 +0000 (0:00:00.259) 0:01:34.614 ********* 2026-08-24 15:40:31.602952 | mon1 | ok: [mon1] 2026-08-24 15:40:31.603008 | mon1 | 2026-08-24 15:40:31.603019 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:40:31.603029 | mon1 | Monday 24 August 2026 15:40:31 +0000 (0:00:01.172) 0:01:35.787 ********* 2026-08-24 15:40:31.816426 | mon1 | ok: [mon1] => { 2026-08-24 15:40:31.816491 | mon1 | "msg": "https://github.com/containerd/containerd/releases/download/v2.3.2/containerd-2.3.2-linux-amd64.tar.gz" 2026-08-24 15:40:31.816536 | mon1 | } 2026-08-24 15:40:31.816546 | mon1 | 2026-08-24 15:40:31.816556 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:40:31.816565 | mon1 | Monday 24 August 2026 15:40:31 +0000 (0:00:00.212) 0:01:35.999 ********* 2026-08-24 15:40:32.387897 | mon1 | ok: [mon1] 2026-08-24 15:40:32.387943 | mon1 | 2026-08-24 15:40:32.387954 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:40:32.387964 | mon1 | Monday 24 August 2026 15:40:32 +0000 (0:00:00.572) 0:01:36.571 ********* 2026-08-24 15:40:35.694254 | mon1 | ok: [mon1] 2026-08-24 15:40:35.695083 | mon1 | 2026-08-24 15:40:35.695123 | mon1 | TASK [vexxhost.containers.containerd : Install SELinux packages] *************** 2026-08-24 15:40:35.695135 | mon1 | Monday 24 August 2026 15:40:35 +0000 (0:00:03.306) 0:01:39.878 ********* 2026-08-24 15:40:35.726952 | mon1 | skipping: [mon1] 2026-08-24 15:40:35.727183 | mon1 | 2026-08-24 15:40:35.727492 | mon1 | TASK [vexxhost.containers.containerd : Set SELinux to permissive at runtime] *** 2026-08-24 15:40:35.727766 | mon1 | Monday 24 August 2026 15:40:35 +0000 (0:00:00.033) 0:01:39.911 ********* 2026-08-24 15:40:35.764544 | mon1 | skipping: [mon1] 2026-08-24 15:40:35.764573 | mon1 | 2026-08-24 15:40:35.764583 | mon1 | TASK [vexxhost.containers.containerd : Persist SELinux permissive mode] ******** 2026-08-24 15:40:35.764592 | mon1 | Monday 24 August 2026 15:40:35 +0000 (0:00:00.036) 0:01:39.948 ********* 2026-08-24 15:40:35.796373 | mon1 | skipping: [mon1] 2026-08-24 15:40:35.796435 | mon1 | 2026-08-24 15:40:35.796452 | mon1 | TASK [vexxhost.containers.containerd : Install AppArmor packages] ************** 2026-08-24 15:40:35.796637 | mon1 | Monday 24 August 2026 15:40:35 +0000 (0:00:00.033) 0:01:39.981 ********* 2026-08-24 15:40:36.898365 | mon1 | ok: [mon1] 2026-08-24 15:40:36.898439 | mon1 | 2026-08-24 15:40:36.899069 | mon1 | TASK [vexxhost.containers.containerd : Create systemd service file for containerd] *** 2026-08-24 15:40:36.899129 | mon1 | Monday 24 August 2026 15:40:36 +0000 (0:00:01.102) 0:01:41.083 ********* 2026-08-24 15:40:37.470894 | mon1 | ok: [mon1] 2026-08-24 15:40:37.470948 | mon1 | 2026-08-24 15:40:37.470960 | mon1 | TASK [vexxhost.containers.containerd : Create folders for configuration] ******* 2026-08-24 15:40:37.470970 | mon1 | Monday 24 August 2026 15:40:37 +0000 (0:00:00.571) 0:01:41.655 ********* 2026-08-24 15:40:38.656352 | mon1 | ok: [mon1] => (item={'path': '/etc/containerd'}) 2026-08-24 15:40:38.656434 | mon1 | ok: [mon1] => (item={'path': '/var/lib/containerd', 'mode': '0o700'}) 2026-08-24 15:40:38.658029 | mon1 | ok: [mon1] => (item={'path': '/run/containerd', 'mode': '0o711'}) 2026-08-24 15:40:38.658096 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.grpc.v1.cri', 'mode': '0o700'}) 2026-08-24 15:40:38.658108 | mon1 | ok: [mon1] => (item={'path': '/run/containerd/io.containerd.sandbox.controller.v1.shim', 'mode': '0o700'}) 2026-08-24 15:40:38.658117 | mon1 | 2026-08-24 15:40:38.658127 | mon1 | TASK [vexxhost.containers.containerd : Create containerd config file] ********** 2026-08-24 15:40:38.658135 | mon1 | Monday 24 August 2026 15:40:38 +0000 (0:00:01.185) 0:01:42.840 ********* 2026-08-24 15:40:39.352269 | mon1 | ok: [mon1] 2026-08-24 15:40:39.352298 | mon1 | 2026-08-24 15:40:39.352303 | mon1 | TASK [vexxhost.containers.containerd : Force any restarts if necessary] ******** 2026-08-24 15:40:39.352307 | mon1 | Monday 24 August 2026 15:40:39 +0000 (0:00:00.688) 0:01:43.529 ********* 2026-08-24 15:40:39.352311 | mon1 | 2026-08-24 15:40:39.352315 | mon1 | TASK [vexxhost.containers.containerd : Enable and start service] *************** 2026-08-24 15:40:39.352319 | mon1 | Monday 24 August 2026 15:40:39 +0000 (0:00:00.005) 0:01:43.535 ********* 2026-08-24 15:40:39.811096 | mon1 | ok: [mon1] 2026-08-24 15:40:39.811146 | mon1 | 2026-08-24 15:40:39.811154 | mon1 | TASK [vexxhost.containers.forget_package : Forget package] ********************* 2026-08-24 15:40:39.811161 | mon1 | Monday 24 August 2026 15:40:39 +0000 (0:00:00.460) 0:01:43.996 ********* 2026-08-24 15:40:40.066237 | mon1 | ok: [mon1] 2026-08-24 15:40:40.066309 | mon1 | 2026-08-24 15:40:40.066320 | mon1 | TASK [vexxhost.containers.download_artifact : Starting download of file] ******* 2026-08-24 15:40:40.066330 | mon1 | Monday 24 August 2026 15:40:40 +0000 (0:00:00.254) 0:01:44.251 ********* 2026-08-24 15:40:40.151310 | mon1 | ok: [mon1] => { 2026-08-24 15:40:40.151374 | mon1 | "msg": "https://download.docker.com/linux/static/stable/x86_64/docker-24.0.9.tgz" 2026-08-24 15:40:40.151385 | mon1 | } 2026-08-24 15:40:40.151401 | mon1 | 2026-08-24 15:40:40.151634 | mon1 | TASK [vexxhost.containers.download_artifact : Download item] ******************* 2026-08-24 15:40:40.151886 | mon1 | Monday 24 August 2026 15:40:40 +0000 (0:00:00.085) 0:01:44.336 ********* 2026-08-24 15:40:40.621329 | mon1 | ok: [mon1] 2026-08-24 15:40:40.621531 | mon1 | 2026-08-24 15:40:40.621805 | mon1 | TASK [vexxhost.containers.download_artifact : Extract archive] ***************** 2026-08-24 15:40:40.622101 | mon1 | Monday 24 August 2026 15:40:40 +0000 (0:00:00.470) 0:01:44.806 ********* 2026-08-24 15:40:43.968513 | mon1 | ok: [mon1] 2026-08-24 15:40:43.968722 | mon1 | 2026-08-24 15:40:43.968992 | mon1 | TASK [vexxhost.containers.docker : Install AppArmor packages] ****************** 2026-08-24 15:40:43.969276 | mon1 | Monday 24 August 2026 15:40:43 +0000 (0:00:03.347) 0:01:48.153 ********* 2026-08-24 15:40:44.962073 | mon1 | ok: [mon1] 2026-08-24 15:40:44.962393 | mon1 | 2026-08-24 15:40:44.962698 | mon1 | TASK [vexxhost.containers.docker : Ensure group "docker" exists] *************** 2026-08-24 15:40:44.962959 | mon1 | Monday 24 August 2026 15:40:44 +0000 (0:00:00.993) 0:01:49.147 ********* 2026-08-24 15:40:45.219475 | mon1 | ok: [mon1] 2026-08-24 15:40:45.219567 | mon1 | 2026-08-24 15:40:45.219579 | mon1 | TASK [vexxhost.containers.docker : Create systemd service file for docker] ***** 2026-08-24 15:40:45.219588 | mon1 | Monday 24 August 2026 15:40:45 +0000 (0:00:00.256) 0:01:49.404 ********* 2026-08-24 15:40:45.774954 | mon1 | ok: [mon1] 2026-08-24 15:40:45.775008 | mon1 | 2026-08-24 15:40:45.775019 | mon1 | TASK [vexxhost.containers.docker : Create folders for configuration] *********** 2026-08-24 15:40:45.775030 | mon1 | Monday 24 August 2026 15:40:45 +0000 (0:00:00.555) 0:01:49.959 ********* 2026-08-24 15:40:46.482736 | mon1 | ok: [mon1] => (item={'path': '/etc/docker'}) 2026-08-24 15:40:46.482874 | mon1 | ok: [mon1] => (item={'path': '/var/lib/docker', 'mode': '0o710'}) 2026-08-24 15:40:46.483723 | mon1 | ok: [mon1] => (item={'path': '/run/docker', 'mode': '0o711'}) 2026-08-24 15:40:46.483746 | mon1 | 2026-08-24 15:40:46.483754 | mon1 | TASK [vexxhost.containers.docker : Create systemd socket file for docker] ****** 2026-08-24 15:40:46.483762 | mon1 | Monday 24 August 2026 15:40:46 +0000 (0:00:00.708) 0:01:50.667 ********* 2026-08-24 15:40:47.044690 | mon1 | ok: [mon1] 2026-08-24 15:40:47.044759 | mon1 | 2026-08-24 15:40:47.044929 | mon1 | TASK [vexxhost.containers.docker : Create docker daemon config file] *********** 2026-08-24 15:40:47.045075 | mon1 | Monday 24 August 2026 15:40:47 +0000 (0:00:00.561) 0:01:51.229 ********* 2026-08-24 15:40:47.600648 | mon1 | ok: [mon1] 2026-08-24 15:40:47.600699 | mon1 | 2026-08-24 15:40:47.600827 | mon1 | TASK [vexxhost.containers.docker : Force any restarts if necessary] ************ 2026-08-24 15:40:47.600941 | mon1 | Monday 24 August 2026 15:40:47 +0000 (0:00:00.549) 0:01:51.779 ********* 2026-08-24 15:40:47.601047 | mon1 | 2026-08-24 15:40:47.601164 | mon1 | TASK [vexxhost.containers.docker : Enable and start service] ******************* 2026-08-24 15:40:47.601303 | mon1 | Monday 24 August 2026 15:40:47 +0000 (0:00:00.006) 0:01:51.785 ********* 2026-08-24 15:40:48.064004 | mon1 | ok: [mon1] 2026-08-24 15:40:48.064055 | mon1 | 2026-08-24 15:40:48.064066 | mon1 | TASK [vexxhost.ceph.cephadm : Gather variables for each operating system] ****** 2026-08-24 15:40:48.064076 | mon1 | Monday 24 August 2026 15:40:48 +0000 (0:00:00.462) 0:01:52.248 ********* 2026-08-24 15:40:48.131449 | mon1 | ok: [mon1] => (item=/home/zuul/.ansible/collections/ansible_collections/vexxhost/ceph/roles/cephadm/vars/debian.yml) 2026-08-24 15:40:48.131585 | mon1 | 2026-08-24 15:40:48.131597 | mon1 | TASK [vexxhost.ceph.cephadm : Install packages] ******************************** 2026-08-24 15:40:48.131607 | mon1 | Monday 24 August 2026 15:40:48 +0000 (0:00:00.067) 0:01:52.316 ********* 2026-08-24 15:40:49.139332 | mon1 | ok: [mon1] 2026-08-24 15:40:49.140277 | mon1 | 2026-08-24 15:40:49.140334 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure services are started] ********************* 2026-08-24 15:40:49.140346 | mon1 | Monday 24 August 2026 15:40:49 +0000 (0:00:01.007) 0:01:53.324 ********* 2026-08-24 15:40:49.976229 | mon1 | ok: [mon1] => (item=systemd-timesyncd) 2026-08-24 15:40:49.976291 | mon1 | ok: [mon1] => (item=ssh) 2026-08-24 15:40:49.976302 | mon1 | 2026-08-24 15:40:49.976312 | mon1 | TASK [vexxhost.ceph.cephadm : Download "cephadm"] ****************************** 2026-08-24 15:40:49.976322 | mon1 | Monday 24 August 2026 15:40:49 +0000 (0:00:00.835) 0:01:54.159 ********* 2026-08-24 15:40:51.078093 | mon1 | ok: [mon1] 2026-08-24 15:40:51.078178 | mon1 | 2026-08-24 15:40:51.078189 | mon1 | TASK [vexxhost.ceph.cephadm : Remove cephadm from old path] ******************** 2026-08-24 15:40:51.078236 | mon1 | Monday 24 August 2026 15:40:51 +0000 (0:00:01.101) 0:01:55.261 ********* 2026-08-24 15:40:51.357719 | mon1 | ok: [mon1] 2026-08-24 15:40:51.357818 | mon1 | 2026-08-24 15:40:51.357859 | mon1 | TASK [vexxhost.ceph.cephadm : Ensure "cephadm" user is present] **************** 2026-08-24 15:40:51.357989 | mon1 | Monday 24 August 2026 15:40:51 +0000 (0:00:00.280) 0:01:55.542 ********* 2026-08-24 15:40:51.700308 | mon1 | ok: [mon1] 2026-08-24 15:40:51.700360 | mon1 | 2026-08-24 15:40:51.700366 | mon1 | TASK [vexxhost.ceph.cephadm : Allow "cephadm" user to have passwordless sudo] *** 2026-08-24 15:40:51.700371 | mon1 | Monday 24 August 2026 15:40:51 +0000 (0:00:00.339) 0:01:55.881 ********* 2026-08-24 15:40:51.969079 | mon1 | ok: [mon1] 2026-08-24 15:40:51.969165 | mon1 | 2026-08-24 15:40:51.969176 | mon1 | TASK [vexxhost.ceph.ceph_exporter : Configure Ceph exporter service] *********** 2026-08-24 15:40:51.969186 | mon1 | Monday 24 August 2026 15:40:51 +0000 (0:00:00.271) 0:01:56.153 ********* 2026-08-24 15:40:53.800322 | mon1 | ok: [mon1] 2026-08-24 15:40:53.800397 | mon1 | 2026-08-24 15:40:53.800411 | mon1 | PLAY RECAP ********************************************************************* 2026-08-24 15:40:53.800430 | mon1 | mon1 : ok=83 changed=0 unreachable=0 failed=0 skipped=15 rescued=0 ignored=0 2026-08-24 15:40:53.802290 | mon1 | osd1 : ok=48 changed=0 unreachable=0 failed=0 skipped=9 rescued=0 ignored=0 2026-08-24 15:40:53.802346 | mon1 | 2026-08-24 15:40:53.802354 | mon1 | 2026-08-24 15:40:53.802361 | mon1 | TASKS RECAP ******************************************************************** 2026-08-24 15:40:53.802369 | mon1 | Monday 24 August 2026 15:40:53 +0000 (0:00:01.832) 0:01:57.985 ********* 2026-08-24 15:40:53.802375 | mon1 | =============================================================================== 2026-08-24 15:40:53.802382 | mon1 | vexxhost.ceph.mgr : Configure manager modules --------------------------- 8.49s 2026-08-24 15:40:53.802388 | mon1 | vexxhost.ceph.osd : Ensure all OSDs are non-legacy ---------------------- 5.97s 2026-08-24 15:40:53.802394 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.44s 2026-08-24 15:40:53.802425 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.35s 2026-08-24 15:40:53.802432 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.34s 2026-08-24 15:40:53.802439 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 3.31s 2026-08-24 15:40:53.802445 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.60s 2026-08-24 15:40:53.802451 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.57s 2026-08-24 15:40:53.802592 | mon1 | vexxhost.ceph.cephadm_host : Add new host to Ceph ----------------------- 2.52s 2026-08-24 15:40:53.802762 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.52s 2026-08-24 15:40:53.802936 | mon1 | vexxhost.containers.download_artifact : Extract archive ----------------- 2.30s 2026-08-24 15:40:53.803141 | mon1 | Gathering Facts --------------------------------------------------------- 2.23s 2026-08-24 15:40:53.803407 | mon1 | vexxhost.ceph.osd : Mark require osd release ---------------------------- 2.12s 2026-08-24 15:40:53.803666 | mon1 | Gathering Facts --------------------------------------------------------- 2.06s 2026-08-24 15:40:53.803889 | mon1 | vexxhost.ceph.osd : Get mon dump ---------------------------------------- 1.98s 2026-08-24 15:40:53.804086 | mon1 | vexxhost.ceph.osd : Get `ceph orch ps` ---------------------------------- 1.96s 2026-08-24 15:40:53.804341 | mon1 | vexxhost.ceph.mgr : Validate manager exist ------------------------------ 1.84s 2026-08-24 15:40:53.804549 | mon1 | vexxhost.ceph.cephadm_host : Get public SSH key for "cephadm" user ------ 1.84s 2026-08-24 15:40:53.804788 | mon1 | vexxhost.ceph.ceph_exporter : Configure Ceph exporter service ----------- 1.83s 2026-08-24 15:40:53.805019 | mon1 | vexxhost.ceph.mgr : Configure "mgr" label for managers ------------------ 1.82s 2026-08-24 15:40:53.956942 | mon1 | INFO [default > idempotence] Executed: Successful 2026-08-24 15:40:53.967448 | mon1 | INFO [default > side_effect] Executing 2026-08-24 15:40:53.967821 | mon1 | WARNING [default > side_effect] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-24 15:40:53.973542 | mon1 | INFO [default > verify] Executing 2026-08-24 15:40:54.813808 | mon1 | 2026-08-24 15:40:54.814141 | mon1 | PLAY [Verify] ****************************************************************** 2026-08-24 15:40:54.814583 | mon1 | 2026-08-24 15:40:54.814838 | mon1 | TASK [Gathering Facts] ********************************************************* 2026-08-24 15:40:54.815112 | mon1 | Monday 24 August 2026 15:40:54 +0000 (0:00:00.008) 0:00:00.008 ********* 2026-08-24 15:40:57.163230 | mon1 | [WARNING]: Platform linux on host mon1 is using the discovered Python 2026-08-24 15:40:57.163651 | mon1 | interpreter at /usr/bin/python3.12, but future installation of another Python 2026-08-24 15:40:57.164026 | mon1 | interpreter could change the meaning of that path. See 2026-08-24 15:40:57.164443 | mon1 | https://docs.ansible.com/ansible- 2026-08-24 15:40:57.164769 | mon1 | core/2.18/reference_appendices/interpreter_discovery.html for more information. 2026-08-24 15:40:57.174840 | mon1 | ok: [mon1] 2026-08-24 15:40:57.175039 | mon1 | 2026-08-24 15:40:57.175263 | mon1 | TASK [List locally deployed Ceph daemons] ************************************** 2026-08-24 15:40:57.175477 | mon1 | Monday 24 August 2026 15:40:57 +0000 (0:00:02.361) 0:00:02.369 ********* 2026-08-24 15:41:03.208008 | mon1 | ok: [mon1] 2026-08-24 15:41:03.209041 | mon1 | 2026-08-24 15:41:03.209071 | mon1 | TASK [Collect deployed Ceph container images] ********************************** 2026-08-24 15:41:03.209082 | mon1 | Monday 24 August 2026 15:41:03 +0000 (0:00:06.032) 0:00:08.402 ********* 2026-08-24 15:41:03.261835 | mon1 | ok: [mon1] 2026-08-24 15:41:03.261908 | mon1 | 2026-08-24 15:41:03.262097 | mon1 | TASK [Assert that a deployed Ceph container image was found] ******************* 2026-08-24 15:41:03.262295 | mon1 | Monday 24 August 2026 15:41:03 +0000 (0:00:00.053) 0:00:08.455 ********* 2026-08-24 15:41:03.304299 | mon1 | ok: [mon1] => { 2026-08-24 15:41:03.304608 | mon1 | "changed": false, 2026-08-24 15:41:03.304870 | mon1 | "msg": "All assertions passed" 2026-08-24 15:41:03.305113 | mon1 | } 2026-08-24 15:41:03.305419 | mon1 | 2026-08-24 15:41:03.305688 | mon1 | TASK [Get cluster health status] *********************************************** 2026-08-24 15:41:03.305936 | mon1 | Monday 24 August 2026 15:41:03 +0000 (0:00:00.043) 0:00:08.498 ********* 2026-08-24 15:41:05.313337 | mon1 | ok: [mon1] 2026-08-24 15:41:05.313424 | mon1 | 2026-08-24 15:41:05.313439 | mon1 | TASK [Print cluster health status] ********************************************* 2026-08-24 15:41:05.313486 | mon1 | Monday 24 August 2026 15:41:05 +0000 (0:00:02.008) 0:00:10.506 ********* 2026-08-24 15:41:05.359250 | mon1 | ok: [mon1] => { 2026-08-24 15:41:05.359283 | mon1 | "_ceph_health": { 2026-08-24 15:41:05.359296 | mon1 | "changed": false, 2026-08-24 15:41:05.359307 | mon1 | "cmd": [ 2026-08-24 15:41:05.359318 | mon1 | "cephadm", 2026-08-24 15:41:05.359329 | mon1 | "shell", 2026-08-24 15:41:05.359340 | mon1 | "--", 2026-08-24 15:41:05.359351 | mon1 | "ceph", 2026-08-24 15:41:05.359362 | mon1 | "health" 2026-08-24 15:41:05.359374 | mon1 | ], 2026-08-24 15:41:05.359413 | mon1 | "delta": "0:00:01.738169", 2026-08-24 15:41:05.359422 | mon1 | "end": "2026-08-24 15:41:05.263855", 2026-08-24 15:41:05.359431 | mon1 | "failed": false, 2026-08-24 15:41:05.359547 | mon1 | "msg": "", 2026-08-24 15:41:05.359850 | mon1 | "rc": 0, 2026-08-24 15:41:05.360152 | mon1 | "start": "2026-08-24 15:41:03.525686", 2026-08-24 15:41:05.360520 | mon1 | "stderr": "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2\nInferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config", 2026-08-24 15:41:05.360836 | mon1 | "stderr_lines": [ 2026-08-24 15:41:05.361144 | mon1 | "Inferring fsid 1dff0e0f-3c44-48da-81cd-4f3c6e8722b2", 2026-08-24 15:41:05.361543 | mon1 | "Inferring config /var/lib/ceph/1dff0e0f-3c44-48da-81cd-4f3c6e8722b2/mon.mon1/config" 2026-08-24 15:41:05.361826 | mon1 | ], 2026-08-24 15:41:05.362014 | mon1 | "stdout": "HEALTH_OK", 2026-08-24 15:41:05.362233 | mon1 | "stdout_lines": [ 2026-08-24 15:41:05.362445 | mon1 | "HEALTH_OK" 2026-08-24 15:41:05.362629 | mon1 | ] 2026-08-24 15:41:05.362813 | mon1 | } 2026-08-24 15:41:05.362997 | mon1 | } 2026-08-24 15:41:05.363172 | mon1 | 2026-08-24 15:41:05.363387 | mon1 | TASK [Assert that the cluster status is healthy] ******************************* 2026-08-24 15:41:05.363586 | mon1 | Monday 24 August 2026 15:41:05 +0000 (0:00:00.044) 0:00:10.551 ********* 2026-08-24 15:41:05.410452 | mon1 | ok: [mon1] => { 2026-08-24 15:41:05.410777 | mon1 | "changed": false, 2026-08-24 15:41:05.411082 | mon1 | "msg": "All assertions passed" 2026-08-24 15:41:05.411416 | mon1 | } 2026-08-24 15:41:05.411735 | mon1 | 2026-08-24 15:41:05.412054 | mon1 | TASK [Create a test Ceph pool] ************************************************* 2026-08-24 15:41:05.412518 | mon1 | Monday 24 August 2026 15:41:05 +0000 (0:00:00.054) 0:00:10.605 ********* 2026-08-24 15:41:12.274265 | mon1 | changed: [mon1] 2026-08-24 15:41:12.274704 | mon1 | 2026-08-24 15:41:12.275107 | mon1 | TASK [Create a test Ceph key] ************************************************** 2026-08-24 15:41:12.275512 | mon1 | Monday 24 August 2026 15:41:12 +0000 (0:00:06.863) 0:00:17.468 ********* 2026-08-24 15:41:14.973721 | mon1 | changed: [mon1] 2026-08-24 15:41:14.973803 | mon1 | 2026-08-24 15:41:14.974182 | mon1 | TASK [Retrieve info for the test Ceph key] ************************************* 2026-08-24 15:41:14.974244 | mon1 | Monday 24 August 2026 15:41:14 +0000 (0:00:02.699) 0:00:20.168 ********* 2026-08-24 15:41:16.316734 | mon1 | ok: [mon1] 2026-08-24 15:41:16.316855 | mon1 | 2026-08-24 15:41:16.317023 | mon1 | TASK [Assert that key_info returns the correct key] **************************** 2026-08-24 15:41:16.317224 | mon1 | Monday 24 August 2026 15:41:16 +0000 (0:00:01.342) 0:00:21.510 ********* 2026-08-24 15:41:16.369821 | mon1 | ok: [mon1] => { 2026-08-24 15:41:16.369893 | mon1 | "changed": false, 2026-08-24 15:41:16.369907 | mon1 | "msg": "All assertions passed" 2026-08-24 15:41:16.369920 | mon1 | } 2026-08-24 15:41:16.369932 | mon1 | 2026-08-24 15:41:16.369944 | mon1 | TASK [Retrieve info for the test Ceph key using the legacy key module] ********* 2026-08-24 15:41:16.369956 | mon1 | Monday 24 August 2026 15:41:16 +0000 (0:00:00.051) 0:00:21.562 ********* 2026-08-24 15:41:17.646933 | mon1 | ok: [mon1] 2026-08-24 15:41:17.646998 | mon1 | 2026-08-24 15:41:17.647013 | mon1 | TASK [Assert that the legacy key module info state returns the correct key] **** 2026-08-24 15:41:17.647026 | mon1 | Monday 24 August 2026 15:41:17 +0000 (0:00:01.278) 0:00:22.840 ********* 2026-08-24 15:41:17.694266 | mon1 | ok: [mon1] => { 2026-08-24 15:41:17.694315 | mon1 | "changed": false, 2026-08-24 15:41:17.694332 | mon1 | "msg": "All assertions passed" 2026-08-24 15:41:17.694347 | mon1 | } 2026-08-24 15:41:17.694363 | mon1 | 2026-08-24 15:41:17.694379 | mon1 | PLAY RECAP ********************************************************************* 2026-08-24 15:41:17.694395 | mon1 | mon1 : ok=13 changed=2 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0 2026-08-24 15:41:17.694411 | mon1 | 2026-08-24 15:41:17.694424 | mon1 | 2026-08-24 15:41:17.694438 | mon1 | TASKS RECAP ******************************************************************** 2026-08-24 15:41:17.694551 | mon1 | Monday 24 August 2026 15:41:17 +0000 (0:00:00.046) 0:00:22.887 ********* 2026-08-24 15:41:17.694953 | mon1 | =============================================================================== 2026-08-24 15:41:17.695324 | mon1 | Create a test Ceph pool ------------------------------------------------- 6.86s 2026-08-24 15:41:17.695643 | mon1 | List locally deployed Ceph daemons -------------------------------------- 6.03s 2026-08-24 15:41:17.695960 | mon1 | Create a test Ceph key -------------------------------------------------- 2.70s 2026-08-24 15:41:17.696296 | mon1 | Gathering Facts --------------------------------------------------------- 2.36s 2026-08-24 15:41:17.696610 | mon1 | Get cluster health status ----------------------------------------------- 2.01s 2026-08-24 15:41:17.696912 | mon1 | Retrieve info for the test Ceph key ------------------------------------- 1.34s 2026-08-24 15:41:17.697246 | mon1 | Retrieve info for the test Ceph key using the legacy key module --------- 1.28s 2026-08-24 15:41:17.697559 | mon1 | Assert that the cluster status is healthy ------------------------------- 0.05s 2026-08-24 15:41:17.697865 | mon1 | Collect deployed Ceph container images ---------------------------------- 0.05s 2026-08-24 15:41:17.698165 | mon1 | Assert that key_info returns the correct key ---------------------------- 0.05s 2026-08-24 15:41:17.698501 | mon1 | Assert that the legacy key module info state returns the correct key ---- 0.05s 2026-08-24 15:41:17.698862 | mon1 | Print cluster health status --------------------------------------------- 0.04s 2026-08-24 15:41:17.699170 | mon1 | Assert that a deployed Ceph container image was found ------------------- 0.04s 2026-08-24 15:41:17.809092 | mon1 | INFO [default > verify] Executed: Successful 2026-08-24 15:41:17.832296 | mon1 | INFO [default > cleanup] Executing 2026-08-24 15:41:17.832684 | mon1 | WARNING [default > cleanup] Executed: Missing playbook (Remove from test_sequence to suppress) 2026-08-24 15:41:17.838414 | mon1 | INFO [default > destroy] Executing 2026-08-24 15:41:17.838534 | mon1 | WARNING [default > destroy] Skipping, '--destroy=never' requested. 2026-08-24 15:41:17.838667 | mon1 | INFO [default > destroy] Executed: Successful 2026-08-24 15:41:17.838939 | mon1 | WARNING Molecule executed 1 scenario (1 missing files) 2026-08-24 15:41:28.122392 | mon1 | ok: Runtime: 0:11:01.984933 2026-08-24 15:41:28.138955 | 2026-08-24 15:41:28.139329 | PLAY RECAP 2026-08-24 15:41:28.139485 | mon1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0 2026-08-24 15:41:28.139512 | 2026-08-24 15:41:28.346597 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/run.yaml@main] 2026-08-24 15:41:28.354647 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-24 15:41:29.893037 | 2026-08-24 15:41:29.893302 | PLAY [all] 2026-08-24 15:41:30.278871 | 2026-08-24 15:41:30.279026 | TASK [fetch-output : Set log path for multiple nodes] 2026-08-24 15:41:30.335193 | mon1 | ok 2026-08-24 15:41:30.341441 | osd1 | ok 2026-08-24 15:41:30.347096 | 2026-08-24 15:41:30.347178 | TASK [fetch-output : Set log path for single node] 2026-08-24 15:41:30.374512 | mon1 | skipping: Conditional result was False 2026-08-24 15:41:30.396138 | osd1 | skipping: Conditional result was False 2026-08-24 15:41:30.411826 | 2026-08-24 15:41:30.412088 | LOOP [fetch-output : Ensure local output dirs] 2026-08-24 15:41:30.837225 | osd1 -> localhost | changed: "/var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/logs/osd1" 2026-08-24 15:41:30.861704 | mon1 -> localhost | changed: "/var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/logs/mon1" 2026-08-24 15:41:31.062456 | osd1 -> localhost | changed: "/var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/artifacts" 2026-08-24 15:41:31.118072 | mon1 -> localhost | ok: "/var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/artifacts" 2026-08-24 15:41:31.448025 | osd1 -> localhost | changed: "/var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/docs" 2026-08-24 15:41:31.487143 | mon1 -> localhost | ok: "/var/lib/zuul/builds/7482d67de3244ef38cbfa266d1cc8906/work/docs" 2026-08-24 15:41:31.487283 | mon1 -> localhost | changed: All items complete 2026-08-24 15:41:31.487358 | 2026-08-24 15:41:31.504368 | 2026-08-24 15:41:31.504498 | LOOP [fetch-output : Collect logs, artifacts and docs] 2026-08-24 15:41:32.143609 | mon1 | changed: .d..t...... ./ 2026-08-24 15:41:32.179078 | osd1 | changed: .d..t...... ./ 2026-08-24 15:41:32.648443 | mon1 | changed: .d..t...... ./ 2026-08-24 15:41:32.668447 | osd1 | ok 2026-08-24 15:41:33.172477 | mon1 | changed: .d..t...... ./ 2026-08-24 15:41:33.192080 | osd1 | ok 2026-08-24 15:41:33.192162 | osd1 | changed: All items complete 2026-08-24 15:41:33.192275 | 2026-08-24 15:41:33.216620 | 2026-08-24 15:41:33.216733 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir] 2026-08-24 15:41:33.634609 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.007952 2026-08-24 15:41:33.995624 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.006525 2026-08-24 15:41:34.019854 | 2026-08-24 15:41:34.020034 | PLAY [all] 2026-08-24 15:41:34.029373 | 2026-08-24 15:41:34.029483 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes] 2026-08-24 15:41:34.628028 | mon1 | changed 2026-08-24 15:41:34.852582 | osd1 | changed 2026-08-24 15:41:34.868100 | 2026-08-24 15:41:34.868167 | PLAY RECAP 2026-08-24 15:41:34.868214 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-24 15:41:34.868244 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0 2026-08-24 15:41:34.868263 | 2026-08-24 15:41:35.030213 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main] 2026-08-24 15:41:35.041592 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main] 2026-08-24 15:41:35.821133 | 2026-08-24 15:41:35.821261 | PLAY [localhost] 2026-08-24 15:41:36.114455 | 2026-08-24 15:41:36.114607 | TASK [Generate Zuul manifest] 2026-08-24 15:41:36.135444 | localhost | ok 2026-08-24 15:41:36.267074 | 2026-08-24 15:41:36.267273 | TASK [generate-zuul-manifest : Generate Zuul manifest] 2026-08-24 15:41:36.981318 | localhost | changed 2026-08-24 15:41:37.004203 | 2026-08-24 15:41:37.004458 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul] 2026-08-24 15:41:37.406855 | localhost | ok 2026-08-24 15:41:37.416703 | 2026-08-24 15:41:37.416824 | TASK [Upload logs] 2026-08-24 15:41:37.435778 | localhost | ok 2026-08-24 15:41:37.795292 | 2026-08-24 15:41:37.795398 | TASK [Set zuul-log-path fact] 2026-08-24 15:41:37.820541 | localhost | ok 2026-08-24 15:41:37.927384 | 2026-08-24 15:41:37.927494 | TASK [set-zuul-log-path-fact : Set log path for a build] 2026-08-24 15:41:37.960082 | localhost | ok 2026-08-24 15:41:37.977096 | 2026-08-24 15:41:37.977294 | TASK [upload-logs : Create log directories] 2026-08-24 15:41:38.424461 | localhost | changed 2026-08-24 15:41:38.429836 | 2026-08-24 15:41:38.429979 | TASK [upload-logs : Ensure logs are readable before uploading] 2026-08-24 15:41:38.870501 | localhost -> localhost | ok: Runtime: 0:00:00.007075 2026-08-24 15:41:38.879231 | 2026-08-24 15:41:38.879327 | TASK [upload-logs : Upload logs to log server] 2026-08-24 15:41:39.471687 | localhost | Output suppressed because no_log was given 2026-08-24 15:41:39.475940 | 2026-08-24 15:41:39.476007 | LOOP [upload-logs : Compress console log and json output] 2026-08-24 15:41:39.554672 | localhost | skipping: Conditional result was False 2026-08-24 15:41:39.562161 | localhost | skipping: Conditional result was False 2026-08-24 15:41:39.580441 | 2026-08-24 15:41:39.580600 | LOOP [upload-logs : Upload compressed console log and json output] 2026-08-24 15:41:39.658560 | localhost | skipping: Conditional result was False 2026-08-24 15:41:39.658892 | 2026-08-24 15:41:39.663234 | localhost | skipping: Conditional result was False 2026-08-24 15:41:39.710365 | 2026-08-24 15:41:39.710519 | LOOP [upload-logs : Upload console log and json output]