2026-08-26 20:54:06.091881 | Job console starting
2026-08-26 20:54:06.112086 | Updating git repos
2026-08-26 20:54:06.139301 | Cloning repos into workspace
2026-08-26 20:54:08.321575 | Restoring repo states
2026-08-26 20:54:08.331144 | Merging changes
2026-08-26 20:54:09.131268 | Checking out repos
2026-08-26 20:54:09.707155 | Preparing playbooks
2026-08-26 20:54:15.007841 | Running Ansible setup
2026-08-26 20:54:20.820113 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 20:54:21.419942 | 
2026-08-26 20:54:21.420134 | PLAY [localhost]
2026-08-26 20:54:21.428352 | 
2026-08-26 20:54:21.428437 | TASK [Gathering Facts]
2026-08-26 20:54:22.341842 | localhost | ok
2026-08-26 20:54:22.362566 | 
2026-08-26 20:54:22.362880 | TASK [Setup log path fact]
2026-08-26 20:54:22.391150 | localhost | ok
2026-08-26 20:54:22.409020 | 
2026-08-26 20:54:22.409238 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 20:54:22.439478 | localhost | ok
2026-08-26 20:54:22.449648 | 
2026-08-26 20:54:22.449725 | TASK [emit-job-header : Print job information]
2026-08-26 20:54:22.489121 | # Job Information
2026-08-26 20:54:22.660857 | Ansible Version: 2.16.18
2026-08-26 20:54:22.661538 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-08-26 20:54:22.661625 | Pipeline: check
2026-08-26 20:54:22.661677 | Executor: 2d72f0692154
2026-08-26 20:54:22.661723 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/116
2026-08-26 20:54:22.661775 | Event ID: 6fcc1630-a18e-11f1-934f-9f0631f6bf76
2026-08-26 20:54:22.674154 | 
2026-08-26 20:54:22.674258 | LOOP [emit-job-header : Print node information]
2026-08-26 20:54:22.787143 | localhost | ok:
2026-08-26 20:54:22.787746 | localhost | # Node Information
2026-08-26 20:54:22.787796 | localhost | Inventory Hostname: mon1
2026-08-26 20:54:22.787881 | localhost | Hostname: np0000191311
2026-08-26 20:54:22.787998 | localhost | Username: zuul
2026-08-26 20:54:22.788091 | localhost | Distro: Ubuntu 24.04
2026-08-26 20:54:22.788148 | localhost | Provider: yul1
2026-08-26 20:54:22.788216 | localhost | Region: ca-ymq-1
2026-08-26 20:54:22.788328 | localhost | Label: ubuntu-noble
2026-08-26 20:54:22.788401 | localhost | Product Name: OpenStack Nova
2026-08-26 20:54:22.788523 | localhost | Interface IP: 162.253.55.226
2026-08-26 20:54:22.834779 | localhost | ok:
2026-08-26 20:54:22.834874 | localhost | # Node Information
2026-08-26 20:54:22.834908 | localhost | Inventory Hostname: osd1
2026-08-26 20:54:22.834938 | localhost | Hostname: np0000191312
2026-08-26 20:54:22.834964 | localhost | Username: zuul
2026-08-26 20:54:22.834990 | localhost | Distro: Ubuntu 24.04
2026-08-26 20:54:22.835099 | localhost | Provider: yul1
2026-08-26 20:54:22.835152 | localhost | Region: ca-ymq-1
2026-08-26 20:54:22.835234 | localhost | Label: ubuntu-noble
2026-08-26 20:54:22.835301 | localhost | Product Name: OpenStack Nova
2026-08-26 20:54:22.835432 | localhost | Interface IP: 162.253.55.173
2026-08-26 20:54:22.855591 | 
2026-08-26 20:54:22.855838 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-26 20:54:23.235494 | localhost -> localhost | changed
2026-08-26 20:54:23.243120 | 
2026-08-26 20:54:23.244068 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-26 20:54:24.771559 | localhost -> localhost | changed
2026-08-26 20:54:24.784602 | 
2026-08-26 20:54:24.784662 | PLAY [all]
2026-08-26 20:54:24.800838 | 
2026-08-26 20:54:24.801311 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-26 20:54:25.030220 | mon1 -> localhost | ok
2026-08-26 20:54:25.043136 | 
2026-08-26 20:54:25.043233 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-26 20:54:25.076984 | mon1 | ok
2026-08-26 20:54:25.083427 | osd1 | ok
2026-08-26 20:54:25.104589 | mon1 | included: /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 20:54:25.104645 | osd1 | included: /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 20:54:25.111245 | 
2026-08-26 20:54:25.111307 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-26 20:54:25.880026 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-26 20:54:25.880256 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/fc798f83a6ef40cc8aa95faeacea6fae_id_rsa
2026-08-26 20:54:25.880301 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/fc798f83a6ef40cc8aa95faeacea6fae_id_rsa.pub
2026-08-26 20:54:25.880338 | mon1 -> localhost | The key fingerprint is:
2026-08-26 20:54:25.880451 | mon1 -> localhost | SHA256:BJS/jZBEudrqZt3QGacX5hoCuC/zHNPfaIe4Frrhqn4 zuul-build-sshkey
2026-08-26 20:54:25.880596 | mon1 -> localhost | The key's randomart image is:
2026-08-26 20:54:25.880650 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-26 20:54:25.880683 | mon1 -> localhost | |     o+o         |
2026-08-26 20:54:25.880713 | mon1 -> localhost | |      +.         |
2026-08-26 20:54:25.880742 | mon1 -> localhost | |   . . +.        |
2026-08-26 20:54:25.880771 | mon1 -> localhost | |  . . +.o +      |
2026-08-26 20:54:25.880800 | mon1 -> localhost | |   . + oS@ .     |
2026-08-26 20:54:25.880828 | mon1 -> localhost | |  . ..= B +      |
2026-08-26 20:54:25.880856 | mon1 -> localhost | |   .++.* =       |
2026-08-26 20:54:25.880883 | mon1 -> localhost | |  oE*++.=o.      |
2026-08-26 20:54:25.880910 | mon1 -> localhost | |oooO*o.oo..      |
2026-08-26 20:54:25.880938 | mon1 -> localhost | +----[SHA256]-----+
2026-08-26 20:54:25.881029 | mon1 -> localhost | ok: Runtime: 0:00:00.334436
2026-08-26 20:54:25.888736 | 
2026-08-26 20:54:25.888803 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-26 20:54:25.926740 | mon1 | ok
2026-08-26 20:54:25.933724 | osd1 | ok
2026-08-26 20:54:25.947034 | mon1 | included: /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 20:54:25.947083 | osd1 | included: /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 20:54:25.959043 | 
2026-08-26 20:54:25.959107 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-26 20:54:25.985135 | mon1 | skipping: Conditional result was False
2026-08-26 20:54:25.996304 | osd1 | skipping: Conditional result was False
2026-08-26 20:54:26.007918 | 
2026-08-26 20:54:26.007987 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-26 20:54:26.558280 | mon1 | changed
2026-08-26 20:54:26.599719 | osd1 | changed
2026-08-26 20:54:26.608665 | 
2026-08-26 20:54:26.608731 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-26 20:54:26.848989 | mon1 | ok
2026-08-26 20:54:26.870511 | osd1 | ok
2026-08-26 20:54:26.877107 | 
2026-08-26 20:54:26.877172 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-26 20:54:27.514558 | mon1 | changed
2026-08-26 20:54:27.577990 | osd1 | changed
2026-08-26 20:54:27.587605 | 
2026-08-26 20:54:27.587676 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-26 20:54:28.204158 | osd1 | changed
2026-08-26 20:54:28.211041 | mon1 | changed
2026-08-26 20:54:28.216487 | 
2026-08-26 20:54:28.216551 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-26 20:54:28.244000 | mon1 | skipping: Conditional result was False
2026-08-26 20:54:28.255766 | osd1 | skipping: Conditional result was False
2026-08-26 20:54:28.264731 | 
2026-08-26 20:54:28.264824 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-26 20:54:28.582277 | mon1 -> localhost | changed
2026-08-26 20:54:28.606422 | 
2026-08-26 20:54:28.606525 | TASK [add-build-sshkey : Add back temp key]
2026-08-26 20:54:28.916486 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/fc798f83a6ef40cc8aa95faeacea6fae_id_rsa (zuul-build-sshkey)
2026-08-26 20:54:28.916688 | mon1 -> localhost | ok: Runtime: 0:00:00.015767
2026-08-26 20:54:28.922326 | 
2026-08-26 20:54:28.922392 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-26 20:54:29.259991 | osd1 | ok
2026-08-26 20:54:29.461794 | mon1 | ok
2026-08-26 20:54:29.468074 | 
2026-08-26 20:54:29.468139 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-26 20:54:29.495435 | mon1 | skipping: Conditional result was False
2026-08-26 20:54:29.506574 | osd1 | skipping: Conditional result was False
2026-08-26 20:54:29.527873 | 
2026-08-26 20:54:29.527940 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-26 20:54:29.889341 | osd1 | ok
2026-08-26 20:54:29.894115 | mon1 | ok
2026-08-26 20:54:29.900365 | 
2026-08-26 20:54:29.900430 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-26 20:54:30.769592 | mon1 | Output suppressed because no_log was given
2026-08-26 20:54:30.800380 | osd1 | Output suppressed because no_log was given
2026-08-26 20:54:30.818373 | 
2026-08-26 20:54:30.818482 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-26 20:54:31.059344 | mon1 | ok: "logs"
2026-08-26 20:54:31.059599 | mon1 | ok: All items complete
2026-08-26 20:54:31.059628 | 
2026-08-26 20:54:31.080891 | osd1 | ok: "logs"
2026-08-26 20:54:31.285415 | mon1 | ok: "artifacts"
2026-08-26 20:54:31.290645 | osd1 | ok: "artifacts"
2026-08-26 20:54:31.501509 | mon1 | ok: "docs"
2026-08-26 20:54:31.510533 | osd1 | ok: "docs"
2026-08-26 20:54:31.525641 | 
2026-08-26 20:54:31.525877 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-26 20:54:31.798239 | mon1 | changed: "logs"
2026-08-26 20:54:31.798551 | mon1 | ok: All items complete
2026-08-26 20:54:31.798591 | 
2026-08-26 20:54:31.820037 | osd1 | changed: "logs"
2026-08-26 20:54:32.000822 | mon1 | changed: "artifacts"
2026-08-26 20:54:32.006838 | osd1 | changed: "artifacts"
2026-08-26 20:54:32.195936 | osd1 | changed: "docs"
2026-08-26 20:54:32.205003 | mon1 | changed: "docs"
2026-08-26 20:54:32.227084 | 
2026-08-26 20:54:32.227235 | PLAY RECAP
2026-08-26 20:54:32.227289 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:54:32.227320 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 20:54:32.227345 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 20:54:32.227363 | 
2026-08-26 20:54:32.392311 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 20:54:32.397549 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 20:54:33.036396 | 
2026-08-26 20:54:33.036561 | PLAY [all]
2026-08-26 20:54:33.048517 | 
2026-08-26 20:54:33.048596 | TASK [setup-uv : Extract archive]
2026-08-26 20:54:41.630799 | osd1 | changed
2026-08-26 20:54:49.641184 | mon1 | ERROR
2026-08-26 20:54:49.641475 | mon1 | {
2026-08-26 20:54:49.641529 | mon1 |   "msg": "Failure downloading https://github.com/astral-sh/uv/releases/download/0.8.13/uv-x86_64-unknown-linux-gnu.tar.gz, Request failed: <urlopen error [Errno -3] Temporary failure in name resolution>"
2026-08-26 20:54:49.641600 | mon1 | }
failure
2026-08-26 20:54:49.649875 | 
2026-08-26 20:54:49.649970 | TASK [setup-uv : Print version]
2026-08-26 20:54:50.091287 | osd1 | uv 0.8.13
2026-08-26 20:54:50.212863 | osd1 | ok: Runtime: 0:00:00.011589
2026-08-26 20:54:50.225321 | 
2026-08-26 20:54:50.225390 | TASK [Install Ansible collection siblings]
2026-08-26 20:54:50.663899 | osd1 | ok:
2026-08-26 20:54:50.664092 | osd1 | Skipping community.general: no checked-out sibling
2026-08-26 20:54:50.664124 | osd1 | Skipping ansible.utils: no checked-out sibling
2026-08-26 20:54:50.664148 | osd1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-26 20:54:50.665899 | 
2026-08-26 20:54:50.665947 | PLAY RECAP
2026-08-26 20:54:50.665989 | mon1 | ok: 0 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:54:50.666017 | osd1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:54:50.666036 | 
2026-08-26 20:54:50.824129 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 20:54:50.827015 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 20:54:51.468622 | 
2026-08-26 20:54:51.468766 | PLAY [all]
2026-08-26 20:54:51.483051 | 
2026-08-26 20:54:51.483167 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-26 20:54:51.544938 | mon1 | ok
2026-08-26 20:54:51.549611 | osd1 | ok
2026-08-26 20:54:51.554603 | 
2026-08-26 20:54:51.554683 | TASK [fetch-output : Set log path for single node]
2026-08-26 20:54:51.579014 | mon1 | skipping: Conditional result was False
2026-08-26 20:54:51.636227 | osd1 | skipping: Conditional result was False
2026-08-26 20:54:51.643163 | 
2026-08-26 20:54:51.643241 | LOOP [fetch-output : Ensure local output dirs]
2026-08-26 20:54:52.051736 | mon1 -> localhost | changed: "/var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/logs/mon1"
2026-08-26 20:54:52.071372 | osd1 -> localhost | changed: "/var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/logs/osd1"
2026-08-26 20:54:52.604103 | osd1 -> localhost | changed: "/var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/artifacts"
2026-08-26 20:54:52.626285 | mon1 -> localhost | ok: "/var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/artifacts"
2026-08-26 20:54:52.846366 | mon1 -> localhost | changed: "/var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/docs"
2026-08-26 20:54:52.848246 | osd1 -> localhost | ok: "/var/lib/zuul/builds/fc798f83a6ef40cc8aa95faeacea6fae/work/docs"
2026-08-26 20:54:52.869075 | 
2026-08-26 20:54:52.869449 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-26 20:54:53.562778 | mon1 | changed: .d..t...... ./
2026-08-26 20:54:53.563057 | mon1 | changed: All items complete
2026-08-26 20:54:53.563090 | 
2026-08-26 20:54:53.570814 | osd1 | changed: .d..t...... ./
2026-08-26 20:54:54.084777 | mon1 | ok
2026-08-26 20:54:54.110604 | osd1 | changed: .d..t...... ./
2026-08-26 20:54:54.597903 | mon1 | changed: .d..t...... ./
2026-08-26 20:54:54.792344 | osd1 | ok
2026-08-26 20:54:54.818543 | 
2026-08-26 20:54:54.828999 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-26 20:54:55.320507 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008241
2026-08-26 20:54:55.320854 | mon1 -> localhost | changed: All items complete
2026-08-26 20:54:55.320902 | 
2026-08-26 20:54:55.543729 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.007516
2026-08-26 20:54:55.566436 | 
2026-08-26 20:54:55.566620 | PLAY [all]
2026-08-26 20:54:55.574399 | 
2026-08-26 20:54:55.574540 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-26 20:54:56.078598 | osd1 | changed
2026-08-26 20:54:56.097631 | mon1 | changed
2026-08-26 20:54:56.112381 | 
2026-08-26 20:54:56.112502 | PLAY RECAP
2026-08-26 20:54:56.112557 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 20:54:56.112588 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 20:54:56.112608 | 
2026-08-26 20:54:56.274121 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 20:54:56.279873 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-26 20:54:56.858210 | 
2026-08-26 20:54:56.876183 | PLAY [localhost]
2026-08-26 20:54:56.894350 | 
2026-08-26 20:54:56.894436 | TASK [Generate Zuul manifest]
2026-08-26 20:54:56.914801 | localhost | ok
2026-08-26 20:54:56.937692 | 
2026-08-26 20:54:56.959884 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-26 20:54:57.369543 | localhost | changed
2026-08-26 20:54:57.380936 | 
2026-08-26 20:54:57.381043 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-26 20:54:57.412707 | localhost | ok
2026-08-26 20:54:57.421949 | 
2026-08-26 20:54:57.422040 | TASK [Upload logs]
2026-08-26 20:54:57.441886 | localhost | ok
2026-08-26 20:54:57.503005 | 
2026-08-26 20:54:57.511994 | TASK [Set zuul-log-path fact]
2026-08-26 20:54:57.535904 | localhost | ok
2026-08-26 20:54:57.550619 | 
2026-08-26 20:54:57.550691 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 20:54:57.582940 | localhost | ok
2026-08-26 20:54:57.592111 | 
2026-08-26 20:54:57.592205 | TASK [upload-logs : Create log directories]
2026-08-26 20:54:58.035300 | localhost | changed
2026-08-26 20:54:58.040425 | 
2026-08-26 20:54:58.040510 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-26 20:54:58.488462 | localhost -> localhost | ok: Runtime: 0:00:00.006368
2026-08-26 20:54:58.495213 | 
2026-08-26 20:54:58.495304 | TASK [upload-logs : Upload logs to log server]
2026-08-26 20:54:58.992706 | localhost | Output suppressed because no_log was given
2026-08-26 20:54:58.998158 | 
2026-08-26 20:54:58.998250 | LOOP [upload-logs : Compress console log and json output]
2026-08-26 20:54:59.090431 | localhost | skipping: Conditional result was False
2026-08-26 20:54:59.097459 | localhost | skipping: Conditional result was False
2026-08-26 20:54:59.129150 | 
2026-08-26 20:54:59.129272 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-26 20:54:59.248065 | localhost | skipping: Conditional result was False
2026-08-26 20:54:59.248528 | 
2026-08-26 20:54:59.252332 | localhost | skipping: Conditional result was False
2026-08-26 20:54:59.306883 | 
2026-08-26 20:54:59.307058 | LOOP [upload-logs : Upload console log and json output]