2026-08-26 20:46:10.642749 | Job console starting
2026-08-26 20:46:10.664376 | Updating git repos
2026-08-26 20:46:10.690235 | Cloning repos into workspace
2026-08-26 20:46:10.854775 | Restoring repo states
2026-08-26 20:46:10.863358 | Merging changes
2026-08-26 20:46:11.233078 | Checking out repos
2026-08-26 20:46:11.282606 | Preparing playbooks
2026-08-26 20:46:12.766531 | Running Ansible setup
2026-08-26 20:46:18.738774 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 20:46:19.335118 | 
2026-08-26 20:46:19.335240 | PLAY [localhost]
2026-08-26 20:46:19.342364 | 
2026-08-26 20:46:19.342431 | TASK [Gathering Facts]
2026-08-26 20:46:20.237117 | localhost | ok
2026-08-26 20:46:20.252309 | 
2026-08-26 20:46:20.252453 | TASK [Setup log path fact]
2026-08-26 20:46:20.271057 | localhost | ok
2026-08-26 20:46:20.281530 | 
2026-08-26 20:46:20.281615 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 20:46:20.312482 | localhost | ok
2026-08-26 20:46:20.320085 | 
2026-08-26 20:46:20.320150 | TASK [emit-job-header : Print job information]
2026-08-26 20:46:20.360089 | # Job Information
2026-08-26 20:46:20.360233 | Ansible Version: 2.16.18
2026-08-26 20:46:20.360278 | Job: ansible-collection-ceph-molecule-ha-ubuntu-noble
2026-08-26 20:46:20.360309 | Pipeline: check
2026-08-26 20:46:20.360338 | Executor: 2d72f0692154
2026-08-26 20:46:20.360365 | Triggered by: https://github.com/vexxhost/ansible-collection-ceph/pull/116
2026-08-26 20:46:20.360396 | Event ID: 6fcc1630-a18e-11f1-934f-9f0631f6bf76
2026-08-26 20:46:20.364594 | 
2026-08-26 20:46:20.364683 | LOOP [emit-job-header : Print node information]
2026-08-26 20:46:20.465725 | localhost | ok:
2026-08-26 20:46:20.466048 | localhost | # Node Information
2026-08-26 20:46:20.466111 | localhost | Inventory Hostname: mon1
2026-08-26 20:46:20.466158 | localhost | Hostname: np0000191288
2026-08-26 20:46:20.466201 | localhost | Username: zuul
2026-08-26 20:46:20.466248 | localhost | Distro: Ubuntu 24.04
2026-08-26 20:46:20.466291 | localhost | Provider: yul1
2026-08-26 20:46:20.466419 | localhost | Region: ca-ymq-1
2026-08-26 20:46:20.466451 | localhost | Label: ubuntu-noble
2026-08-26 20:46:20.466470 | localhost | Product Name: OpenStack Nova
2026-08-26 20:46:20.466489 | localhost | Interface IP: 162.253.55.123
2026-08-26 20:46:20.519283 | localhost | ok:
2026-08-26 20:46:20.519348 | localhost | # Node Information
2026-08-26 20:46:20.519384 | localhost | Inventory Hostname: osd1
2026-08-26 20:46:20.519412 | localhost | Hostname: np0000191289
2026-08-26 20:46:20.519440 | localhost | Username: zuul
2026-08-26 20:46:20.519466 | localhost | Distro: Ubuntu 24.04
2026-08-26 20:46:20.519493 | localhost | Provider: yul1
2026-08-26 20:46:20.519519 | localhost | Region: ca-ymq-1
2026-08-26 20:46:20.519545 | localhost | Label: ubuntu-noble
2026-08-26 20:46:20.519570 | localhost | Product Name: OpenStack Nova
2026-08-26 20:46:20.519597 | localhost | Interface IP: 162.253.55.4
2026-08-26 20:46:20.528017 | 
2026-08-26 20:46:20.528084 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-08-26 20:46:20.901844 | localhost -> localhost | changed
2026-08-26 20:46:20.911707 | 
2026-08-26 20:46:20.911783 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-08-26 20:46:21.784777 | localhost -> localhost | changed
2026-08-26 20:46:21.794831 | 
2026-08-26 20:46:21.794889 | PLAY [all]
2026-08-26 20:46:21.806166 | 
2026-08-26 20:46:21.806236 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-08-26 20:46:22.033774 | mon1 -> localhost | ok
2026-08-26 20:46:22.044059 | 
2026-08-26 20:46:22.044145 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-08-26 20:46:22.081658 | mon1 | ok
2026-08-26 20:46:22.086294 | osd1 | ok
2026-08-26 20:46:22.105532 | mon1 | included: /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 20:46:22.105585 | osd1 | included: /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-08-26 20:46:22.112310 | 
2026-08-26 20:46:22.112372 | TASK [add-build-sshkey : Create Temp SSH key]
2026-08-26 20:46:22.756315 | mon1 -> localhost | Generating public/private rsa key pair.
2026-08-26 20:46:22.756488 | mon1 -> localhost | Your identification has been saved in /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/cb21ab9c15204b06895f8ae067aa11b4_id_rsa
2026-08-26 20:46:22.756520 | mon1 -> localhost | Your public key has been saved in /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/cb21ab9c15204b06895f8ae067aa11b4_id_rsa.pub
2026-08-26 20:46:22.756543 | mon1 -> localhost | The key fingerprint is:
2026-08-26 20:46:22.756566 | mon1 -> localhost | SHA256:SEcN5dQiqhV19KFGI3bIFhvvHzGoL0rDgSthMvTmhWw zuul-build-sshkey
2026-08-26 20:46:22.756587 | mon1 -> localhost | The key's randomart image is:
2026-08-26 20:46:22.756608 | mon1 -> localhost | +---[RSA 3072]----+
2026-08-26 20:46:22.756628 | mon1 -> localhost | |       oOBO..    |
2026-08-26 20:46:22.756649 | mon1 -> localhost | |      .o=@o=..   |
2026-08-26 20:46:22.756669 | mon1 -> localhost | | .    .+o.*.+    |
2026-08-26 20:46:22.756689 | mon1 -> localhost | |. o .ooo +   o   |
2026-08-26 20:46:22.756709 | mon1 -> localhost | |o oE.+o S . .    |
2026-08-26 20:46:22.756728 | mon1 -> localhost | | ++.oo . . . .   |
2026-08-26 20:46:22.756747 | mon1 -> localhost | |  ... + . . .    |
2026-08-26 20:46:22.756766 | mon1 -> localhost | |   . . o .       |
2026-08-26 20:46:22.756785 | mon1 -> localhost | |      .          |
2026-08-26 20:46:22.756804 | mon1 -> localhost | +----[SHA256]-----+
2026-08-26 20:46:22.756853 | mon1 -> localhost | ok: Runtime: 0:00:00.226336
2026-08-26 20:46:22.762354 | 
2026-08-26 20:46:22.762419 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-08-26 20:46:22.800344 | mon1 | ok
2026-08-26 20:46:22.805836 | osd1 | ok
2026-08-26 20:46:22.819599 | mon1 | included: /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 20:46:22.819661 | osd1 | included: /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-08-26 20:46:22.830762 | 
2026-08-26 20:46:22.830831 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-08-26 20:46:22.858996 | mon1 | skipping: Conditional result was False
2026-08-26 20:46:22.870240 | osd1 | skipping: Conditional result was False
2026-08-26 20:46:22.880291 | 
2026-08-26 20:46:22.880391 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-08-26 20:46:23.430698 | osd1 | changed
2026-08-26 20:46:23.437547 | mon1 | changed
2026-08-26 20:46:23.442549 | 
2026-08-26 20:46:23.442705 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-08-26 20:46:23.687755 | mon1 | ok
2026-08-26 20:46:23.705120 | osd1 | ok
2026-08-26 20:46:23.710841 | 
2026-08-26 20:46:23.710984 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-08-26 20:46:24.271265 | mon1 | changed
2026-08-26 20:46:24.350161 | osd1 | changed
2026-08-26 20:46:24.355601 | 
2026-08-26 20:46:24.355669 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-08-26 20:46:24.998440 | mon1 | changed
2026-08-26 20:46:25.003236 | osd1 | changed
2026-08-26 20:46:25.008539 | 
2026-08-26 20:46:25.008602 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-08-26 20:46:25.033728 | mon1 | skipping: Conditional result was False
2026-08-26 20:46:25.044784 | osd1 | skipping: Conditional result was False
2026-08-26 20:46:25.057217 | 
2026-08-26 20:46:25.057317 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-08-26 20:46:25.395639 | mon1 -> localhost | changed
2026-08-26 20:46:25.417655 | 
2026-08-26 20:46:25.417731 | TASK [add-build-sshkey : Add back temp key]
2026-08-26 20:46:25.726639 | mon1 -> localhost | Identity added: /var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/cb21ab9c15204b06895f8ae067aa11b4_id_rsa (zuul-build-sshkey)
2026-08-26 20:46:25.726918 | mon1 -> localhost | ok: Runtime: 0:00:00.013312
2026-08-26 20:46:25.734228 | 
2026-08-26 20:46:25.734292 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-08-26 20:46:26.083984 | mon1 | ok
2026-08-26 20:46:26.095599 | osd1 | ok
2026-08-26 20:46:26.101089 | 
2026-08-26 20:46:26.101157 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-08-26 20:46:26.135180 | mon1 | skipping: Conditional result was False
2026-08-26 20:46:26.146369 | osd1 | skipping: Conditional result was False
2026-08-26 20:46:26.169873 | 
2026-08-26 20:46:26.170017 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-08-26 20:46:26.534167 | mon1 | ok
2026-08-26 20:46:26.539561 | osd1 | ok
2026-08-26 20:46:26.545740 | 
2026-08-26 20:46:26.545825 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-08-26 20:46:27.421885 | osd1 | Output suppressed because no_log was given
2026-08-26 20:46:27.432344 | mon1 | Output suppressed because no_log was given
2026-08-26 20:46:27.448726 | 
2026-08-26 20:46:27.448796 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-08-26 20:46:27.712600 | mon1 | ok: "logs"
2026-08-26 20:46:27.713326 | mon1 | ok: All items complete
2026-08-26 20:46:27.713359 | 
2026-08-26 20:46:27.718450 | osd1 | ok: "logs"
2026-08-26 20:46:27.905902 | osd1 | ok: "artifacts"
2026-08-26 20:46:27.923154 | mon1 | ok: "artifacts"
2026-08-26 20:46:28.116615 | osd1 | ok: "docs"
2026-08-26 20:46:28.123914 | mon1 | ok: "docs"
2026-08-26 20:46:28.139406 | 
2026-08-26 20:46:28.139677 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-08-26 20:46:28.369192 | mon1 | changed: "logs"
2026-08-26 20:46:28.369604 | mon1 | ok: All items complete
2026-08-26 20:46:28.369660 | 
2026-08-26 20:46:28.418518 | osd1 | changed: "logs"
2026-08-26 20:46:28.554787 | mon1 | changed: "artifacts"
2026-08-26 20:46:28.608389 | osd1 | changed: "artifacts"
2026-08-26 20:46:28.762043 | mon1 | changed: "docs"
2026-08-26 20:46:28.798155 | osd1 | changed: "docs"
2026-08-26 20:46:28.823733 | 
2026-08-26 20:46:28.823855 | PLAY RECAP
2026-08-26 20:46:28.823907 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:46:28.823938 | mon1 | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 20:46:28.823962 | osd1 | ok: 11 changed: 5 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-08-26 20:46:28.823980 | 
2026-08-26 20:46:29.004773 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-08-26 20:46:29.009886 | PRE-RUN START: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 20:46:29.651324 | 
2026-08-26 20:46:29.651508 | PLAY [all]
2026-08-26 20:46:29.665661 | 
2026-08-26 20:46:29.665865 | TASK [setup-uv : Extract archive]
2026-08-26 20:46:37.206986 | mon1 | changed
2026-08-26 20:46:47.952788 | osd1 | ERROR
2026-08-26 20:46:47.953125 | osd1 | {
2026-08-26 20:46:47.953215 | osd1 |   "msg": "Failure downloading https://github.com/astral-sh/uv/releases/download/0.8.13/uv-x86_64-unknown-linux-gnu.tar.gz, Request failed: <urlopen error [Errno -3] Temporary failure in name resolution>"
2026-08-26 20:46:47.953328 | osd1 | }
failure
2026-08-26 20:46:47.960059 | 
2026-08-26 20:46:47.960128 | TASK [setup-uv : Print version]
2026-08-26 20:46:48.419158 | mon1 | uv 0.8.13
2026-08-26 20:46:48.525629 | mon1 | ok: Runtime: 0:00:00.017907
2026-08-26 20:46:48.541504 | 
2026-08-26 20:46:48.541575 | TASK [Install Ansible collection siblings]
2026-08-26 20:46:48.966802 | mon1 | ok:
2026-08-26 20:46:48.966971 | mon1 | Skipping community.general: no checked-out sibling
2026-08-26 20:46:48.967003 | mon1 | Skipping ansible.utils: no checked-out sibling
2026-08-26 20:46:48.967025 | mon1 | Skipping vexxhost.containers: no checked-out sibling
2026-08-26 20:46:48.968653 | 
2026-08-26 20:46:48.968694 | PLAY RECAP
2026-08-26 20:46:48.968743 | mon1 | ok: 3 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:46:48.968780 | osd1 | ok: 0 changed: 0 unreachable: 0 failed: 1 skipped: 0 rescued: 0 ignored: 0
2026-08-26 20:46:48.968800 | 
2026-08-26 20:46:49.118721 | PRE-RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/zuul-jobs/playbooks/molecule/pre.yaml@main]
2026-08-26 20:46:49.124476 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 20:46:49.747676 | 
2026-08-26 20:46:49.747851 | PLAY [all]
2026-08-26 20:46:49.764975 | 
2026-08-26 20:46:49.765098 | TASK [fetch-output : Set log path for multiple nodes]
2026-08-26 20:46:49.822534 | mon1 | ok
2026-08-26 20:46:49.829885 | osd1 | ok
2026-08-26 20:46:49.835392 | 
2026-08-26 20:46:49.835489 | TASK [fetch-output : Set log path for single node]
2026-08-26 20:46:49.861116 | mon1 | skipping: Conditional result was False
2026-08-26 20:46:49.872648 | osd1 | skipping: Conditional result was False
2026-08-26 20:46:49.884720 | 
2026-08-26 20:46:49.884829 | LOOP [fetch-output : Ensure local output dirs]
2026-08-26 20:46:50.278545 | osd1 -> localhost | changed: "/var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/logs/osd1"
2026-08-26 20:46:50.300806 | mon1 -> localhost | changed: "/var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/logs/mon1"
2026-08-26 20:46:50.508283 | osd1 -> localhost | changed: "/var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/artifacts"
2026-08-26 20:46:50.537565 | mon1 -> localhost | ok: "/var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/artifacts"
2026-08-26 20:46:50.721414 | osd1 -> localhost | changed: "/var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/docs"
2026-08-26 20:46:50.764685 | mon1 -> localhost | ok: "/var/lib/zuul/builds/cb21ab9c15204b06895f8ae067aa11b4/work/docs"
2026-08-26 20:46:50.764831 | mon1 -> localhost | changed: All items complete
2026-08-26 20:46:50.764888 | 
2026-08-26 20:46:50.785165 | 
2026-08-26 20:46:50.785299 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-08-26 20:46:51.493677 | mon1 | changed: .d..t...... ./
2026-08-26 20:46:51.511522 | osd1 | changed: .d..t...... ./
2026-08-26 20:46:51.978195 | mon1 | changed: .d..t...... ./
2026-08-26 20:46:52.004781 | osd1 | ok
2026-08-26 20:46:52.490948 | mon1 | changed: .d..t...... ./
2026-08-26 20:46:52.515439 | osd1 | ok
2026-08-26 20:46:52.515522 | osd1 | changed: All items complete
2026-08-26 20:46:52.515563 | 
2026-08-26 20:46:52.548573 | 
2026-08-26 20:46:52.548704 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-08-26 20:46:52.969632 | mon1 -> localhost | ok: Item: artifacts Runtime: 0:00:00.008805
2026-08-26 20:46:53.194381 | mon1 -> localhost | ok: Item: docs Runtime: 0:00:00.008009
2026-08-26 20:46:53.222822 | 
2026-08-26 20:46:53.222930 | PLAY [all]
2026-08-26 20:46:53.229469 | 
2026-08-26 20:46:53.229535 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-08-26 20:46:53.763945 | mon1 | changed
2026-08-26 20:46:53.771608 | osd1 | changed
2026-08-26 20:46:53.781735 | 
2026-08-26 20:46:53.781784 | PLAY RECAP
2026-08-26 20:46:53.781831 | mon1 | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 20:46:53.781858 | osd1 | ok: 4 changed: 3 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-08-26 20:46:53.781876 | 
2026-08-26 20:46:53.904811 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-08-26 20:46:53.910089 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-08-26 20:46:54.523519 | 
2026-08-26 20:46:54.523659 | PLAY [localhost]
2026-08-26 20:46:54.533789 | 
2026-08-26 20:46:54.533866 | TASK [Generate Zuul manifest]
2026-08-26 20:46:54.557974 | localhost | ok
2026-08-26 20:46:54.576553 | 
2026-08-26 20:46:54.576637 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-08-26 20:46:54.963786 | localhost | changed
2026-08-26 20:46:54.978486 | 
2026-08-26 20:46:54.978602 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-08-26 20:46:55.011605 | localhost | ok
2026-08-26 20:46:55.023844 | 
2026-08-26 20:46:55.023935 | TASK [Upload logs]
2026-08-26 20:46:55.044876 | localhost | ok
2026-08-26 20:46:55.106654 | 
2026-08-26 20:46:55.106813 | TASK [Set zuul-log-path fact]
2026-08-26 20:46:55.128455 | localhost | ok
2026-08-26 20:46:55.143359 | 
2026-08-26 20:46:55.143430 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-08-26 20:46:55.176552 | localhost | ok
2026-08-26 20:46:55.183536 | 
2026-08-26 20:46:55.183609 | TASK [upload-logs : Create log directories]
2026-08-26 20:46:55.611378 | localhost | changed
2026-08-26 20:46:55.618404 | 
2026-08-26 20:46:55.618501 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-08-26 20:46:56.027913 | localhost -> localhost | ok: Runtime: 0:00:00.006726
2026-08-26 20:46:56.035254 | 
2026-08-26 20:46:56.035349 | TASK [upload-logs : Upload logs to log server]
2026-08-26 20:46:56.564103 | localhost | Output suppressed because no_log was given
2026-08-26 20:46:56.570676 | 
2026-08-26 20:46:56.570789 | LOOP [upload-logs : Compress console log and json output]
2026-08-26 20:46:56.674543 | localhost | skipping: Conditional result was False
2026-08-26 20:46:56.682161 | localhost | skipping: Conditional result was False
2026-08-26 20:46:56.699539 | 
2026-08-26 20:46:56.699732 | LOOP [upload-logs : Upload compressed console log and json output]
2026-08-26 20:46:56.792374 | localhost | skipping: Conditional result was False
2026-08-26 20:46:56.792749 | 
2026-08-26 20:46:56.796171 | localhost | skipping: Conditional result was False
2026-08-26 20:46:56.857322 | 
2026-08-26 20:46:56.857514 | LOOP [upload-logs : Upload console log and json output]