2026-10-19 01:38:46.237178 | Job console starting
2026-10-19 01:38:46.248346 | Updating git repos
2026-10-19 01:38:46.337643 | Cloning repos into workspace
2026-10-19 01:38:46.408346 | Restoring repo states
2026-10-19 01:38:46.433515 | Merging changes
2026-10-19 01:38:47.347978 | Checking out repos
2026-10-19 01:38:47.481823 | Preparing playbooks
2026-10-19 01:38:48.851631 | Running Ansible setup
2026-10-19 01:38:52.228126 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-10-19 01:38:52.781717 | 
2026-10-19 01:38:52.782129 | PLAY [localhost]
2026-10-19 01:38:52.797282 | 
2026-10-19 01:38:52.797481 | TASK [Gathering Facts]
2026-10-19 01:38:53.798867 | localhost | ok
2026-10-19 01:38:53.816037 | 
2026-10-19 01:38:53.816192 | TASK [Setup log path fact]
2026-10-19 01:38:53.835439 | localhost | ok
2026-10-19 01:38:53.852314 | 
2026-10-19 01:38:53.852434 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-10-19 01:38:53.881699 | localhost | ok
2026-10-19 01:38:53.892199 | 
2026-10-19 01:38:53.892337 | TASK [emit-job-header : Print job information]
2026-10-19 01:38:53.934903 | # Job Information
2026-10-19 01:38:53.935111 | Ansible Version: 2.16.18
2026-10-19 01:38:53.935180 | Job: atmosphere-release-manifest
2026-10-19 01:38:53.935227 | Pipeline: check
2026-10-19 01:38:53.935268 | Executor: 2d72f0692154
2026-10-19 01:38:53.935309 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4093
2026-10-19 01:38:53.935357 | Event ID: e59c46d0-cb5c-11f1-8d66-ecabaf6af916
2026-10-19 01:38:53.940789 | 
2026-10-19 01:38:53.940946 | LOOP [emit-job-header : Print node information]
2026-10-19 01:38:54.040284 | localhost | ok:
2026-10-19 01:38:54.041134 | localhost | # Node Information
2026-10-19 01:38:54.041227 | localhost | Inventory Hostname: instance
2026-10-19 01:38:54.041275 | localhost | Hostname: np0000196117
2026-10-19 01:38:54.041314 | localhost | Username: zuul
2026-10-19 01:38:54.041359 | localhost | Distro: Ubuntu 22.04
2026-10-19 01:38:54.041397 | localhost | Provider: yul1
2026-10-19 01:38:54.041434 | localhost | Region: ca-ymq-1
2026-10-19 01:38:54.041478 | localhost | Label: ubuntu-jammy
2026-10-19 01:38:54.041532 | localhost | Product Name: OpenStack Nova
2026-10-19 01:38:54.041592 | localhost | Interface IP: 162.253.55.66
2026-10-19 01:38:54.060918 | 
2026-10-19 01:38:54.061082 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-10-19 01:38:54.510696 | localhost -> localhost | changed
2026-10-19 01:38:54.519539 | 
2026-10-19 01:38:54.519677 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-10-19 01:38:55.425931 | localhost -> localhost | changed
2026-10-19 01:38:55.437482 | 
2026-10-19 01:38:55.437680 | PLAY [all]
2026-10-19 01:38:55.452778 | 
2026-10-19 01:38:55.453055 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-10-19 01:38:55.746061 | instance -> localhost | ok
2026-10-19 01:38:55.758238 | 
2026-10-19 01:38:55.758371 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-10-19 01:38:55.793244 | instance | ok
2026-10-19 01:38:55.818668 | instance | included: /var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-10-19 01:38:55.826806 | 
2026-10-19 01:38:55.826900 | TASK [add-build-sshkey : Create Temp SSH key]
2026-10-19 01:38:56.826388 | instance -> localhost | Generating public/private rsa key pair.
2026-10-19 01:38:56.826641 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/work/8bb946fcf68a4b74b739e18a99027f1f_id_rsa
2026-10-19 01:38:56.826700 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/work/8bb946fcf68a4b74b739e18a99027f1f_id_rsa.pub
2026-10-19 01:38:56.826743 | instance -> localhost | The key fingerprint is:
2026-10-19 01:38:56.826785 | instance -> localhost | SHA256:XSIKbvb87ahjnrIJzM8bkD1XBExlKgDlJgzRRwjLN4U zuul-build-sshkey
2026-10-19 01:38:56.826841 | instance -> localhost | The key's randomart image is:
2026-10-19 01:38:56.826905 | instance -> localhost | +---[RSA 3072]----+
2026-10-19 01:38:56.826953 | instance -> localhost | |=*ooo+oo+        |
2026-10-19 01:38:56.826995 | instance -> localhost | |+ooEo .+         |
2026-10-19 01:38:56.827033 | instance -> localhost | |ooo+o . o . .    |
2026-10-19 01:38:56.827072 | instance -> localhost | | o.+.o o o o     |
2026-10-19 01:38:56.827110 | instance -> localhost | |  o * o S .      |
2026-10-19 01:38:56.827148 | instance -> localhost | | o + =           |
2026-10-19 01:38:56.827185 | instance -> localhost | |  + . o          |
2026-10-19 01:38:56.827224 | instance -> localhost | |   +.ooo o       |
2026-10-19 01:38:56.827268 | instance -> localhost | |    **+oo.o      |
2026-10-19 01:38:56.827308 | instance -> localhost | +----[SHA256]-----+
2026-10-19 01:38:56.827391 | instance -> localhost | ok: Runtime: 0:00:00.543804
2026-10-19 01:38:56.836781 | 
2026-10-19 01:38:56.836925 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-10-19 01:38:56.871107 | instance | ok
2026-10-19 01:38:56.887045 | instance | included: /var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-10-19 01:38:56.897846 | 
2026-10-19 01:38:56.897943 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-10-19 01:38:56.923081 | instance | skipping: Conditional result was False
2026-10-19 01:38:56.934281 | 
2026-10-19 01:38:56.934408 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-10-19 01:38:57.386742 | instance | changed
2026-10-19 01:38:57.391091 | 
2026-10-19 01:38:57.391151 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-10-19 01:38:57.585667 | instance | ok
2026-10-19 01:38:57.595427 | 
2026-10-19 01:38:57.595551 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-10-19 01:38:58.085443 | instance | changed
2026-10-19 01:38:58.097027 | 
2026-10-19 01:38:58.097160 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-10-19 01:38:58.586352 | instance | changed
2026-10-19 01:38:58.595565 | 
2026-10-19 01:38:58.595689 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-10-19 01:38:58.620536 | instance | skipping: Conditional result was False
2026-10-19 01:38:58.630144 | 
2026-10-19 01:38:58.630267 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-10-19 01:38:59.018990 | instance -> localhost | changed
2026-10-19 01:38:59.033750 | 
2026-10-19 01:38:59.033848 | TASK [add-build-sshkey : Add back temp key]
2026-10-19 01:38:59.346108 | instance -> localhost | Identity added: /var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/work/8bb946fcf68a4b74b739e18a99027f1f_id_rsa (zuul-build-sshkey)
2026-10-19 01:38:59.346293 | instance -> localhost | ok: Runtime: 0:00:00.017946
2026-10-19 01:38:59.350371 | 
2026-10-19 01:38:59.350428 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-10-19 01:38:59.696763 | instance | ok
2026-10-19 01:38:59.705227 | 
2026-10-19 01:38:59.705352 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-10-19 01:38:59.732076 | instance | skipping: Conditional result was False
2026-10-19 01:38:59.749050 | 
2026-10-19 01:38:59.749174 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-10-19 01:39:00.106361 | instance | ok
2026-10-19 01:39:00.111293 | 
2026-10-19 01:39:00.111351 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-10-19 01:39:01.874779 | instance | Output suppressed because no_log was given
2026-10-19 01:39:01.891036 | 
2026-10-19 01:39:01.891118 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-10-19 01:39:02.111613 | instance | ok: "logs"
2026-10-19 01:39:02.112270 | instance | ok: All items complete
2026-10-19 01:39:02.112427 | 
2026-10-19 01:39:02.280550 | instance | ok: "artifacts"
2026-10-19 01:39:02.455101 | instance | ok: "docs"
2026-10-19 01:39:02.465639 | 
2026-10-19 01:39:02.465795 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-10-19 01:39:02.679533 | instance | changed: "logs"
2026-10-19 01:39:02.860615 | instance | changed: "artifacts"
2026-10-19 01:39:03.048405 | instance | changed: "docs"
2026-10-19 01:39:03.073151 | 
2026-10-19 01:39:03.073312 | PLAY RECAP
2026-10-19 01:39:03.073402 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-10-19 01:39:03.073458 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-10-19 01:39:03.073501 | 
2026-10-19 01:39:03.216305 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-10-19 01:39:03.218725 | RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/release-manifest/run.yaml@main]
2026-10-19 01:39:03.806349 | 
2026-10-19 01:39:03.806491 | PLAY [Build the release manifest]
2026-10-19 01:39:03.817273 | 
2026-10-19 01:39:03.817352 | TASK [Install Go]
2026-10-19 01:39:03.837216 | instance | ok
2026-10-19 01:39:03.853728 | 
2026-10-19 01:39:03.853816 | TASK [ensure-go : Check installed go version]
2026-10-19 01:39:04.386899 | instance | ok: ERROR (ignored)
2026-10-19 01:39:04.388035 | instance | {
2026-10-19 01:39:04.388258 | instance |   "failed_when_result": false,
2026-10-19 01:39:04.388466 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-10-19 01:39:04.388693 | instance |   "rc": 2
2026-10-19 01:39:04.388982 | instance | }
2026-10-19 01:39:04.400065 | 
2026-10-19 01:39:04.400199 | TASK [ensure-go : Skip if correct version of go is installed]
2026-10-19 01:39:04.474545 | instance | ok
2026-10-19 01:39:04.488048 | instance | included: /var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-10-19 01:39:04.498130 | 
2026-10-19 01:39:04.498263 | TASK [ensure-go : Create temp directory]
2026-10-19 01:39:04.862732 | instance | changed
2026-10-19 01:39:04.873565 | 
2026-10-19 01:39:04.873695 | TASK [ensure-go : Get archive checksum]
2026-10-19 01:39:05.536668 | instance | ok: OK (64 bytes)
2026-10-19 01:39:05.541538 | 
2026-10-19 01:39:05.541613 | TASK [ensure-go : Download go archive]
2026-10-19 01:39:06.669727 | instance | changed: OK (78559214 bytes)
2026-10-19 01:39:06.679495 | 
2026-10-19 01:39:06.679637 | TASK [ensure-go : Install go]
2026-10-19 01:39:12.650898 | instance | changed
2026-10-19 01:39:12.669308 | 
2026-10-19 01:39:12.669476 | TASK [atmosphere-build-manifest : Create the output directory]
2026-10-19 01:39:13.028435 | instance | changed
2026-10-19 01:39:13.037746 | 
2026-10-19 01:39:13.037903 | TASK [atmosphere-build-manifest : Build atmosphere-release]
2026-10-19 01:39:13.320728 | instance | go: downloading oras.land/oras-go/v2 v2.6.0
2026-10-19 01:39:13.320918 | instance | go: downloading github.com/sirupsen/logrus v1.9.3
2026-10-19 01:39:13.320977 | instance | go: downloading github.com/spf13/cobra v1.9.1
2026-10-19 01:39:13.320995 | instance | go: downloading github.com/goccy/go-yaml v1.18.0
2026-10-19 01:39:13.325599 | instance | go: downloading github.com/containers/image/v5 v5.35.0
2026-10-19 01:39:13.567326 | instance | go: downloading github.com/opencontainers/go-digest v1.0.0
2026-10-19 01:39:13.612278 | instance | go: downloading github.com/opencontainers/image-spec v1.1.1
2026-10-19 01:39:13.674483 | instance | go: downloading golang.org/x/sync v0.18.0
2026-10-19 01:39:13.766480 | instance | go: downloading golang.org/x/sys v0.38.0
2026-10-19 01:39:13.782088 | instance | go: downloading github.com/spf13/pflag v1.0.6
2026-10-19 01:39:13.868398 | instance | go: downloading github.com/containers/storage v1.58.0
2026-10-19 01:39:13.868547 | instance | go: downloading github.com/docker/distribution v2.8.3+incompatible
2026-10-19 01:39:13.869887 | instance | go: downloading github.com/docker/go-connections v0.5.0
2026-10-19 01:39:13.870299 | instance | go: downloading gopkg.in/yaml.v3 v3.0.1
2026-10-19 01:39:13.913423 | instance | go: downloading github.com/containers/libtrust v0.0.0-20230121012942-c1716e8a8d01
2026-10-19 01:39:13.919242 | instance | go: downloading github.com/containers/ocicrypt v1.2.1
2026-10-19 01:39:13.952442 | instance | go: downloading github.com/docker/docker v28.3.3+incompatible
2026-10-19 01:39:13.995291 | instance | go: downloading github.com/BurntSushi/toml v1.5.0
2026-10-19 01:39:14.088053 | instance | go: downloading github.com/docker/docker-credential-helpers v0.9.3
2026-10-19 01:39:14.090887 | instance | go: downloading github.com/distribution/reference v0.6.0
2026-10-19 01:39:14.091081 | instance | go: downloading github.com/gorilla/mux v1.8.1
2026-10-19 01:39:14.095283 | instance | go: downloading github.com/moby/sys/capability v0.4.0
2026-10-19 01:39:14.122015 | instance | go: downloading github.com/opencontainers/runtime-spec v1.2.1
2026-10-19 01:39:14.129112 | instance | go: downloading github.com/docker/go-units v0.5.0
2026-10-19 01:39:14.131087 | instance | go: downloading github.com/moby/sys/user v0.4.0
2026-10-19 01:39:14.131423 | instance | go: downloading github.com/moby/sys/mountinfo v0.7.2
2026-10-19 01:39:28.111908 | instance | ok: Runtime: 0:00:14.681475
2026-10-19 01:39:28.122116 | 
2026-10-19 01:39:28.122242 | TASK [atmosphere-build-manifest : Generate the release manifest]
2026-10-19 01:39:30.515877 | instance | time="2026-10-19T01:39:30Z" level=info msg="Wrote /home/zuul/atmosphere-release-manifest/release-manifest.yaml" images=218
2026-10-19 01:39:30.710596 | instance | ok: Runtime: 0:00:02.114783
2026-10-19 01:39:30.716702 | 
2026-10-19 01:39:30.716793 | TASK [atmosphere-build-manifest : Compute the release manifest artifact digest]
2026-10-19 01:39:30.967973 | instance | sha256:59c8597ce6cb2713529989f237f205b7b794f2a42b3e76c99074d9e7db545f91
2026-10-19 01:39:31.274928 | instance | ok: Runtime: 0:00:00.022526
2026-10-19 01:39:31.285005 | 
2026-10-19 01:39:31.285138 | LOOP [atmosphere-build-manifest : Save the release manifest and atmosphere-release with the job logs]
2026-10-19 01:39:31.522307 | instance | changed: "release-manifest.yaml"
2026-10-19 01:39:31.840090 | instance | changed: "atmosphere-release"
2026-10-19 01:39:31.872226 | 
2026-10-19 01:39:31.872569 | TASK [atmosphere-build-manifest : Return the release manifest to dependent jobs]
2026-10-19 01:39:31.909258 | instance | ok
2026-10-19 01:39:31.915745 | 
2026-10-19 01:39:31.915808 | PLAY RECAP
2026-10-19 01:39:31.915877 | instance | ok: 12 changed: 7 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-10-19 01:39:31.915907 | 
2026-10-19 01:39:32.104978 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/release-manifest/run.yaml@main]
2026-10-19 01:39:32.107953 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-10-19 01:39:32.684042 | 
2026-10-19 01:39:32.684186 | PLAY [all]
2026-10-19 01:39:32.694810 | 
2026-10-19 01:39:32.695033 | TASK [fetch-output : Set log path for multiple nodes]
2026-10-19 01:39:32.749476 | instance | skipping: Conditional result was False
2026-10-19 01:39:32.756108 | 
2026-10-19 01:39:32.756209 | TASK [fetch-output : Set log path for single node]
2026-10-19 01:39:32.809671 | instance | ok
2026-10-19 01:39:32.817634 | 
2026-10-19 01:39:32.817723 | LOOP [fetch-output : Ensure local output dirs]
2026-10-19 01:39:33.241619 | instance -> localhost | ok: "/var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/work/logs"
2026-10-19 01:39:33.463328 | instance -> localhost | changed: "/var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/work/artifacts"
2026-10-19 01:39:33.735051 | instance -> localhost | changed: "/var/lib/zuul/builds/8bb946fcf68a4b74b739e18a99027f1f/work/docs"
2026-10-19 01:39:33.754590 | 
2026-10-19 01:39:33.754740 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-10-19 01:39:34.476348 | instance | changed: .d..t...... ./
2026-10-19 01:39:34.476896 | instance | changed: All items complete
2026-10-19 01:39:34.476963 | 
2026-10-19 01:39:34.988163 | instance | changed: .d..t...... ./
2026-10-19 01:39:35.497545 | instance | changed: .d..t...... ./
2026-10-19 01:39:35.525422 | 
2026-10-19 01:39:35.525575 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-10-19 01:39:35.999381 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007466
2026-10-19 01:39:36.327628 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.009413
2026-10-19 01:39:36.345091 | 
2026-10-19 01:39:36.345881 | PLAY [all]
2026-10-19 01:39:36.353801 | 
2026-10-19 01:39:36.353903 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-10-19 01:39:36.782553 | instance | changed
2026-10-19 01:39:36.795318 | 
2026-10-19 01:39:36.795414 | PLAY RECAP
2026-10-19 01:39:36.795498 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-10-19 01:39:36.795541 | 
2026-10-19 01:39:36.937607 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-10-19 01:39:36.938910 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-10-19 01:39:37.531802 | 
2026-10-19 01:39:37.531946 | PLAY [localhost]
2026-10-19 01:39:37.542055 | 
2026-10-19 01:39:37.542122 | TASK [Generate Zuul manifest]
2026-10-19 01:39:37.562279 | localhost | ok
2026-10-19 01:39:37.574480 | 
2026-10-19 01:39:37.574549 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-10-19 01:39:38.132836 | localhost | changed
2026-10-19 01:39:38.142259 | 
2026-10-19 01:39:38.142332 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-10-19 01:39:38.181583 | localhost | ok
2026-10-19 01:39:38.190065 | 
2026-10-19 01:39:38.190158 | TASK [Upload logs]
2026-10-19 01:39:38.208256 | localhost | ok
2026-10-19 01:39:38.265733 | 
2026-10-19 01:39:38.265906 | TASK [Set zuul-log-path fact]
2026-10-19 01:39:38.282497 | localhost | ok
2026-10-19 01:39:38.382362 | 
2026-10-19 01:39:38.382564 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-10-19 01:39:38.424733 | localhost | ok
2026-10-19 01:39:38.440550 | 
2026-10-19 01:39:38.440726 | TASK [upload-logs : Create log directories]
2026-10-19 01:39:38.930267 | localhost | changed
2026-10-19 01:39:38.944532 | 
2026-10-19 01:39:38.944692 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-10-19 01:39:39.416102 | localhost -> localhost | ok: Runtime: 0:00:00.005234
2026-10-19 01:39:39.425961 | 
2026-10-19 01:39:39.426117 | TASK [upload-logs : Upload logs to log server]
2026-10-19 01:39:40.085490 | localhost | Output suppressed because no_log was given
2026-10-19 01:39:40.091007 | 
2026-10-19 01:39:40.091170 | LOOP [upload-logs : Compress console log and json output]
2026-10-19 01:39:40.146143 | localhost | skipping: Conditional result was False
2026-10-19 01:39:40.153491 | localhost | skipping: Conditional result was False
2026-10-19 01:39:40.162257 | 
2026-10-19 01:39:40.162398 | LOOP [upload-logs : Upload compressed console log and json output]
2026-10-19 01:39:40.203444 | localhost | skipping: Conditional result was False
2026-10-19 01:39:40.203734 | 
2026-10-19 01:39:40.209612 | localhost | skipping: Conditional result was False
2026-10-19 01:39:40.220528 | 
2026-10-19 01:39:40.220648 | LOOP [upload-logs : Upload console log and json output]