2026-10-17 02:53:33.624216 | Job console starting
2026-10-17 02:53:33.637492 | Updating git repos
2026-10-17 02:53:33.742171 | Cloning repos into workspace
2026-10-17 02:53:33.919003 | Restoring repo states
2026-10-17 02:53:33.957134 | Merging changes
2026-10-17 02:53:35.546286 | Checking out repos
2026-10-17 02:53:35.746024 | Preparing playbooks
2026-10-17 02:53:38.162819 | Running Ansible setup
2026-10-17 02:53:41.666077 | PRE-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-10-17 02:53:42.235853 | 
2026-10-17 02:53:42.236571 | PLAY [localhost]
2026-10-17 02:53:42.244678 | 
2026-10-17 02:53:42.244754 | TASK [Gathering Facts]
2026-10-17 02:53:43.135595 | localhost | ok
2026-10-17 02:53:43.148255 | 
2026-10-17 02:53:43.148406 | TASK [Setup log path fact]
2026-10-17 02:53:43.170017 | localhost | ok
2026-10-17 02:53:43.190721 | 
2026-10-17 02:53:43.190855 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-10-17 02:53:43.221791 | localhost | ok
2026-10-17 02:53:43.232841 | 
2026-10-17 02:53:43.232971 | TASK [emit-job-header : Print job information]
2026-10-17 02:53:43.283956 | # Job Information
2026-10-17 02:53:43.284152 | Ansible Version: 2.16.18
2026-10-17 02:53:43.284212 | Job: atmosphere-release-manifest
2026-10-17 02:53:43.284254 | Pipeline: check
2026-10-17 02:53:43.284292 | Executor: 2d72f0692154
2026-10-17 02:53:43.284329 | Triggered by: https://github.com/vexxhost/atmosphere/pull/4420
2026-10-17 02:53:43.284374 | Event ID: 327ee4f0-c9d5-11f1-87f5-cbb5fc8e396f
2026-10-17 02:53:43.289738 | 
2026-10-17 02:53:43.289884 | LOOP [emit-job-header : Print node information]
2026-10-17 02:53:43.410526 | localhost | ok:
2026-10-17 02:53:43.410889 | localhost | # Node Information
2026-10-17 02:53:43.410960 | localhost | Inventory Hostname: instance
2026-10-17 02:53:43.411012 | localhost | Hostname: np0000195997
2026-10-17 02:53:43.411057 | localhost | Username: zuul
2026-10-17 02:53:43.411115 | localhost | Distro: Ubuntu 22.04
2026-10-17 02:53:43.411161 | localhost | Provider: yul1
2026-10-17 02:53:43.411205 | localhost | Region: ca-ymq-1
2026-10-17 02:53:43.411248 | localhost | Label: ubuntu-jammy
2026-10-17 02:53:43.411290 | localhost | Product Name: OpenStack Nova
2026-10-17 02:53:43.411332 | localhost | Interface IP: 162.253.55.86
2026-10-17 02:53:43.422692 | 
2026-10-17 02:53:43.422838 | TASK [log-inventory : Ensure Zuul Ansible directory exists]
2026-10-17 02:53:43.925124 | localhost -> localhost | changed
2026-10-17 02:53:43.934079 | 
2026-10-17 02:53:43.934479 | TASK [log-inventory : Copy ansible inventory to logs dir]
2026-10-17 02:53:44.853846 | localhost -> localhost | changed
2026-10-17 02:53:44.866346 | 
2026-10-17 02:53:44.866481 | PLAY [all]
2026-10-17 02:53:44.880712 | 
2026-10-17 02:53:44.880849 | TASK [add-build-sshkey : Check to see if ssh key was already created for this build]
2026-10-17 02:53:45.128522 | instance -> localhost | ok
2026-10-17 02:53:45.134072 | 
2026-10-17 02:53:45.134134 | TASK [add-build-sshkey : Create a new key in workspace based on build UUID]
2026-10-17 02:53:45.162695 | instance | ok
2026-10-17 02:53:45.179144 | instance | included: /var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/create-key-and-replace.yaml
2026-10-17 02:53:45.184559 | 
2026-10-17 02:53:45.184619 | TASK [add-build-sshkey : Create Temp SSH key]
2026-10-17 02:53:45.906454 | instance -> localhost | Generating public/private rsa key pair.
2026-10-17 02:53:45.906754 | instance -> localhost | Your identification has been saved in /var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/work/49e3ca2e1b72470abac6c5828ed44580_id_rsa
2026-10-17 02:53:45.906815 | instance -> localhost | Your public key has been saved in /var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/work/49e3ca2e1b72470abac6c5828ed44580_id_rsa.pub
2026-10-17 02:53:45.906859 | instance -> localhost | The key fingerprint is:
2026-10-17 02:53:45.906900 | instance -> localhost | SHA256:dKQDkE9JF6mKmYOLUsJ4NEquHttni0KrkEEZhLJoBUM zuul-build-sshkey
2026-10-17 02:53:45.906962 | instance -> localhost | The key's randomart image is:
2026-10-17 02:53:45.907003 | instance -> localhost | +---[RSA 3072]----+
2026-10-17 02:53:45.907055 | instance -> localhost | |+E. .+o.oo.      |
2026-10-17 02:53:45.907100 | instance -> localhost | |o +.. oo.o       |
2026-10-17 02:53:45.907139 | instance -> localhost | |o+.  o .+ .      |
2026-10-17 02:53:45.907177 | instance -> localhost | |+oo   o. o       |
2026-10-17 02:53:45.907215 | instance -> localhost | |B+ = .  S        |
2026-10-17 02:53:45.907261 | instance -> localhost | |=*B .            |
2026-10-17 02:53:45.907299 | instance -> localhost | |**..             |
2026-10-17 02:53:45.907337 | instance -> localhost | |*o+ .o           |
2026-10-17 02:53:45.907381 | instance -> localhost | |=o.oo..          |
2026-10-17 02:53:45.907419 | instance -> localhost | +----[SHA256]-----+
2026-10-17 02:53:45.907503 | instance -> localhost | ok: Runtime: 0:00:00.250609
2026-10-17 02:53:45.914868 | 
2026-10-17 02:53:45.914955 | TASK [add-build-sshkey : Remote setup ssh keys (linux)]
2026-10-17 02:53:45.945620 | instance | ok
2026-10-17 02:53:45.958239 | instance | included: /var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/trusted/project_1/opendev.org/zuul/zuul-jobs/roles/add-build-sshkey/tasks/remote-linux.yaml
2026-10-17 02:53:45.967080 | 
2026-10-17 02:53:45.967140 | TASK [add-build-sshkey : Remove previously added zuul-build-sshkey]
2026-10-17 02:53:45.990608 | instance | skipping: Conditional result was False
2026-10-17 02:53:45.996118 | 
2026-10-17 02:53:45.996184 | TASK [add-build-sshkey : Enable access via build key on all nodes]
2026-10-17 02:53:46.453022 | instance | changed
2026-10-17 02:53:46.461878 | 
2026-10-17 02:53:46.462021 | TASK [add-build-sshkey : Make sure user has a .ssh]
2026-10-17 02:53:46.647631 | instance | ok
2026-10-17 02:53:46.659392 | 
2026-10-17 02:53:46.659521 | TASK [add-build-sshkey : Install build private key as SSH key on all nodes]
2026-10-17 02:53:47.105697 | instance | changed
2026-10-17 02:53:47.110962 | 
2026-10-17 02:53:47.111024 | TASK [add-build-sshkey : Install build public key as SSH key on all nodes]
2026-10-17 02:53:47.589096 | instance | changed
2026-10-17 02:53:47.598437 | 
2026-10-17 02:53:47.598559 | TASK [add-build-sshkey : Remote setup ssh keys (windows)]
2026-10-17 02:53:47.623282 | instance | skipping: Conditional result was False
2026-10-17 02:53:47.633062 | 
2026-10-17 02:53:47.633187 | TASK [remove-zuul-sshkey : Remove master key from local agent]
2026-10-17 02:53:48.052896 | instance -> localhost | changed
2026-10-17 02:53:48.071612 | 
2026-10-17 02:53:48.071820 | TASK [add-build-sshkey : Add back temp key]
2026-10-17 02:53:48.378287 | instance -> localhost | Identity added: /var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/work/49e3ca2e1b72470abac6c5828ed44580_id_rsa (zuul-build-sshkey)
2026-10-17 02:53:48.378583 | instance -> localhost | ok: Runtime: 0:00:00.015534
2026-10-17 02:53:48.387529 | 
2026-10-17 02:53:48.387687 | TASK [add-build-sshkey : Verify we can still SSH to all nodes]
2026-10-17 02:53:48.724810 | instance | ok
2026-10-17 02:53:48.733521 | 
2026-10-17 02:53:48.733671 | TASK [add-build-sshkey : Verify we can still SSH to all nodes (windows)]
2026-10-17 02:53:48.757982 | instance | skipping: Conditional result was False
2026-10-17 02:53:48.779139 | 
2026-10-17 02:53:48.779323 | TASK [prepare-workspace : Start zuul_console daemon.]
2026-10-17 02:53:49.137186 | instance | ok
2026-10-17 02:53:49.172906 | 
2026-10-17 02:53:49.173046 | TASK [prepare-workspace : Synchronize src repos to workspace directory.]
2026-10-17 02:53:50.987500 | instance | Output suppressed because no_log was given
2026-10-17 02:53:51.004063 | 
2026-10-17 02:53:51.004196 | LOOP [ensure-output-dirs : Empty Zuul Output directories by removing them]
2026-10-17 02:53:51.213261 | instance | ok: "logs"
2026-10-17 02:53:51.213626 | instance | ok: All items complete
2026-10-17 02:53:51.213705 | 
2026-10-17 02:53:51.357348 | instance | ok: "artifacts"
2026-10-17 02:53:51.496557 | instance | ok: "docs"
2026-10-17 02:53:51.508763 | 
2026-10-17 02:53:51.508950 | LOOP [ensure-output-dirs : Ensure Zuul Output directories exist]
2026-10-17 02:53:51.677690 | instance | changed: "logs"
2026-10-17 02:53:51.857620 | instance | changed: "artifacts"
2026-10-17 02:53:52.030277 | instance | changed: "docs"
2026-10-17 02:53:52.050825 | 
2026-10-17 02:53:52.050987 | PLAY RECAP
2026-10-17 02:53:52.051080 | instance | ok: 15 changed: 8 unreachable: 0 failed: 0 skipped: 3 rescued: 0 ignored: 0
2026-10-17 02:53:52.051139 | localhost | ok: 6 changed: 2 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-10-17 02:53:52.051179 | 
2026-10-17 02:53:52.196780 | PRE-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/pre.yaml@main]
2026-10-17 02:53:52.197883 | RUN START: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/release-manifest/run.yaml@main]
2026-10-17 02:53:52.759223 | 
2026-10-17 02:53:52.759628 | PLAY [Build the release manifest]
2026-10-17 02:53:52.770961 | 
2026-10-17 02:53:52.771036 | TASK [Install Go]
2026-10-17 02:53:52.789522 | instance | ok
2026-10-17 02:53:52.803359 | 
2026-10-17 02:53:52.803436 | TASK [ensure-go : Check installed go version]
2026-10-17 02:53:53.336723 | instance | ok: ERROR (ignored)
2026-10-17 02:53:53.337150 | instance | {
2026-10-17 02:53:53.337217 | instance |   "failed_when_result": false,
2026-10-17 02:53:53.337262 | instance |   "msg": "[Errno 2] No such file or directory: b'go'",
2026-10-17 02:53:53.337300 | instance |   "rc": 2
2026-10-17 02:53:53.337339 | instance | }
2026-10-17 02:53:53.346194 | 
2026-10-17 02:53:53.346318 | TASK [ensure-go : Skip if correct version of go is installed]
2026-10-17 02:53:53.419235 | instance | ok
2026-10-17 02:53:53.432052 | instance | included: /var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/untrusted/project_2/opendev.org/zuul/zuul-jobs/roles/ensure-go/tasks/install-go.yaml
2026-10-17 02:53:53.442980 | 
2026-10-17 02:53:53.443101 | TASK [ensure-go : Create temp directory]
2026-10-17 02:53:53.780616 | instance | changed
2026-10-17 02:53:53.892461 | 
2026-10-17 02:53:53.892692 | TASK [ensure-go : Get archive checksum]
2026-10-17 02:53:54.556962 | instance | ok: OK (64 bytes)
2026-10-17 02:53:54.567882 | 
2026-10-17 02:53:54.568021 | TASK [ensure-go : Download go archive]
2026-10-17 02:53:55.666376 | instance | changed: OK (78559214 bytes)
2026-10-17 02:53:55.681859 | 
2026-10-17 02:53:55.682060 | TASK [ensure-go : Install go]
2026-10-17 02:54:01.525700 | instance | changed
2026-10-17 02:54:01.542378 | 
2026-10-17 02:54:01.542503 | TASK [atmosphere-build-manifest : Create the output directory]
2026-10-17 02:54:01.889259 | instance | changed
2026-10-17 02:54:01.898262 | 
2026-10-17 02:54:01.898402 | TASK [atmosphere-build-manifest : Build atmosphere-release]
2026-10-17 02:54:02.165739 | instance | go: downloading oras.land/oras-go/v2 v2.6.0
2026-10-17 02:54:02.166443 | instance | go: downloading github.com/sirupsen/logrus v1.9.3
2026-10-17 02:54:02.166593 | instance | go: downloading github.com/goccy/go-yaml v1.18.0
2026-10-17 02:54:02.167407 | instance | go: downloading github.com/spf13/cobra v1.9.1
2026-10-17 02:54:02.189135 | instance | go: downloading github.com/containers/image/v5 v5.35.0
2026-10-17 02:54:02.399983 | instance | go: downloading github.com/opencontainers/go-digest v1.0.0
2026-10-17 02:54:02.435854 | instance | go: downloading github.com/opencontainers/image-spec v1.1.1
2026-10-17 02:54:02.486079 | instance | go: downloading golang.org/x/sync v0.18.0
2026-10-17 02:54:02.569518 | instance | go: downloading golang.org/x/sys v0.38.0
2026-10-17 02:54:02.570760 | instance | go: downloading github.com/spf13/pflag v1.0.7
2026-10-17 02:54:02.652308 | instance | go: downloading github.com/containers/libtrust v0.0.0-20230121012942-c1716e8a8d01
2026-10-17 02:54:02.652476 | instance | go: downloading github.com/containers/ocicrypt v1.2.1
2026-10-17 02:54:02.652487 | instance | go: downloading github.com/containers/storage v1.58.0
2026-10-17 02:54:02.652662 | instance | go: downloading github.com/docker/docker v28.3.3+incompatible
2026-10-17 02:54:02.653137 | instance | go: downloading github.com/docker/distribution v2.8.3+incompatible
2026-10-17 02:54:02.814228 | instance | go: downloading github.com/BurntSushi/toml v1.5.0
2026-10-17 02:54:02.814320 | instance | go: downloading github.com/docker/go-connections v0.5.0
2026-10-17 02:54:02.847054 | instance | go: downloading github.com/docker/docker-credential-helpers v0.9.3
2026-10-17 02:54:02.865606 | instance | go: downloading gopkg.in/yaml.v3 v3.0.1
2026-10-17 02:54:02.866183 | instance | go: downloading github.com/distribution/reference v0.6.0
2026-10-17 02:54:02.866346 | instance | go: downloading github.com/gorilla/mux v1.8.1
2026-10-17 02:54:02.885060 | instance | go: downloading github.com/docker/go-units v0.5.0
2026-10-17 02:54:02.885444 | instance | go: downloading github.com/moby/sys/mountinfo v0.7.2
2026-10-17 02:54:02.897380 | instance | go: downloading github.com/moby/sys/capability v0.4.0
2026-10-17 02:54:02.902189 | instance | go: downloading github.com/opencontainers/runtime-spec v1.2.1
2026-10-17 02:54:02.904580 | instance | go: downloading github.com/moby/sys/user v0.4.0
2026-10-17 02:54:16.963902 | instance | ok: Runtime: 0:00:14.407209
2026-10-17 02:54:16.973147 | 
2026-10-17 02:54:16.973277 | TASK [atmosphere-build-manifest : Generate the release manifest]
2026-10-17 02:54:19.310289 | instance | time="2026-10-17T02:54:19Z" level=info msg="Wrote /home/zuul/atmosphere-release-manifest/release-manifest.yaml" images=231
2026-10-17 02:54:19.520821 | instance | ok: Runtime: 0:00:02.038648
2026-10-17 02:54:19.529304 | 
2026-10-17 02:54:19.529427 | TASK [atmosphere-build-manifest : Compute the release manifest artifact digest]
2026-10-17 02:54:19.787033 | instance | sha256:0d4bb493f9a6ebc9b2839a0644dbdcde80a13e6d2f57b0ffee14df39e95d7edb
2026-10-17 02:54:20.077458 | instance | ok: Runtime: 0:00:00.023959
2026-10-17 02:54:20.087190 | 
2026-10-17 02:54:20.087323 | LOOP [atmosphere-build-manifest : Save the release manifest and atmosphere-release with the job logs]
2026-10-17 02:54:20.337109 | instance | changed: "release-manifest.yaml"
2026-10-17 02:54:20.684267 | instance | changed: "atmosphere-release"
2026-10-17 02:54:20.714262 | 
2026-10-17 02:54:20.714556 | TASK [atmosphere-build-manifest : Return the release manifest to dependent jobs]
2026-10-17 02:54:20.759400 | instance | ok
2026-10-17 02:54:20.769228 | 
2026-10-17 02:54:20.769325 | PLAY RECAP
2026-10-17 02:54:20.769405 | instance | ok: 12 changed: 7 unreachable: 0 failed: 0 skipped: 0 rescued: 0 ignored: 0
2026-10-17 02:54:20.769446 | 
2026-10-17 02:54:20.910324 | RUN END RESULT_NORMAL: [untrusted : github.com/vexxhost/atmosphere-zuul-jobs/playbooks/release-manifest/run.yaml@main]
2026-10-17 02:54:20.912724 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-10-17 02:54:21.477047 | 
2026-10-17 02:54:21.477169 | PLAY [all]
2026-10-17 02:54:21.487777 | 
2026-10-17 02:54:21.487850 | TASK [fetch-output : Set log path for multiple nodes]
2026-10-17 02:54:21.532173 | instance | skipping: Conditional result was False
2026-10-17 02:54:21.537152 | 
2026-10-17 02:54:21.537225 | TASK [fetch-output : Set log path for single node]
2026-10-17 02:54:21.591461 | instance | ok
2026-10-17 02:54:21.600293 | 
2026-10-17 02:54:21.600401 | LOOP [fetch-output : Ensure local output dirs]
2026-10-17 02:54:21.988135 | instance -> localhost | ok: "/var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/work/logs"
2026-10-17 02:54:22.167396 | instance -> localhost | changed: "/var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/work/artifacts"
2026-10-17 02:54:22.380868 | instance -> localhost | changed: "/var/lib/zuul/builds/49e3ca2e1b72470abac6c5828ed44580/work/docs"
2026-10-17 02:54:22.397722 | 
2026-10-17 02:54:22.397910 | LOOP [fetch-output : Collect logs, artifacts and docs]
2026-10-17 02:54:23.088052 | instance | changed: .d..t...... ./
2026-10-17 02:54:23.088392 | instance | changed: All items complete
2026-10-17 02:54:23.088449 | 
2026-10-17 02:54:23.585844 | instance | changed: .d..t...... ./
2026-10-17 02:54:24.048702 | instance | changed: .d..t...... ./
2026-10-17 02:54:24.078746 | 
2026-10-17 02:54:24.079020 | LOOP [merge-output-to-logs : Move artifacts and docs to logs dir]
2026-10-17 02:54:24.524295 | instance -> localhost | ok: Item: artifacts Runtime: 0:00:00.007066
2026-10-17 02:54:24.796858 | instance -> localhost | ok: Item: docs Runtime: 0:00:00.006834
2026-10-17 02:54:24.822224 | 
2026-10-17 02:54:24.822421 | PLAY [all]
2026-10-17 02:54:24.834112 | 
2026-10-17 02:54:24.834245 | TASK [remove-build-sshkey : Remove the build SSH key from all nodes]
2026-10-17 02:54:25.266924 | instance | changed
2026-10-17 02:54:25.276867 | 
2026-10-17 02:54:25.276961 | PLAY RECAP
2026-10-17 02:54:25.277045 | instance | ok: 5 changed: 4 unreachable: 0 failed: 0 skipped: 1 rescued: 0 ignored: 0
2026-10-17 02:54:25.277088 | 
2026-10-17 02:54:25.484138 | POST-RUN END RESULT_NORMAL: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post.yaml@main]
2026-10-17 02:54:25.485321 | POST-RUN START: [trusted : github.com/vexxhost/zuul-config/playbooks/base/post-logs.yaml@main]
2026-10-17 02:54:26.035693 | 
2026-10-17 02:54:26.035909 | PLAY [localhost]
2026-10-17 02:54:26.045070 | 
2026-10-17 02:54:26.045139 | TASK [Generate Zuul manifest]
2026-10-17 02:54:26.063377 | localhost | ok
2026-10-17 02:54:26.076512 | 
2026-10-17 02:54:26.076584 | TASK [generate-zuul-manifest : Generate Zuul manifest]
2026-10-17 02:54:26.451019 | localhost | changed
2026-10-17 02:54:26.472325 | 
2026-10-17 02:54:26.472467 | TASK [generate-zuul-manifest : Return Zuul manifest URL to Zuul]
2026-10-17 02:54:26.514910 | localhost | ok
2026-10-17 02:54:26.527433 | 
2026-10-17 02:54:26.527554 | TASK [Upload logs]
2026-10-17 02:54:26.549814 | localhost | ok
2026-10-17 02:54:26.613201 | 
2026-10-17 02:54:26.613330 | TASK [Set zuul-log-path fact]
2026-10-17 02:54:26.631020 | localhost | ok
2026-10-17 02:54:26.640868 | 
2026-10-17 02:54:26.640930 | TASK [set-zuul-log-path-fact : Set log path for a build]
2026-10-17 02:54:26.678969 | localhost | ok
2026-10-17 02:54:26.687892 | 
2026-10-17 02:54:26.687972 | TASK [upload-logs : Create log directories]
2026-10-17 02:54:27.106483 | localhost | changed
2026-10-17 02:54:27.115990 | 
2026-10-17 02:54:27.116125 | TASK [upload-logs : Ensure logs are readable before uploading]
2026-10-17 02:54:27.586269 | localhost -> localhost | ok: Runtime: 0:00:00.003838
2026-10-17 02:54:27.596013 | 
2026-10-17 02:54:27.596147 | TASK [upload-logs : Upload logs to log server]
2026-10-17 02:54:28.196906 | localhost | Output suppressed because no_log was given
2026-10-17 02:54:28.204336 | 
2026-10-17 02:54:28.204467 | LOOP [upload-logs : Compress console log and json output]
2026-10-17 02:54:28.272078 | localhost | skipping: Conditional result was False
2026-10-17 02:54:28.323693 | localhost | skipping: Conditional result was False
2026-10-17 02:54:28.333243 | 
2026-10-17 02:54:28.333478 | LOOP [upload-logs : Upload compressed console log and json output]
2026-10-17 02:54:28.371035 | localhost | skipping: Conditional result was False
2026-10-17 02:54:28.371401 | 
2026-10-17 02:54:28.374713 | localhost | skipping: Conditional result was False
2026-10-17 02:54:28.386800 | 
2026-10-17 02:54:28.386984 | LOOP [upload-logs : Upload console log and json output]