+ exec nova-compute --config-file /etc/nova/nova.conf --config-file /tmp/pod-shared/nova-console.conf --config-file /tmp/pod-shared/nova-libvirt.conf --config-file /tmp/pod-shared/nova-compute-fqdn.conf --config-file /tmp/pod-shared/nova-hypervisor.conf 2026-07-29 14:43:44.014 259564 INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs 2026-07-29 14:43:44.513 259564 INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative 2026-07-29 14:43:45.521 259564 INFO nova.virt.driver [None req-7d9ef5e2-2978-4568-a6de-43ea1ca2dcd2 - - - - - -] Loading compute driver 'libvirt.LibvirtDriver' simplejson unavailable, fall-back to standard python json 2026-07-29 14:43:45.993 259564 INFO nova.compute.provider_config [None req-7d9ef5e2-2978-4568-a6de-43ea1ca2dcd2 - - - - - -] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. 2026-07-29 14:43:46.511 259564 WARNING oslo_config.cfg [None req-7d9ef5e2-2978-4568-a6de-43ea1ca2dcd2 - - - - - -] Deprecated: Option "api_servers" from group "glance" is deprecated for removal ( Support for image service configuration via standard keystoneauth1 Adapter options was added in the 17.0.0 Queens release. The api_servers option was retained temporarily to allow consumers time to cut over to a real load balancing solution. ). Its value may be silently ignored in the future. 2026-07-29 14:43:46.526 259564 INFO nova.service [-] Starting compute node (version 32.1.0) 2026-07-29 14:43:47.031 259564 INFO nova.utils [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] The default thread pool MainProcess.default is initialized 2026-07-29 14:43:47.046 259564 INFO nova.virt.libvirt.driver [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Connection event '1' reason 'None' 2026-07-29 14:43:47.550 259564 WARNING nova.virt.libvirt.driver [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Cannot update service status on host "instance" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host instance could not be found. 2026-07-29 14:43:48.579 259564 INFO nova.virt.libvirt.host [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Libvirt host capabilities e48cef89-6ef1-4489-85bf-307b47ead1a0 x86_64 EPYC-Rome AMD tcp rdma 65841436 16460359 0 0 none 0 dac 0 +42424:+107 +42424:+107 hvm 32 /usr/bin/qemu-system-i386 pc-i440fx-noble ubuntu pc-q35-mantic pc-i440fx-impish-hpb pc-q35-5.2 pc-q35-lunar-hpb pc-i440fx-mantic pc-i440fx-2.12 pc-i440fx-2.0 pc-i440fx-xenial pc-q35-kinetic pc-i440fx-6.2 pc-q35-4.2 pc-i440fx-mantic-maxcpus pc-i440fx-2.5 pc-i440fx-4.2 pc-i440fx-focal pc-i440fx-hirsute pc-q35-xenial pc-i440fx-jammy-hpb pc-i440fx-5.2 pc-q35-2.7 pc-q35-eoan-hpb pc-i440fx-disco-hpb pc-q35-groovy pc-i440fx-zesty pc-q35-lunar pc-q35-mantic-hpb-maxcpus pc-i440fx-groovy pc-q35-7.1 pc-q35-artful pc-i440fx-trusty pc-i440fx-2.2 pc-i440fx-eoan-hpb pc-q35-focal-hpb pc-q35-8.1 pc-q35-jammy-maxcpus pc-q35-bionic-hpb pc-q35-mantic-hpb pc-i440fx-artful pc-i440fx-8.1 pc-i440fx-2.7 pc-q35-6.1 pc-i440fx-kinetic pc-i440fx-jammy-maxcpus pc-i440fx-yakkety pc-q35-2.4 pc-q35-cosmic-hpb pc-i440fx-7.1 pc-q35-2.10 x-remote pc-q35-5.1 pc-q35-2.9 pc-i440fx-2.11 pc-i440fx-jammy-hpb-maxcpus pc-q35-3.1 pc-i440fx-6.1 pc-q35-4.1 pc-q35-jammy pc-i440fx-2.4 pc-i440fx-4.1 pc-q35-eoan pc-q35-jammy-hpb pc-i440fx-5.1 pc-i440fx-2.9 pc-i440fx-bionic-hpb pc-i440fx-lunar isapc pc-i440fx-mantic-hpb pc-q35-cosmic pc-q35-2.6 pc-q35-mantic-maxcpus pc-i440fx-3.1 pc-q35-bionic pc-q35-disco-hpb pc-i440fx-cosmic pc-q35-2.12 pc-i440fx-bionic pc-q35-kinetic-hpb pc-q35-groovy-hpb pc-q35-7.0 pc-i440fx-lunar-hpb pc-q35-disco pc-i440fx-cosmic-hpb pc-q35-noble ubuntu-q35 pc-i440fx-2.1 pc-q35-8.0 pc-q35-impish pc-i440fx-wily pc-i440fx-8.0 pc-i440fx-2.6 pc-q35-6.0 pc-i440fx-impish pc-i440fx-jammy pc-q35-impish-hpb pc-q35-hirsute pc-q35-4.0.1 pc-q35-hirsute-hpb pc-i440fx-7.0 pc-q35-5.0 pc-q35-2.8 pc-i440fx-2.10 pc-q35-3.0 pc-i440fx-6.0 pc-q35-zesty pc-q35-7.2 pc-q35-4.0 pc-q35-focal microvm pc-i440fx-2.3 pc-q35-jammy-hpb-maxcpus pc-q35-8.2 q35 pc-i440fx-kinetic-hpb pc-i440fx-focal-hpb pc-i440fx-4.0 pc-i440fx-disco pc-i440fx-groovy-hpb pc-i440fx-8.2 pc pc-i440fx-hirsute-hpb pc-i440fx-5.0 pc-q35-6.2 pc-i440fx-2.8 pc-i440fx-eoan pc-q35-2.5 pc-i440fx-3.0 pc-q35-yakkety pc-i440fx-mantic-hpb-maxcpus pc-i440fx-7.2 pc-q35-2.11 hvm 64 /usr/bin/qemu-system-x86_64 pc-i440fx-noble ubuntu pc-q35-mantic pc-i440fx-impish-hpb pc-q35-5.2 pc-q35-lunar-hpb pc-i440fx-mantic pc-i440fx-2.12 pc-i440fx-2.0 pc-i440fx-xenial pc-q35-kinetic pc-i440fx-6.2 pc-q35-4.2 pc-i440fx-mantic-maxcpus pc-i440fx-2.5 pc-i440fx-4.2 pc-i440fx-focal pc-i440fx-hirsute pc-q35-xenial pc-i440fx-jammy-hpb pc-i440fx-5.2 pc-q35-2.7 pc-q35-eoan-hpb pc-i440fx-zesty pc-q35-groovy pc-i440fx-disco-hpb pc-q35-lunar pc-q35-mantic-hpb-maxcpus pc-i440fx-groovy pc-q35-7.1 pc-q35-artful pc-i440fx-trusty pc-i440fx-2.2 pc-q35-focal-hpb pc-q35-8.1 pc-i440fx-eoan-hpb pc-q35-jammy-maxcpus pc-q35-bionic-hpb pc-q35-mantic-hpb pc-i440fx-artful pc-i440fx-8.1 pc-i440fx-2.7 pc-q35-6.1 pc-i440fx-kinetic pc-i440fx-jammy-maxcpus pc-i440fx-yakkety pc-q35-2.4 pc-q35-cosmic-hpb pc-i440fx-7.1 pc-q35-2.10 x-remote pc-q35-5.1 pc-q35-2.9 pc-i440fx-2.11 pc-i440fx-jammy-hpb-maxcpus pc-q35-3.1 pc-i440fx-6.1 pc-q35-4.1 pc-q35-jammy pc-i440fx-2.4 pc-i440fx-4.1 pc-q35-eoan pc-q35-jammy-hpb pc-i440fx-5.1 pc-i440fx-2.9 pc-i440fx-bionic-hpb pc-i440fx-lunar isapc pc-i440fx-mantic-hpb pc-q35-cosmic pc-q35-2.6 pc-q35-mantic-maxcpus pc-i440fx-3.1 pc-q35-bionic pc-q35-disco-hpb pc-i440fx-cosmic pc-q35-2.12 pc-i440fx-bionic pc-q35-kinetic-hpb pc-q35-groovy-hpb pc-q35-7.0 pc-i440fx-lunar-hpb pc-q35-disco pc-i440fx-cosmic-hpb pc-i440fx-2.1 pc-q35-noble ubuntu-q35 pc-q35-8.0 pc-i440fx-wily pc-q35-impish pc-i440fx-8.0 pc-i440fx-2.6 pc-q35-6.0 pc-i440fx-impish pc-i440fx-jammy pc-q35-impish-hpb pc-q35-hirsute pc-q35-4.0.1 pc-q35-hirsute-hpb pc-i440fx-7.0 pc-q35-5.0 pc-q35-2.8 pc-i440fx-2.10 pc-q35-3.0 pc-q35-zesty pc-q35-7.2 pc-q35-4.0 pc-i440fx-6.0 pc-q35-focal microvm pc-i440fx-2.3 pc-q35-jammy-hpb-maxcpus pc-i440fx-disco pc-i440fx-kinetic-hpb pc-i440fx-4.0 pc-i440fx-focal-hpb pc-q35-8.2 q35 pc-i440fx-groovy-hpb pc-i440fx-hirsute-hpb pc-i440fx-8.2 pc pc-i440fx-5.0 pc-i440fx-2.8 pc-q35-6.2 pc-i440fx-eoan pc-q35-2.5 pc-i440fx-3.0 pc-q35-yakkety pc-i440fx-mantic-hpb-maxcpus pc-i440fx-7.2 pc-q35-2.11 2026-07-29 14:43:48.642 259564 INFO nova.virt.libvirt.host [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Secure Boot support detected 2026-07-29 14:43:49.185 259564 INFO nova.virt.node [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Generated node identity 03ea6dea-c012-49fd-a59c-8163038fa893 2026-07-29 14:43:49.186 259564 INFO nova.virt.node [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Wrote node identity 03ea6dea-c012-49fd-a59c-8163038fa893 to /var/lib/nova/compute_id 2026-07-29 14:43:49.691 259564 WARNING nova.compute.manager [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Compute nodes ['03ea6dea-c012-49fd-a59c-8163038fa893'] for host instance were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. 2026-07-29 14:43:50.699 259564 INFO nova.compute.manager [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host 2026-07-29 14:43:51.707 259564 WARNING nova.compute.manager [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] No compute node record found for host instance. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host instance could not be found. 2026-07-29 14:43:52.260 259564 WARNING nova.virt.libvirt.driver [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:43:52.782 259564 WARNING nova.compute.resource_tracker [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] No compute node record for instance:03ea6dea-c012-49fd-a59c-8163038fa893: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 03ea6dea-c012-49fd-a59c-8163038fa893 could not be found. 2026-07-29 14:43:53.288 259564 INFO nova.compute.resource_tracker [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] Compute node record created for instance:instance with uuid: 03ea6dea-c012-49fd-a59c-8163038fa893 2026-07-29 14:43:55.355 259564 INFO nova.scheduler.client.report [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] [req-74117274-e1d5-4278-87a4-82d8aeb263aa] Created resource provider record via placement API for resource provider with UUID 03ea6dea-c012-49fd-a59c-8163038fa893 and name instance. 2026-07-29 14:43:55.381 259564 INFO nova.virt.libvirt.host [None req-35cccfcd-a7b5-4ebf-bc98-59f69677d7ed - - - - - -] kernel doesn't support AMD SEV 2026-07-29 14:44:45.522 259564 INFO nova.compute.manager [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] Running instance usage audit for host instance from 2026-07-29 13:00:00 to 2026-07-29 14:00:00. 0 instances. 2026-07-29 14:44:47.602 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:45:51.752 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:46:55.293 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:47:50.320 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:48:49.535 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:49:49.956 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:50:49.618 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:51:52.575 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:52:51.644 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:53:44.406 259564 WARNING oslo.service.backend._common.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 2.52 sec 2026-07-29 14:53:51.559 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:54:44.510 259564 WARNING nova.servicegroup.drivers.db [-] Lost connection to nova-conductor for reporting service status.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 2546956b7c554b5f892a4741fa0cbb46 2026-07-29 14:54:44.511 259564 WARNING oslo.service.backend._common.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 50.10 sec 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] Error updating resources for node instance.: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.InternalError) Packet sequence number wrong - got 1 expected 2 (Background on this error at: https://sqlalche.me/e/20/2j85) ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 681, in connect\n self._request_authentication()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 958, in _request_authentication\n auth_packet = self._read_packet()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 764, in _read_packet\n raise err.InternalError(\n', 'pymysql.err.InternalError: Packet sequence number wrong - got 1 expected 2\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n return getattr(target, method)(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n result = fn(cls, context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/instance.py", line 1456, in get_by_host_and_node\n db_inst_list = db.instance_get_all_by_host_and_node(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 224, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 2221, in instance_get_all_by_host_and_node\n ).filter_by(host=host).filter_by(node=node).all()\n ^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2704, in all\n return self._iter().all() # type: ignore\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2857, in _iter\n result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute\n return self._execute_internal(\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal\n conn = self._connection_for_bind(bind)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind\n return trans._connection_for_bind(engine, execution_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "", line 2, in _connection_for_bind\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/state_changes.py", line 137, in _go\n ret_value = fn(self, *arg, **kw)\n ^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 1187, in _connection_for_bind\n conn = bind.connect()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3277, in connect\n return self._connection_cls(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 145, in __init__\n Connection._handle_dbapi_exception_noconnection(\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2437, in _handle_dbapi_exception_noconnection\n raise newraise.with_traceback(exc_info[2]) from e\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 681, in connect\n self._request_authentication()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 958, in _request_authentication\n auth_packet = self._read_packet()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 764, in _read_packet\n raise err.InternalError(\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.InternalError) Packet sequence number wrong - got 1 expected 2\n(Background on this error at: https://sqlalche.me/e/20/2j85)\n']. 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager Traceback (most recent call last): 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/nova/compute/manager.py", line 11315, in _update_available_resource_for_node 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager self.rt.update_available_resource(context, nodename, 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/nova/compute/resource_tracker.py", line 965, in update_available_resource 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager self._update_available_resource(context, resources, startup=startup) 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/oslo_concurrency/lockutils.py", line 415, in inner 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager return f(*args, **kwargs) 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/nova/compute/resource_tracker.py", line 1018, in _update_available_resource 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager instances = objects.InstanceList.get_by_host_and_node( 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager result = cls.indirection_api.object_class_action_versions( 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager return cctxt.call(context, 'object_class_action_versions', 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 180, in call 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager result = self.transport._send( 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager return self._driver.send(target, ctxt, message, 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager return self._send(target, ctxt, message, wait_for_reply, timeout, 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager raise result 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.InternalError) Packet sequence number wrong - got 1 expected 2 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager (Background on this error at: https://sqlalche.me/e/20/2j85) 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 681, in connect\n self._request_authentication()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 958, in _request_authentication\n auth_packet = self._read_packet()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 764, in _read_packet\n raise err.InternalError(\n', 'pymysql.err.InternalError: Packet sequence number wrong - got 1 expected 2\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n return getattr(target, method)(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n result = fn(cls, context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/instance.py", line 1456, in get_by_host_and_node\n db_inst_list = db.instance_get_all_by_host_and_node(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 224, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 2221, in instance_get_all_by_host_and_node\n ).filter_by(host=host).filter_by(node=node).all()\n ^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2704, in all\n return self._iter().all() # type: ignore\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2857, in _iter\n result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute\n return self._execute_internal(\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal\n conn = self._connection_for_bind(bind)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind\n return trans._connection_for_bind(engine, execution_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "", line 2, in _connection_for_bind\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/state_changes.py", line 137, in _go\n ret_value = fn(self, *arg, **kw)\n ^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 1187, in _connection_for_bind\n conn = bind.connect()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3277, in connect\n return self._connection_cls(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 145, in __init__\n Connection._handle_dbapi_exception_noconnection(\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2437, in _handle_dbapi_exception_noconnection\n raise newraise.with_traceback(exc_info[2]) from e\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 681, in connect\n self._request_authentication()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 958, in _request_authentication\n auth_packet = self._read_packet()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 764, in _read_packet\n raise err.InternalError(\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.InternalError) Packet sequence number wrong - got 1 expected 2\n(Background on this error at: https://sqlalche.me/e/20/2j85)\n']. 2026-07-29 14:54:46.690 259564 ERROR nova.compute.manager 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] Error during ComputeManager._run_pending_deletes: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on 'percona-xtradb-haproxy.openstack.svc.cluster.local' (timed out)") (Background on this error at: https://sqlalche.me/e/20/e3q8) ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 661, in connect\n sock = socket.create_connection(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 63, in create_connection\n raise err\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 53, in create_connection\n sock.connect(sa)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 261, in connect\n self._trampoline(fd, write=True, timeout=timeout, timeout_exc=_timeout_exc)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 206, in _trampoline\n return trampoline(fd, read=read, write=write, timeout=timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/__init__.py", line 157, in trampoline\n return hub.switch()\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/hub.py", line 310, in switch\n return self.greenlet.switch()\n ^^^^^^^^^^^^^^^^^^^^^^\n', 'TimeoutError: timed out\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n return getattr(target, method)(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n result = fn(cls, context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/instance.py", line 1427, in get_by_filters\n db_inst_list = cls._get_by_filters_impl(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 179, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/instance.py", line 1417, in _get_by_filters_impl\n db_inst_list = db.instance_get_all_by_filters(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/utils.py", line 35, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 241, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 1601, in instance_get_all_by_filters\n return instance_get_all_by_filters_sort(context, filters, limit=limit,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/utils.py", line 35, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 241, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 1860, in instance_get_all_by_filters_sort\n instances = query_prefix.all()\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2704, in all\n return self._iter().all() # type: ignore\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2857, in _iter\n result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute\n return self._execute_internal(\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal\n conn = self._connection_for_bind(bind)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind\n return trans._connection_for_bind(engine, execution_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "", line 2, in _connection_for_bind\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/state_changes.py", line 137, in _go\n ret_value = fn(self, *arg, **kw)\n ^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 1187, in _connection_for_bind\n conn = bind.connect()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3277, in connect\n return self._connection_cls(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 145, in __init__\n Connection._handle_dbapi_exception_noconnection(\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2437, in _handle_dbapi_exception_noconnection\n raise newraise.with_traceback(exc_info[2]) from e\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n']. 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task Traceback (most recent call last): 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task task(self, context) 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/nova/compute/manager.py", line 11967, in _run_pending_deletes 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task instances = objects.InstanceList.get_by_filters( 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions( 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions', 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 180, in call 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task result = self.transport._send( 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message, 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout, 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task raise result 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on 'percona-xtradb-haproxy.openstack.svc.cluster.local' (timed out)") 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task (Background on this error at: https://sqlalche.me/e/20/e3q8) 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 661, in connect\n sock = socket.create_connection(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 63, in create_connection\n raise err\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 53, in create_connection\n sock.connect(sa)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 261, in connect\n self._trampoline(fd, write=True, timeout=timeout, timeout_exc=_timeout_exc)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 206, in _trampoline\n return trampoline(fd, read=read, write=write, timeout=timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/__init__.py", line 157, in trampoline\n return hub.switch()\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/hub.py", line 310, in switch\n return self.greenlet.switch()\n ^^^^^^^^^^^^^^^^^^^^^^\n', 'TimeoutError: timed out\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n return getattr(target, method)(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n result = fn(cls, context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/instance.py", line 1427, in get_by_filters\n db_inst_list = cls._get_by_filters_impl(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 179, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/instance.py", line 1417, in _get_by_filters_impl\n db_inst_list = db.instance_get_all_by_filters(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/utils.py", line 35, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 241, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 1601, in instance_get_all_by_filters\n return instance_get_all_by_filters_sort(context, filters, limit=limit,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/utils.py", line 35, in wrapper\n return f(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 241, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 1860, in instance_get_all_by_filters_sort\n instances = query_prefix.all()\n ^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2704, in all\n return self._iter().all() # type: ignore\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2857, in _iter\n result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute\n return self._execute_internal(\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal\n conn = self._connection_for_bind(bind)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind\n return trans._connection_for_bind(engine, execution_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "", line 2, in _connection_for_bind\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/state_changes.py", line 137, in _go\n ret_value = fn(self, *arg, **kw)\n ^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 1187, in _connection_for_bind\n conn = bind.connect()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3277, in connect\n return self._connection_cls(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 145, in __init__\n Connection._handle_dbapi_exception_noconnection(\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2437, in _handle_dbapi_exception_noconnection\n raise newraise.with_traceback(exc_info[2]) from e\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n']. 2026-07-29 14:54:57.223 259564 ERROR oslo_service.periodic_task 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] Error during ComputeManager._cleanup_incomplete_migrations: oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on 'percona-xtradb-haproxy.openstack.svc.cluster.local' (timed out)") (Background on this error at: https://sqlalche.me/e/20/e3q8) ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 661, in connect\n sock = socket.create_connection(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 63, in create_connection\n raise err\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 53, in create_connection\n sock.connect(sa)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 261, in connect\n self._trampoline(fd, write=True, timeout=timeout, timeout_exc=_timeout_exc)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 206, in _trampoline\n return trampoline(fd, read=read, write=write, timeout=timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/__init__.py", line 157, in trampoline\n return hub.switch()\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/hub.py", line 310, in switch\n return self.greenlet.switch()\n ^^^^^^^^^^^^^^^^^^^^^^\n', 'TimeoutError: timed out\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n return getattr(target, method)(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n result = fn(cls, context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/migration.py", line 314, in get_by_filters\n db_migrations = db.migration_get_all_by_filters(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 224, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 3475, in migration_get_all_by_filters\n return query.all()\n ^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2704, in all\n return self._iter().all() # type: ignore\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2857, in _iter\n result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute\n return self._execute_internal(\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal\n conn = self._connection_for_bind(bind)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind\n return trans._connection_for_bind(engine, execution_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "", line 2, in _connection_for_bind\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/state_changes.py", line 137, in _go\n ret_value = fn(self, *arg, **kw)\n ^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 1187, in _connection_for_bind\n conn = bind.connect()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3277, in connect\n return self._connection_cls(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 145, in __init__\n Connection._handle_dbapi_exception_noconnection(\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2437, in _handle_dbapi_exception_noconnection\n raise newraise.with_traceback(exc_info[2]) from e\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n']. 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task Traceback (most recent call last): 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task task(self, context) 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/nova/compute/manager.py", line 12001, in _cleanup_incomplete_migrations 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task migrations = objects.MigrationList.get_by_filters(context, 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task result = cls.indirection_api.object_class_action_versions( 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/rpcapi.py", line 240, in object_class_action_versions 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task return cctxt.call(context, 'object_class_action_versions', 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 180, in call 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task result = self.transport._send( 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task return self._driver.send(target, ctxt, message, 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task return self._send(target, ctxt, message, wait_for_reply, timeout, 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task File "/var/lib/openstack/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 792, in _send 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task raise result 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on 'percona-xtradb-haproxy.openstack.svc.cluster.local' (timed out)") 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task (Background on this error at: https://sqlalche.me/e/20/e3q8) 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task ['Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 661, in connect\n sock = socket.create_connection(\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 63, in create_connection\n raise err\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/green/socket.py", line 53, in create_connection\n sock.connect(sa)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 261, in connect\n self._trampoline(fd, write=True, timeout=timeout, timeout_exc=_timeout_exc)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/greenio/base.py", line 206, in _trampoline\n return trampoline(fd, read=read, write=write, timeout=timeout,\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/__init__.py", line 157, in trampoline\n return hub.switch()\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/eventlet/hubs/hub.py", line 310, in switch\n return self.greenlet.switch()\n ^^^^^^^^^^^^^^^^^^^^^^\n', 'TimeoutError: timed out\n', '\nDuring handling of the above exception, another exception occurred:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'pymysql.err.OperationalError: (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n', '\nThe above exception was the direct cause of the following exception:\n\n', 'Traceback (most recent call last):\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/conductor/manager.py", line 142, in _object_dispatch\n return getattr(target, method)(*args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/oslo_versionedobjects/base.py", line 184, in wrapper\n result = fn(cls, context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/objects/migration.py", line 314, in get_by_filters\n db_migrations = db.migration_get_all_by_filters(\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 224, in wrapper\n return f(context, *args, **kwargs)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/nova/db/main/api.py", line 3475, in migration_get_all_by_filters\n return query.all()\n ^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2704, in all\n return self._iter().all() # type: ignore\n ^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/query.py", line 2857, in _iter\n result: Union[ScalarResult[_T], Result[_T]] = self.session.execute(\n ^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2351, in execute\n return self._execute_internal(\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2239, in _execute_internal\n conn = self._connection_for_bind(bind)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 2108, in _connection_for_bind\n return trans._connection_for_bind(engine, execution_options)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "", line 2, in _connection_for_bind\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/state_changes.py", line 137, in _go\n ret_value = fn(self, *arg, **kw)\n ^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/orm/session.py", line 1187, in _connection_for_bind\n conn = bind.connect()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3277, in connect\n return self._connection_cls(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 145, in __init__\n Connection._handle_dbapi_exception_noconnection(\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2437, in _handle_dbapi_exception_noconnection\n raise newraise.with_traceback(exc_info[2]) from e\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 143, in __init__\n self._dbapi_connection = engine.raw_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 3301, in raw_connection\n return self.pool.connect()\n ^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 447, in connect\n return _ConnectionFairy._checkout(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 1264, in _checkout\n fairy = _ConnectionRecord.checkout(pool)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 711, in checkout\n rec = pool._do_get()\n ^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 177, in _do_get\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/impl.py", line 175, in _do_get\n return self._create_connection()\n ^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 388, in _create_connection\n return _ConnectionRecord(self)\n ^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 673, in __init__\n self.__connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 899, in __connect\n with util.safe_reraise():\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/util/langhelpers.py", line 224, in __exit__\n raise exc_value.with_traceback(exc_tb)\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/pool/base.py", line 895, in __connect\n self.dbapi_connection = connection = pool._invoke_creator(self)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/create.py", line 661, in connect\n return dialect.connect(*cargs, **cparams)\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 629, in connect\n return self.loaded_dbapi.connect(*cargs, **cparams) # type: ignore[no-any-return] # NOQA: E501\n ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 365, in __init__\n self.connect()\n', ' File "/var/lib/openstack/lib/python3.12/site-packages/pymysql/connections.py", line 723, in connect\n raise exc\n', 'oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2003, "Can\'t connect to MySQL server on \'percona-xtradb-haproxy.openstack.svc.cluster.local\' (timed out)")\n(Background on this error at: https://sqlalche.me/e/20/e3q8)\n']. 2026-07-29 14:55:07.748 259564 ERROR oslo_service.periodic_task 2026-07-29 14:55:20.177 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:55:32.161 259564 INFO oslo_messaging._drivers.amqpdriver [-] No calling threads waiting for msg_id : 2546956b7c554b5f892a4741fa0cbb46 2026-07-29 14:55:40.614 259564 INFO nova.servicegroup.drivers.db [-] Recovered from being unable to report status. 2026-07-29 14:55:40.615 259564 WARNING oslo.service.backend._common.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 46.10 sec 2026-07-29 14:56:24.583 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:57:29.812 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:58:09.843 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 14:58:58.132 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:00:00.140 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:00:59.526 259564 INFO nova.compute.manager [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] Running instance usage audit for host instance from 2026-07-29 14:00:00 to 2026-07-29 15:00:00. 0 instances. 2026-07-29 15:01:02.254 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:02:02.654 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:03:04.669 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:03:50.274 259564 WARNING oslo.service.backend._common.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 9.53 sec 2026-07-29 15:04:05.246 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:04:21.299 259564 WARNING oslo.service.backend._common.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 1.02 sec 2026-07-29 15:05:06.601 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:05:13.833 259564 WARNING oslo.service.backend._common.loopingcall [-] Function 'nova.servicegroup.drivers.db.DbDriver._report_state' run outlasted interval by 2.53 sec 2026-07-29 15:06:10.919 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:07:14.951 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:08:17.584 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:09:10.264 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:10:11.745 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:11:12.695 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:12:13.799 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:13:14.687 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:14:15.200 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:15:14.808 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. 2026-07-29 15:16:16.724 259564 WARNING nova.virt.libvirt.driver [None req-f1e797b7-b91f-4f35-abec-1f35c4da03c7 - - - - - -] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.