May 22 00:59:44.521413 np0000176108 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service. May 22 00:59:46.021912 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.common.config [-] Logging enabled! May 22 00:59:46.021912 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.1.0.dev264 May 22 00:59:46.022745 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=104775) setup_logging /opt/stack/neutron/neutron/common/config.py:125}} May 22 00:59:46.022745 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting... May 22 00:59:46.023363 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=104775) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 22 00:59:46.023363 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=104775) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 22 00:59:46.023363 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=104775) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 22 00:59:46.023363 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=104775) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 22 00:59:46.023363 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=104775) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 22 00:59:46.023363 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [-] Loading core plugin: ml2 May 22 00:59:46.298645 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.298645 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.298645 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.298645 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.298645 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.298967 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.421429 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.421565 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.421565 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.428107 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.428225 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.428225 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.481393 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.481513 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.481513 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.484103 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.484165 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.484204 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.534197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.534197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.534512 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.534512 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.534631 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.585624 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.585753 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.585753 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.585896 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.585896 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586045 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586045 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586170 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586170 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586293 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586293 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586293 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586520 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586520 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586520 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586759 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586759 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586759 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.586759 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.587095 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.587095 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.587095 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.587095 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.587095 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.587457 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:46.587457 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:46.587588 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:46.587588 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:46.587588 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:46.587795 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:46.587908 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve'] May 22 00:59:46.588553 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public'] May 22 00:59:46.589143 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 22 00:59:46.589675 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]}) May 22 00:59:46.589675 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan'] May 22 00:59:46.589833 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan']) May 22 00:59:46.589932 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Project network_types: ['geneve'] May 22 00:59:46.590053 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos'] May 22 00:59:46.590565 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos'] May 22 00:59:46.590650 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos'] May 22 00:59:46.590710 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn'] May 22 00:59:46.627459 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn'] May 22 00:59:46.627553 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn'] May 22 00:59:46.627553 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling. May 22 00:59:46.628310 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.628422 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:46.651314 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 22 00:59:46.651314 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 22 00:59:46.651510 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 22 00:59:46.651510 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)] May 22 00:59:46.694523 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO dbcounter [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Registered counter for database neutron May 22 00:59:46.704518 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_db.sqlalchemy.engines [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104775) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} May 22 00:59:47.118439 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG dbcounter [-] [104775] Writer thread running {{(pid=104775) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} May 22 00:59:47.305915 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Initializing driver for type 'local' May 22 00:59:47.306109 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Initializing driver for type 'vlan' May 22 00:59:47.427180 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] VlanTypeDriver initialization complete May 22 00:59:47.427332 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Initializing extension driver 'port_security' May 22 00:59:47.427406 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.extensions.port_security [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] PortSecurityExtensionDriver initialization complete May 22 00:59:47.427452 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Initializing extension driver 'qos' May 22 00:59:47.427591 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.plugins.ml2.extensions.qos [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QosExtensionDriver initialization complete {{(pid=104775) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}} May 22 00:59:47.427665 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Initializing mechanism driver 'ovn' May 22 00:59:47.427768 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Starting OVNMechanismDriver May 22 00:59:47.429874 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > process before_spawn 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430018 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > process after_init 55550000, True {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430141 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > segment after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430233 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > segment after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430322 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > segment after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430432 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > allowed_address_pair before_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430531 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430647 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430748 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430836 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group precommit_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.430992 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431089 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group_rule precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431189 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group_rule after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431289 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group_rule before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431375 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > address_group after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431470 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > address_group after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431565 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > address_group after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.431795 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > qos_plugin after_init 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.432022 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > trunk_plugin after_init 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.432253 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > logging-plugin after_init 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.432799 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.services.logapi.drivers.ovn.driver [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVN logging driver registered May 22 00:59:47.434346 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.plugins.ml2.plugin [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=104775) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}} May 22 00:59:47.434632 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > port after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.434772 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > port after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.434941 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > port after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.434941 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > subnet after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435125 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > subnet after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435125 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > subnet after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435279 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > network after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435279 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > network after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435442 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > network after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435442 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435596 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435695 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435784 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group_rule after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435901 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group_rule after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.435901 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > security_group_rule after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.436086 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > address_group after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.436086 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > address_group after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.436234 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > address_group after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.436234 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ML2 OVO RPC backend initialized. {{(pid=104775) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}} May 22 00:59:47.437231 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.quota [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded quota_driver: . May 22 00:59:47.437341 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.plugin [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Modular L2 Plugin initialization complete May 22 00:59:47.437440 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading services supported by the core plugin {{(pid=104775) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:170}} May 22 00:59:47.437525 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.plugins.ml2.managers [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Got port-security extension from driver 'port_security' May 22 00:59:47.437851 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=104775) _load_service_plugins /opt/stack/neutron/neutron/manager.py:195}} May 22 00:59:47.437966 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: ovn-router May 22 00:59:47.448922 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449165 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: port before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449279 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: port after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449400 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > port precommit_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449546 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: port before_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449635 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: port before_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449783 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.449892 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.450010 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.450126 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: subnet after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.450405 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Tracking information for resource: router configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:47.450496 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.quota.resource_registry [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Tracking information for resource: floatingip configured {{(pid=104775) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} May 22 00:59:47.450582 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.services.ovn_l3.plugin [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Starting OVNL3RouterPlugin May 22 00:59:47.450922 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > port_forwarding_plugin after_init 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.451153 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router before_create 55550100, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.451277 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_delete 55550100, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.451399 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_create 55550100, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.451519 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_update 55550100, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.455307 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.services.provider_configuration [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Service providers = [] {{(pid=104775) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:170}} May 22 00:59:47.455442 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.db.servicetype_db [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=104775) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:45}} May 22 00:59:47.457188 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_create 55549900, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.457300 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router_interface after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.457456 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > floatingip after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.457574 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > floatingip precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.457736 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > floatingip precommit_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.457822 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > floatingip after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.457987 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > floatingip after_status_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458120 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > floatingip after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458246 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > port_forwarding after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458378 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router_interface after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458473 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router after_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458607 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458743 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router after_delete 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.458920 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > router after_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.459163 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.services.service_base [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=104775) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 22 00:59:47.459300 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: > process after_init 55550001, True {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.459489 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.459595 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: auto_allocate May 22 00:59:47.460839 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: network precommit_update 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.460984 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron_lib.callbacks.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Subscribe: network precommit_create 55550000, False {{(pid=104775) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.461261 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.461375 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: tag May 22 00:59:47.464849 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.464970 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: timestamp May 22 00:59:47.466549 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.466665 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: network_ip_availability May 22 00:59:47.468642 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.468726 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: flavors May 22 00:59:47.469908 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.470048 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading Plugin: revisions May 22 00:59:47.471267 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.manager [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=104775) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:239}} May 22 00:59:47.471441 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_concurrency.lockutils [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.448s {{(pid=104775) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 22 00:59:47.471739 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=104775) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} May 22 00:59:47.471877 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Initializing extension manager. May 22 00:59:47.472215 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: __init__.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.472344 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: __pycache__ {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.472451 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: aap_reject_multicast.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.472765 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Allowed address pairs reject multicast extension" alias="aap-reject-multicast" description="Reject multicast addresses in Allowed Address Pairs" updated="2026-04-01T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.473126 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension aap-reject-multicast not supported by any of loaded plugins May 22 00:59:47.473230 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: address_group.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.473616 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.473839 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: address-group May 22 00:59:47.473984 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: address_scope.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.474325 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.474531 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: address-scope May 22 00:59:47.474628 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: admin_state_down_before_update.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.474949 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.475183 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins May 22 00:59:47.475268 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: agent.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.475639 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.475878 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: agent May 22 00:59:47.476145 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: agent_resources_synced.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.476259 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.476474 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension agent-resources-synced not supported by any of loaded plugins May 22 00:59:47.476555 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: agent_sort_key.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.476828 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Agents Sort Key" alias="agent_sort_key" description="Enabling the keyword sort_key for sorting in agents." updated="2013-02-03T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.477031 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension agent_sort_key not supported by any of loaded plugins May 22 00:59:47.477115 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: allowedaddresspairs.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.477912 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.478135 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: allowed-address-pairs May 22 00:59:47.478229 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: auto_allocated_topology.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.478519 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.478729 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: auto-allocated-topology May 22 00:59:47.478819 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: availability_zone.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.479289 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.479485 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: availability_zone May 22 00:59:47.479575 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: availability_zone_filter.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.479851 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.480072 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension availability_zone_filter not supported by any of loaded plugins May 22 00:59:47.480156 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: data_plane_status.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.480440 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.480649 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension data-plane-status not supported by any of loaded plugins May 22 00:59:47.480767 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: default_subnetpools.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.481038 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.481238 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: default-subnetpools May 22 00:59:47.481342 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: dhcpagentscheduler.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.481793 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.482011 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: dhcp_agent_scheduler May 22 00:59:47.482104 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: dns.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.482363 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.482574 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: dns-integration May 22 00:59:47.482662 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: dns_domain_ports.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.482978 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.483184 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: dns-domain-ports May 22 00:59:47.483304 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.483574 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.483780 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: dns-integration-domain-keywords May 22 00:59:47.483903 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: dvr.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.484207 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.484410 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension dvr not supported by any of loaded plugins May 22 00:59:47.484529 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: ecmp_routes.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.484782 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.485014 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension ecmp_routes not supported by any of loaded plugins May 22 00:59:47.485116 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: empty_string_filtering.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.485389 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.485596 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: empty-string-filtering May 22 00:59:47.485717 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: evpn.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.486020 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="EVPN" alias="evpn" description="Router extension to support EVPN Type-5 route advertisement" updated="2026-04-28T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.486230 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension evpn not supported by any of loaded plugins May 22 00:59:47.486354 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.486618 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.486814 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 22 00:59:47.486996 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.487262 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.487450 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 22 00:59:47.487553 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: external_net.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.487791 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.487988 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: external-net May 22 00:59:47.488080 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: extra_dhcp_opt.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.488302 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.488477 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: extra_dhcp_opt May 22 00:59:47.488566 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: extraroute.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.488790 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.489002 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: extraroute May 22 00:59:47.489105 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: extraroute_atomic.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.489378 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.489564 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: extraroute-atomic May 22 00:59:47.489678 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: filter_validation.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.489998 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.490203 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: filter-validation May 22 00:59:47.490300 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: fip_pf_description.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.490567 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.491079 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 22 00:59:47.491205 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: fip_pf_detail.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.491480 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.491698 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: floating-ip-port-forwarding-detail May 22 00:59:47.491813 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: fip_pf_port_range.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.492099 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.492306 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins May 22 00:59:47.492429 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: fip_port_details.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.492688 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.492914 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: fip-port-details May 22 00:59:47.493036 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: flavors.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.493349 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.493561 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: flavors May 22 00:59:47.493647 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.494101 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.494293 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 22 00:59:47.494399 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: floatingip_pools.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.494724 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.494977 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: floatingip-pools May 22 00:59:47.495071 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: ip_allocation.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.495333 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.495535 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension ip_allocation not supported by any of loaded plugins May 22 00:59:47.495646 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: ip_substring_port_filtering.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.495939 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.496141 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension ip-substring-filtering not supported by any of loaded plugins May 22 00:59:47.496249 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l2_adjacency.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.496520 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.496707 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension l2_adjacency not supported by any of loaded plugins May 22 00:59:47.496823 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.497419 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.497645 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: router May 22 00:59:47.497736 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_conntrack_helper.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.498565 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.498745 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 22 00:59:47.498825 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.499197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.499412 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: enable-default-route-bfd May 22 00:59:47.499521 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.499806 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.500025 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: enable-default-route-ecmp May 22 00:59:47.500136 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_ext_gw_mode.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.500409 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.500611 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: ext-gw-mode May 22 00:59:47.500722 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_ext_ha_mode.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.501006 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.501196 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: l3-ha May 22 00:59:47.501308 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.501553 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.501741 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins May 22 00:59:47.501847 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_extra_gws.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.502129 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.502325 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: external-gateway-multihoming May 22 00:59:47.502439 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_flavors.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.502706 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.502945 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: l3-flavors May 22 00:59:47.503057 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_ndp_proxy.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.503422 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.503622 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension l3-ndp-proxy not supported by any of loaded plugins May 22 00:59:47.503702 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.504021 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.504216 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins May 22 00:59:47.504322 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: l3agentscheduler.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.505050 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.505248 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension l3_agent_scheduler not supported by any of loaded plugins May 22 00:59:47.505365 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: local_ip.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.505755 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.505988 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension local_ip not supported by any of loaded plugins May 22 00:59:47.506099 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: logging.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.506463 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.506675 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension logging not supported by any of loaded plugins May 22 00:59:47.506756 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: metering.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.507457 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.507677 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension metering not supported by any of loaded plugins May 22 00:59:47.507786 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.508120 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.508326 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins May 22 00:59:47.508433 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: multiprovidernet.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.508702 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.508934 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: multi-provider May 22 00:59:47.509045 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: netmtu.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.509321 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.509529 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: net-mtu May 22 00:59:47.509642 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: netmtu_writable.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.509935 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.510117 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: net-mtu-writable May 22 00:59:47.510219 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: network_availability_zone.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.510514 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.510713 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: network_availability_zone May 22 00:59:47.510824 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: network_ha.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.511150 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.511354 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension network_ha not supported by any of loaded plugins May 22 00:59:47.511469 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: network_ip_availability.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.511806 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.512099 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: network-ip-availability May 22 00:59:47.512209 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: network_ip_availability_details.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.512507 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.512716 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: network-ip-availability-details May 22 00:59:47.512824 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: network_segment_range.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.513221 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.513431 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension network-segment-range not supported by any of loaded plugins May 22 00:59:47.513536 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: pagination.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.513825 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.513956 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: pagination May 22 00:59:47.514084 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_device_profile.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.514353 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.514563 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: port-device-profile May 22 00:59:47.514674 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_hardware_offload_type.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.515024 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.515229 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-hardware-offload-type not supported by any of loaded plugins May 22 00:59:47.515343 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.515617 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.515814 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins May 22 00:59:47.515959 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_hints.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.516228 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.516432 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-hints not supported by any of loaded plugins May 22 00:59:47.516545 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_mac_address_override.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.516815 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.517034 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-mac-override not supported by any of loaded plugins May 22 00:59:47.517141 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_mac_address_regenerate.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.517407 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.517608 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: port-mac-address-regenerate May 22 00:59:47.517713 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_numa_affinity_policy.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.517982 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.518177 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: port-numa-affinity-policy May 22 00:59:47.518285 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.518553 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.518762 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: port-numa-affinity-policy-socket May 22 00:59:47.518880 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_resource_request.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.519189 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.519366 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-resource-request not supported by any of loaded plugins May 22 00:59:47.519461 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_resource_request_groups.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.519716 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.519924 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-resource-request-groups not supported by any of loaded plugins May 22 00:59:47.520032 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: port_trusted_vif.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.520301 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.520499 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-trusted-vif not supported by any of loaded plugins May 22 00:59:47.520615 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: portbindings.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.520874 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.521089 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: binding May 22 00:59:47.521197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: portbindings_extended.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.521518 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.521711 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: binding-extended May 22 00:59:47.521902 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: portsecurity.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.522111 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.522306 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: port-security May 22 00:59:47.522377 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: project_id.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.522650 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.522724 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: project-id May 22 00:59:47.522852 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: providernet.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.523188 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.523410 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: provider May 22 00:59:47.523502 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qinq.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.523829 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x88a8 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.524057 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: qinq May 22 00:59:47.524174 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.525488 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.525700 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos not supported by any of loaded plugins May 22 00:59:47.525824 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_bw_limit_direction.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.526192 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.526398 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 22 00:59:47.526516 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.526800 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.527062 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 22 00:59:47.527154 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_default.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.527433 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.527652 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-default not supported by any of loaded plugins May 22 00:59:47.527775 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_fip.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.528077 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.528278 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-fip not supported by any of loaded plugins May 22 00:59:47.528389 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_fip_network_policy.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.528660 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.528901 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-fip-network-policy not supported by any of loaded plugins May 22 00:59:47.529006 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_gateway_ip.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.529285 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.529478 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-gateway-ip not supported by any of loaded plugins May 22 00:59:47.529591 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_port_network_policy.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.529875 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.530076 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-port-network-policy not supported by any of loaded plugins May 22 00:59:47.530188 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.530480 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.530685 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-pps-minimum not supported by any of loaded plugins May 22 00:59:47.530799 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.531158 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.531359 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins May 22 00:59:47.531470 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_pps_rule.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.531765 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.531988 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-pps not supported by any of loaded plugins May 22 00:59:47.532096 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_rule_type_details.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.532387 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.532566 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-rule-type-details not supported by any of loaded plugins May 22 00:59:47.532682 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_rule_type_filter.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.532968 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.533222 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-rule-type-filter not supported by any of loaded plugins May 22 00:59:47.533293 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: qos_rules_alias.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.533564 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.533753 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension qos-rules-alias not supported by any of loaded plugins May 22 00:59:47.533874 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: quota_check_limit.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.534160 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.534358 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: quota-check-limit May 22 00:59:47.534459 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: quota_check_limit_default.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.534725 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.535010 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: quota-check-limit-default May 22 00:59:47.535123 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: quotasv2.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.536029 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.536163 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: quotas May 22 00:59:47.536277 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: quotasv2_detail.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.537003 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.537107 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: quota_details May 22 00:59:47.537231 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: rbac.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.537846 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control project access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.538092 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: rbac-policies May 22 00:59:47.538207 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: rbac_address_group.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.538482 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.538690 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension rbac-address-group not supported by any of loaded plugins May 22 00:59:47.538789 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: rbac_address_scope.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.539136 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.539347 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: rbac-address-scope May 22 00:59:47.539460 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: rbac_security_groups.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.539739 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.539965 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: rbac-security-groups May 22 00:59:47.540064 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: rbac_subnetpool.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.540337 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.540537 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension rbac-subnetpool not supported by any of loaded plugins May 22 00:59:47.540649 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: revisionifmatch.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.540929 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.541147 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: revision-if-match May 22 00:59:47.541251 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: revisions.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.541551 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.541755 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: standard-attr-revisions May 22 00:59:47.541873 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: router_availability_zone.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.542186 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.542398 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: router_availability_zone May 22 00:59:47.542497 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: router_enable_snat.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.542777 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.543028 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: router-enable-snat May 22 00:59:47.543140 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: routerservicetype.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.543399 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.543617 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension router-service-type not supported by any of loaded plugins May 22 00:59:47.543720 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: security_groups_default_rules.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.544255 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.544466 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: security-groups-default-rules May 22 00:59:47.544577 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.544851 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.545094 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: security-groups-normalized-cidr May 22 00:59:47.545206 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: security_groups_port_filtering.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.545485 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.545690 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension port-security-groups-filtering not supported by any of loaded plugins May 22 00:59:47.545813 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: security_groups_remote_address_group.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.546085 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.546283 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: security-groups-remote-address-group May 22 00:59:47.546397 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.546673 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.546873 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: security-groups-rules-belongs-to-default-sg May 22 00:59:47.547074 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: security_groups_shared_filtering.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.547342 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.547538 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: security-groups-shared-filtering May 22 00:59:47.547646 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: securitygroup.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.549935 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.550160 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: security-group May 22 00:59:47.550261 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: segment.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.550642 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.550874 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension segment not supported by any of loaded plugins May 22 00:59:47.551034 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.551293 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.551477 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 22 00:59:47.551573 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: servicetype.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.551870 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.552062 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: service-type May 22 00:59:47.552157 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: sorting.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.552406 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.552496 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: sorting May 22 00:59:47.552621 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: standard_attr_segment.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.552841 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.553021 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension standard-attr-segment not supported by any of loaded plugins May 22 00:59:47.553114 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: standardattrdescription.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.553389 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.553560 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: standard-attr-description May 22 00:59:47.553652 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: stateful_security_group.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.553903 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.554081 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: stateful-security-group May 22 00:59:47.554176 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: stdattrs_common.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.554397 np0000176108 neutron-ovn-maintenance-worker[104775]: WARNING neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 22 00:59:47.554488 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.554712 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.554909 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: subnet-dns-publish-fixed-ip May 22 00:59:47.555053 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnet_external_network.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.555457 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.555457 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: subnet-external-network May 22 00:59:47.555541 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnet_onboard.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.555788 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.556032 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension subnet_onboard not supported by any of loaded plugins May 22 00:59:47.556082 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnet_segmentid_writable.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.556300 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.556642 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 22 00:59:47.556792 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnet_service_types.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.557176 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.557359 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: subnet-service-types May 22 00:59:47.557442 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnetallocation.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.557956 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.558146 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: subnet_allocation May 22 00:59:47.558230 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.558516 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.558700 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: subnetpool-prefix-ops May 22 00:59:47.558781 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: tag_creation.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.559073 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.559237 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: tag-creation May 22 00:59:47.559381 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.559601 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.559748 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 22 00:59:47.559840 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: tagging.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.560881 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.561126 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: standard-attr-tag May 22 00:59:47.561197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: timestamp.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.561428 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.561606 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: standard-attr-timestamp May 22 00:59:47.561712 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: trunk.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.562001 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.562200 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension trunk not supported by any of loaded plugins May 22 00:59:47.562312 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: trunk_details.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.562583 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.562773 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension trunk-details not supported by any of loaded plugins May 22 00:59:47.562910 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: uplink_status_propagation.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.563245 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.563440 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension uplink-status-propagation not supported by any of loaded plugins May 22 00:59:47.563540 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.563790 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.564002 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins May 22 00:59:47.564097 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loading extension file: vlantransparent.py {{(pid=104775) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} May 22 00:59:47.564403 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=104775) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} May 22 00:59:47.564606 np0000176108 neutron-ovn-maintenance-worker[104775]: INFO neutron.api.extensions [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Loaded extension: vlan-transparent May 22 00:59:47.568407 np0000176108 neutron-ovn-maintenance-worker[104775]: WARNING oslo_service.backend._threading.service [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Service MaintenanceWorker is not picklable with spawn; falling back to fork. Please make the service spawn-safe to avoid this fallback. May 22 00:59:47.568895 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Full set of CONF: {{(pid=104775) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}} May 22 00:59:47.569022 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ******************************************************************************** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} May 22 00:59:47.569133 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Configuration options gathered from: {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3230}} May 22 00:59:47.569233 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3231}} May 22 00:59:47.569400 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3232}} May 22 00:59:47.569498 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ================================================================================ {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3237}} May 22 00:59:47.569691 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] agent_down_time = 75 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.569826 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] allow_automatic_dhcp_failover = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.569987 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] allow_bulk = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.570261 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.570401 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] api_extensions_path = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.570538 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] api_paste_config = api-paste.ini {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.570682 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] api_workers = 4 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.570802 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] auth_strategy = keystone {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.570989 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] base_mac = fa:16:3e:00:00:00 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571145 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] bind_host = 0.0.0.0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571252 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] bind_port = 9696 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571358 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] client_socket_timeout = 900 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571474 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] config_dir = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571556 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571664 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] config_source = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571779 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] control_exchange = neutron {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.571923 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] core_plugin = ml2 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572048 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] debug = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572172 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] default_availability_zones = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572390 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572513 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] dhcp_agent_notification = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572644 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] dhcp_agents_per_network = 1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572778 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] dhcp_lease_duration = 86400 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.572953 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] dhcp_load_type = networks {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573094 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] dns_domain = openstacklocal {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573328 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573379 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_default_route_bfd = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573488 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_default_route_ecmp = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573623 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_dvr = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573756 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_new_agents = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.573907 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_services_on_agents_with_admin_state_down = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574041 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_snat_by_default = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574170 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] enable_traditional_dhcp = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574289 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] external_dns_driver = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574411 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] filter_validation = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574543 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] global_physnet_mtu = 1430 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574646 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] graceful_shutdown_timeout = 60 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.574880 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] host = np0000176108 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575081 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] host_dvr_for_dhcp = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575215 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] http_retries = 3 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575351 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] instance_format = [instance: %(uuid)s] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575496 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575642 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ipam_driver = internal {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575765 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ipv6_pd_enabled = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.575942 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] l3_ha = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576089 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576220 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] l3_ha_network_physical_name = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576350 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] l3_ha_network_type = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576482 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_color = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576609 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_config_append = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576745 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.576876 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_dir = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577030 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_file = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577126 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_options = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577257 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_rotate_interval = 1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577392 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_rotate_interval_type = days {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577537 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] log_rotation_type = none {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577645 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577747 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.577911 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578057 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578166 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578300 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_allowed_address_pair = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578439 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_dns_nameservers = 5 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578577 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_header_line = 16384 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578695 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_l3_agents_per_router = 3 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578810 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_logfile_count = 30 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.578979 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_logfile_size_mb = 200 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579117 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_routes = 30 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579250 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] max_subnet_host_routes = 20 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579391 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] my_ip = 199.204.45.244 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579520 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] my_ipv6 = 2604:e100:1:0:f816:3eff:fedb:cf13 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579647 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] network_auto_schedule = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579767 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] network_link_prefix = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.579912 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580050 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] notify_nova_on_port_data_changes = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580190 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] notify_nova_on_port_status_changes = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580335 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] pagination_max_limit = -1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580471 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] periodic_fuzzy_delay = 5 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580599 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] periodic_interval = 40 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580735 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] publish_errors = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.580877 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rate_limit_burst = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581037 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rate_limit_except_level = CRITICAL {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581175 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rate_limit_interval = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581308 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] router_distributed = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581448 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rpc_resources_processing_step = 20 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581584 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rpc_response_max_timeout = 600 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581720 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rpc_response_timeout = 60 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.581851 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rpc_state_report_workers = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582006 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] rpc_workers = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582146 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] send_events_interval = 2 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582295 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] service_plugins = ['ovn-router'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582438 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] setproctitle = on {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582548 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] shell_completion = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582667 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] state_path = /opt/stack/data/neutron {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.582796 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] syslog_log_facility = LOG_USER {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583010 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] tcp_keepidle = 600 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583126 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] transport_url = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583264 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] use_journal = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583393 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] use_json = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583524 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] use_stderr = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583661 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] use_syslog = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583784 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] vlan_qinq = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.583923 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] vlan_transparent = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.584056 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] wsgi_default_pool_size = 100 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.584184 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] wsgi_keep_alive = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.584328 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.584461 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] wsgi_server_debug = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.584626 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_concurrency.disable_process_locking = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.584774 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.584946 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.connection_string = messaging:// {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585086 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.enabled = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585234 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.es_doc_type = notification {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585375 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.es_scroll_size = 10000 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585526 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.es_scroll_time = 2m {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585668 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.filter_error_trace = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585815 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.hmac_keys = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.585976 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.sentinel_service_name = mymaster {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.586141 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.socket_timeout = 0.1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.586280 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.trace_requests = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.586407 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler.trace_sqlalchemy = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.586564 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler_jaeger.process_tags = {} {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.586703 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler_jaeger.service_name_prefix = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.586829 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] profiler_otlp.service_name_prefix = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.587042 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.587167 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.587299 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.587445 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.587559 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.587719 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.enforce_new_defaults = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.588062 np0000176108 neutron-ovn-maintenance-worker[104775]: WARNING oslo_config.cfg [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. May 22 00:59:47.588208 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.enforce_scope = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.588360 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.policy_default_rule = default {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.588528 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.588751 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.588824 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.588994 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.589128 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.589260 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.589390 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.589533 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_policy.remote_timeout = 60.0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.589683 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.589832 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] service_providers.service_provider = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590015 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.auth_section = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590162 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.auth_type = password {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590305 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.auth_url = https://199.204.45.244/identity {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590445 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.cafile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590582 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.certfile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590730 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.collect_timing = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.590891 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.default_domain_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591077 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.default_domain_name = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591222 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.domain_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591357 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.domain_name = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591506 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.endpoint_type = public {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591649 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.insecure = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591781 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.keyfile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.591952 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.password = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592091 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.project_domain_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592232 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.project_domain_name = Default {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592377 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.project_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592533 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.project_name = service {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592678 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.region_name = RegionOne {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592817 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.split_loggers = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.592975 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.system_scope = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593118 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.timeout = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593257 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.trust_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593381 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.user_domain_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593516 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.user_domain_name = Default {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593650 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.user_id = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593795 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] nova.username = nova {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.593961 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.auth_section = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594111 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.auth_type = password {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594244 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.cafile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594378 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.certfile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594514 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.collect_timing = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594660 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.endpoint_type = public {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594790 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.insecure = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.594960 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.keyfile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595092 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.region_name = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595232 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.split_loggers = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595361 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] placement.timeout = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595505 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.auth_section = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595637 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.auth_type = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595776 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.cafile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.595933 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.certfile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596072 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.collect_timing = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596193 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.connect_retries = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596310 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.connect_retry_delay = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596422 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.enable_notifications = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596531 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.endpoint_override = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596656 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.insecure = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596772 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.interface = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.596899 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.keyfile = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597011 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.max_version = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597127 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.min_version = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597243 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.region_name = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597359 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.retriable_status_codes = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597473 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.service_name = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597588 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.service_type = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597701 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.split_loggers = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597814 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.status_code_retries = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.597952 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.status_code_retry_delay = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598069 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.timeout = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598184 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.valid_interfaces = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598303 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ironic.version = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598428 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] cli_script.dry_run = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598568 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598693 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.598833 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599054 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599334 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599475 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599617 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599765 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.hostname = np0000176108 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.599928 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600080 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600215 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600351 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600492 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600629 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600766 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.600927 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601077 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601217 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601360 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601496 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601634 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601776 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.601935 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602063 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602195 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602330 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602468 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602602 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602744 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.602897 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603088 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603230 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603367 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603513 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603656 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.ssl_version = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603799 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.603976 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_notifications.driver = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.604127 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_notifications.retry = -1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.604279 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.604415 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_messaging_notifications.transport_url = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.604560 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_reports.file_event_handler = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.604703 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.604842 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_reports.log_dir = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605008 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605161 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.default_quota = -1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605309 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605447 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_floatingip = 50 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605585 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_network = 100 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605722 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_port = 500 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.605873 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_rbac_policy = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606020 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_router = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606147 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_security_group = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606268 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_security_group_rule = 100 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606389 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.quota_subnet = 100 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606510 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] QUOTAS.track_quota_usage = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606650 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606774 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.group = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.606920 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.helper_command = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607111 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.log_daemon_traceback = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607245 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.logger_name = oslo_privsep.daemon {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607379 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.thread_pool_size = 16 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607514 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep.user = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607655 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607783 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.group = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.607932 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.helper_command = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608061 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608196 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608329 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608459 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_dhcp_release.user = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608599 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608731 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.group = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.608882 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.helper_command = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609009 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609285 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609417 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609549 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_ovs_vsctl.user = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609693 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.capabilities = [21] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609808 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.group = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.609969 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.helper_command = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.610091 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.log_daemon_traceback = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.610295 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.610522 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.thread_pool_size = 16 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.610648 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_namespace.user = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.610779 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.capabilities = [12] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.610909 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.group = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611056 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.helper_command = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611163 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.log_daemon_traceback = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611276 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611392 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.thread_pool_size = 16 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611505 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_conntrack.user = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611628 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.capabilities = [12, 21] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611736 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.group = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.611832 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.helper_command = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612043 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.log_daemon_traceback = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612190 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612328 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.thread_pool_size = 16 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612452 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] privsep_link.user = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612598 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612731 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.612871 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] AGENT.use_helper_for_ns_read = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613018 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] SECURITYGROUP.enable_ipset = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613153 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] SECURITYGROUP.enable_security_group = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613285 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] SECURITYGROUP.firewall_driver = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613428 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613572 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] experimental.ipv6_pd_enabled = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613741 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.extension_drivers = ['port_security', 'qos'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.613891 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.external_network_type = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614052 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.mechanism_drivers = ['ovn'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614197 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.overlay_ip_version = 4 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614331 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.path_mtu = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614463 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.physical_network_mtus = {} {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614614 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.project_network_types = ['geneve'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614758 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.614929 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2.type_drivers = ['local', 'flat', 'vlan', 'geneve'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.615332 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2_type_flat.flat_networks = ['public'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.615594 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2_type_geneve.max_header_size = 38 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.615828 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2_type_geneve.vni_ranges = ['1:65536'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.616083 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.616295 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] network_log.burst_limit = 25 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.616487 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] network_log.local_output_log_base = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.616672 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] network_log.rate_limit = 100 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.616881 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.asyncio_connection = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.617079 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.asyncio_slave_connection = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.617327 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.backend = sqlalchemy {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.617636 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.connection = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.617918 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.connection_debug = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.618214 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.connection_parameters = {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.618423 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.connection_recycle_time = 3600 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.618682 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.connection_trace = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.619068 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.db_inc_retry_interval = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.619299 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.db_max_retries = 20 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.619496 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.db_max_retry_interval = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.619730 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.db_retry_interval = 1 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.619870 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.max_overflow = 50 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620031 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.max_pool_size = 5 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620229 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.max_retries = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620379 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620508 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.mysql_wsrep_sync_wait = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620664 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.pool_timeout = None {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620817 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.retry_interval = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.620964 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.slave_connection = **** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621093 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.sqlite_synchronous = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621219 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.synchronous_reader = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621343 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] database.use_db_reconnect = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621487 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.bfd_min_rx = 1000 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621616 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.bfd_min_tx = 100 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621767 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.bfd_mult = 3 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.621917 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.broadcast_arps_to_all_routers = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622049 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.dhcp_default_lease_time = 43200 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622177 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622302 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.dns_records_ovn_owned = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622433 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.dns_servers = [] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622559 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.enable_distributed_floating_ip = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622701 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.fdb_age_threshold = 300 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.622848 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ha_failover_strategy = normal {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623052 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.live_migration_activation_strategy = rarp {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623181 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.localnet_learn_fdb = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623310 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.mac_binding_age_threshold = 300 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623450 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.neutron_sync_mode = log {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623581 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_dhcp4_global_options = {} {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623729 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_dhcp6_global_options = {} {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.623946 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_l3_scheduler = leastloaded {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.624131 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_metadata_enabled = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.624273 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_nb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.624408 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_nb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.624571 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_nb_connection = ['ssl:199.204.45.244:6641'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.624744 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_nb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.624970 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_router_indirect_snat = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.625152 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_sb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.625335 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_sb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.625502 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_sb_connection = ['ssl:199.204.45.244:6642'] {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.625635 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovn_sb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.625806 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovs_create_tap = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.625958 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovsdb_connection_timeout = 180 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626108 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovsdb_log_level = INFO {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626235 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovsdb_probe_interval = 60000 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626360 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.ovsdb_retry_max_interval = 180 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626485 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.stateless_nat_enabled = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626613 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626764 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVS.bridge_mac_table_size = 50000 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.626924 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVS.igmp_flood = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627167 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVS.igmp_flood_reports = True {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627311 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVS.igmp_flood_unregistered = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627460 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVS.igmp_snooping_enable = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627583 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] OVS.ovsdb_timeout = 10 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627728 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627851 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn_nb_global.ignore_lsp_down = False {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.627971 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.628019 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG cotyledon.oslo_config_glue [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] ******************************************************************************** {{(pid=104775) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3263}} May 22 00:59:47.628144 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG oslo_service.backend._threading.service [None req-19a9d310-6279-43ef-b804-dadcd24a67cd None None] Selected the multiprocessing context: and updated it in Cotyledon ServiceManager: {{(pid=104775) launch_service /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/service.py:405}} May 22 00:59:47.659553 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=105606) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}} May 22 00:59:47.660103 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} May 22 00:59:47.660103 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3230}} May 22 00:59:47.660103 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3231}} May 22 00:59:47.660103 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3232}} May 22 00:59:47.660103 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3237}} May 22 00:59:47.660297 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time = 75 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.660412 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.660527 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.660877 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.661107 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.661234 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config = api-paste.ini {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.661406 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] api_workers = 4 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.661535 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy = keystone {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.661645 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] base_mac = fa:16:3e:00:00:00 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.661953 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] bind_host = 0.0.0.0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662088 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] bind_port = 9696 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662196 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout = 900 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662347 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] config_dir = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662427 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662548 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] config_source = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662674 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] control_exchange = neutron {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662794 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] core_plugin = ml2 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.662937 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] debug = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663082 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663341 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663454 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663567 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network = 1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663666 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration = 86400 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663798 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type = networks {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.663914 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] dns_domain = openstacklocal {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664055 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664157 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664260 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664364 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664467 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664572 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664680 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664788 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664900 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.664972 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.665074 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] filter_validation = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.665185 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu = 1430 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.665299 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout = 60 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.665626 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] host = np0000176108 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667135 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667249 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] http_retries = 3 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667384 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] instance_format = [instance: %(uuid)s] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667477 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667574 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver = internal {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667664 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667782 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] l3_ha = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667875 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.667944 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668004 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668075 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_color = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668160 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_config_append = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668235 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668299 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_dir = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668370 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_file = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668418 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_options = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668466 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval = 1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668552 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type = days {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668633 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type = none {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668699 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668749 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668791 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668873 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668921 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.668989 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669059 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers = 5 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669121 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_header_line = 16384 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669187 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router = 3 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669257 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count = 30 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669309 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb = 200 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669370 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_routes = 30 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669431 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes = 20 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669505 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] my_ip = 199.204.45.244 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669577 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6 = 2604:e100:1:0:f816:3eff:fedb:cf13 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669660 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669735 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669821 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.669904 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670000 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670076 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit = -1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670153 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay = 5 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670206 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval = 40 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670279 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] publish_errors = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670391 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670442 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level = CRITICAL {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670526 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670526 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] router_distributed = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670596 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step = 20 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670670 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout = 600 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670749 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout = 60 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670822 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.670890 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671010 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval = 2 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671111 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] service_plugins = ['ovn-router'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671180 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] setproctitle = on {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671261 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] shell_completion = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671336 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] state_path = /opt/stack/data/neutron {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671401 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility = LOG_USER {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671475 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle = 600 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671584 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] transport_url = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671648 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] use_journal = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671704 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] use_json = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671770 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] use_stderr = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671823 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] use_syslog = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671906 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.671969 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.672036 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size = 100 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.672089 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.672172 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.672225 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3245}} May 22 00:59:47.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672438 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672550 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string = messaging:// {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672636 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672723 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type = notification {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672792 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size = 10000 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672890 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time = 2m {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.672979 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673054 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673134 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673218 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout = 0.1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673282 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673355 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673461 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags = {} {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673532 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673597 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673722 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673780 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673844 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.673951 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674021 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674117 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674162 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674210 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674258 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674297 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674343 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674423 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674468 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674509 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674554 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout = 60.0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674615 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674752 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674752 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674826 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type = password {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674826 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url = https://199.204.45.244/identity {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674913 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.674954 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675075 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675075 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675075 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675188 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675188 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675188 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type = public {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675302 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675302 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675302 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.password = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675402 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675402 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name = Default {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name = service {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675546 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name = RegionOne {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675788 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675835 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675896 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.675964 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676048 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name = Default {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676085 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676142 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] nova.username = nova {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676183 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676220 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type = password {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676256 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676294 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676333 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676378 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type = public {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676459 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676505 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676505 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676578 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676616 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676683 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676730 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676789 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676839 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676839 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676947 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.676947 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677019 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677019 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677088 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677088 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677157 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677197 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677232 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677279 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677279 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677357 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677357 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677429 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677429 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677500 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677538 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677577 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ironic.version = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677626 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677682 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677762 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.677813 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678084 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678128 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678163 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678211 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678258 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678298 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000176108 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678335 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678371 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678408 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678446 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678498 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678536 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678573 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678608 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678696 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678745 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.678781 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679098 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679158 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679193 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679227 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679267 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679310 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679350 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679350 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679428 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679428 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679506 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679506 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679572 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679572 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679653 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679653 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679731 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679771 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679807 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679842 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679932 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.679974 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680013 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680063 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680133 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota = -1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680178 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680218 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip = 50 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680255 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network = 100 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680311 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port = 500 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680364 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680406 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680451 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680508 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680508 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet = 100 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680576 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680617 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680676 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.group = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680719 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680764 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680811 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name = oslo_privsep.daemon {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680851 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size = 16 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680927 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep.user = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.680976 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681095 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681157 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681201 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681240 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681335 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681335 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681406 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681446 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681446 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681516 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681555 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681595 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681640 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681686 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681737 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681737 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681809 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681809 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681914 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681914 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681984 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.681984 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682060 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682060 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682129 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities = [12, 21] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682167 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682213 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682253 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682291 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682336 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size = 16 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682336 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682412 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682454 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682492 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682532 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682571 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682610 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682650 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682719 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682796 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers = ['port_security', 'qos'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682848 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682905 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers = ['ovn'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.682946 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version = 4 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683043 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683043 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus = {} {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683120 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.project_network_types = ['geneve'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683120 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683198 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'geneve'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683237 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks = ['public'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683282 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683320 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges = ['1:65536'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683423 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683523 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit = 25 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683523 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683523 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit = 100 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683624 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683624 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683703 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.backend = sqlalchemy {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683703 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.connection = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683785 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683785 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters = {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683875 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683875 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683948 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683987 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries = 20 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.683987 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684052 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval = 1 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684105 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow = 50 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684148 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size = 5 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684148 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684221 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684265 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684307 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout = None {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684355 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684355 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection = **** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684435 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684435 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684517 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684558 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_rx = 1000 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684558 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_tx = 100 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684635 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_mult = 3 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684635 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684718 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time = 43200 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684718 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684801 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684801 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers = [] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684887 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684887 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold = 300 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684981 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ha_failover_strategy = normal {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.684981 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685060 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685060 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold = 300 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685140 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode = log {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685140 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options = {} {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685212 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options = {} {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685212 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685280 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685280 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685351 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685390 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection = ['ssl:199.204.45.244:6641'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685442 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685442 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685512 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685512 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685581 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection = ['ssl:199.204.45.244:6642'] {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685619 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685658 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685695 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout = 180 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685734 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level = INFO {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685780 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval = 60000 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685780 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685887 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685887 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.685962 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size = 50000 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686002 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686049 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports = True {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686095 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686139 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686185 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout = 10 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686226 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686265 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down = False {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686310 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3256}} May 22 00:59:47.686441 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=105606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3263}} May 22 00:59:47.686494 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [105606] {{(pid=105606) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}} May 22 00:59:47.687947 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-707447', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-8754'] for process (None), after_init {{(pid=105606) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} May 22 00:59:47.690308 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry May 22 00:59:47.776655 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 22 00:59:47.776655 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 22 00:59:47.777026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 22 00:59:47.777026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.777575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.780094 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.244:6641: connecting... May 22 00:59:47.788519 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.244:6641: connected May 22 00:59:47.824433 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry May 22 00:59:47.857985 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 22 00:59:47.858120 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} May 22 00:59:47.858120 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.858270 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=105606) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} May 22 00:59:47.861488 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.244:6642: connecting... May 22 00:59:47.868777 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.244:6642: connected May 22 00:59:47.905278 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip precommit_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.905385 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip precommit_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.905451 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.905514 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.905575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.905631 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port precommit_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.905885 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-63618'] for port_forwarding_plugin (None), after_init {{(pid=105606) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} May 22 00:59:47.905989 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.906053 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > router_interface after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.906112 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.906112 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.906218 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > router_interface after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.906323 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension May 22 00:59:47.906396 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension May 22 00:59:47.906769 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment before_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907005 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete_associations 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907161 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907231 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907290 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907362 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907425 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907425 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907537 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907611 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.907611 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.964122 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.964312 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.964312 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet before_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.964312 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet before_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.966459 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.966563 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.966636 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-1886794'] for logging-plugin (None), after_init {{(pid=105606) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} May 22 00:59:47.966779 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group_rule after_create 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.966849 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group_rule after_update 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:47.966946 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group_rule after_delete 55550000, False {{(pid=105606) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} May 22 00:59:57.312558 np0000176108 neutron-ovn-maintenance-worker[104775]: DEBUG dbcounter [-] [104775] Writing DB stats neutron:SELECT=4 {{(pid=104775) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} May 22 00:59:57.968016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-05-22 00:59:57.967537 {{(pid=105606) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:99}} May 22 00:59:57.969620 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync port groups started @ 2026-05-22 00:59:57.969313 {{(pid=105606) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:132}} May 22 00:59:57.987652 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG dbcounter [-] [105606] Writer thread running {{(pid=105606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} May 22 00:59:58.002999 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync port groups completed @ 2026-05-22 00:59:58.002654 {{(pid=105606) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:196}} May 22 00:59:58.003191 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-05-22 00:59:58.002953 {{(pid=105606) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1152}} May 22 00:59:58.140463 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.services.segments.db [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['66645f52-bf0b-4651-bfff-0fd2ad46c8ad'], 'is_dynamic': False}} {{(pid=105606) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}} May 22 00:59:58.144928 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync metadata ports started {{(pid=105606) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1097}} May 22 00:59:58.394605 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync metadata ports completed {{(pid=105606) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1149}} May 22 00:59:58.394934 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=105606) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:949}} May 22 00:59:58.445878 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-05-22 00:59:58.445650 {{(pid=105606) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1022}} May 22 00:59:58.446167 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 22 00:59:58.446320 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=105606) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1027}} May 22 00:59:58.446410 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=105606) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1086}} May 22 00:59:58.446500 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-05-22 00:59:58.446406 {{(pid=105606) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1321}} May 22 00:59:58.446606 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync ACLs started @ 2026-05-22 00:59:58.446521 {{(pid=105606) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:239}} May 22 00:59:58.489774 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync ACLs completed @ 2026-05-22 00:59:58.489496 {{(pid=105606) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:431}} May 22 00:59:58.490032 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync routers and router ports started @ 2026-05-22 00:59:58.489739 {{(pid=105606) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:736}} May 22 00:59:58.543787 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 22 00:59:58.544271 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync routers and router ports completed @ 2026-05-22 00:59:58.543946 {{(pid=105606) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:944}} May 22 00:59:58.544422 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync port QoS policies started @ 2026-05-22 00:59:58.544264 {{(pid=105606) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1369}} May 22 00:59:58.544601 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] Starting OVNClientQosExtension May 22 00:59:58.573527 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync port QoS policies completed @ 2026-05-22 00:59:58.573196 {{(pid=105606) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1392}} May 22 00:59:58.573714 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync Floating IP QoS policies started @ 2026-05-22 00:59:58.573500 {{(pid=105606) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1397}} May 22 00:59:58.573838 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] Starting OVNClientQosExtension May 22 00:59:58.602213 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-05-22 00:59:58.601811 {{(pid=105606) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1420}} May 22 00:59:58.602213 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync Floating IP NAT rules started @ 2026-05-22 00:59:58.602087 {{(pid=105606) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1425}} May 22 00:59:58.602488 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-05-22 00:59:58.602334 {{(pid=105606) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1451}} May 22 00:59:58.602631 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65b77d94-1bec-41d4-9868-8709ec09056b None None] OVN-Northbound DB sync process completed @ 2026-05-22 00:59:58.602442 {{(pid=105606) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:112}} May 22 01:00:07.968924 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-05-22 01:00:07.968499 {{(pid=105606) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1480}} May 22 01:00:07.969501 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension May 22 01:00:07.971123 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] OVN-SB Sync hostname and physical networks started @ 2026-05-22 01:00:07.970369 {{(pid=105606) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1511}} May 22 01:00:07.976144 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.add_provnet_ext_id_to_localnet_ports {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.976574 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.976736 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_dhcp_options_consistency {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.976891 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978152 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978248 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978347 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978413 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978479 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978559 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978644 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978711 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978771 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978822 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.978941 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.979116 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.migrate_lrp_gateway_chassis_to_ha_chassis_group {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.980633 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.agent.neutron_agent [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] Agents populated in the agent cache: {{(pid=105606) populate /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/agent/neutron_agent.py:309}} May 22 01:00:07.981378 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.981378 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.agent.neutron_agent [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] - Agent type: OVN Controller Gateway agent, hostname: np0000176108, name: 954b4a00-6dd1-47cd-86a8-a9310c56cf08 {{(pid=105606) populate /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/agent/neutron_agent.py:311}} May 22 01:00:07.981378 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.981561 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.agent.neutron_agent [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] - Agent type: OVN Neutron agent, hostname: np0000176108, name: 954b4a00-6dd1-47cd-86a8-a9310c56cf08 {{(pid=105606) populate /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/agent/neutron_agent.py:311}} May 22 01:00:07.983242 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.983479 np0000176108 neutron-ovn-maintenance-worker[105606]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] New host np0000176108 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron May 22 01:00:07.983690 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_ha_failover {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.983760 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.983850 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.984318 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.984379 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.984465 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_security_group_with_address_group {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.984674 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_virtual_port_parent_hostname {{(pid=105606) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:148}} May 22 01:00:07.986238 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_provnet_ext_id_to_localnet_ports' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.986766 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started May 22 01:00:07.986903 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization May 22 01:00:07.991472 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.994020 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.994227 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.994411 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.994573 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.994719 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.994872 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.995141 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.995298 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.995434 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.996115 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.996479 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.996559 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.996685 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.996776 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.migrate_lrp_gateway_chassis_to_ha_chassis_group' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.996879 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997004 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997092 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997192 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997269 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997357 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997567 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997567 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:07.997797 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:08.000035 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_virtual_port_parent_hostname' {{(pid=105606) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:826}} May 22 01:00:08.003626 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG oslo_concurrency.lockutils [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=105606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} May 22 01:00:08.003984 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG oslo_concurrency.lockutils [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.001s {{(pid=105606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} May 22 01:00:08.031563 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron_lib.callbacks.manager [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-7001122', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-653201'] for segment_host_mapping (None), after_create {{(pid=105606) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} May 22 01:00:08.044377 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.add_provnet_ext_id_to_localnet_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.044377 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_baremetal_ports_dhcp_options {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.044377 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Sync baremetal port DHCP options with configuration. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.046491 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.services.segments.db [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] Segments {'566bec33-5819-4515-9d99-9ac7652133fa'} mapped to the host np0000176108 {{(pid=105606) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}} May 22 01:00:08.068070 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG oslo_concurrency.lockutils [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.064s {{(pid=105606) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} May 22 01:00:08.068345 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] OVN-SB Sync hostname and physical networks completed @ 2026-05-22 01:00:08.068091 {{(pid=105606) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1538}} May 22 01:00:08.129554 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_baremetal_ports_dhcp_options finished in 0.084 seconds May 22 01:00:08.129554 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.129554 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_dhcp_options_consistency {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.129554 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Backfill network_id on DHCP_Options external_ids. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.181059 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_dhcp_options_consistency finished in 0.051 seconds May 22 01:00:08.181059 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.181267 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fair_meter_consistency {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.181267 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Refresh ACL logging fair meter after configuration reload. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.181533 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fair_meter_consistency finished in 0.000 seconds May 22 01:00:08.181635 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.181743 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.181889 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.192627 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:08.294617 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.294617 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.302685 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.121 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:08.317401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.317942 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:08.318369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.318369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:08.321626 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:08.322281 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_for_igmp_snoop_support {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Check for IGMP snoop support. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_for_igmp_snoop_support finished in 0.000 seconds May 22 01:00:08.322928 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.323206 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_for_inconsistencies {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.323206 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Checking Neutron and OVN revision consistency. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.354065 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=105606) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:437}} May 22 01:00:08.354287 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_for_inconsistencies finished in 0.031 seconds May 22 01:00:08.354558 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_global_dhcp_opts {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.354796 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Check global DHCP options consistency. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.354976 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_global_dhcp_opts finished in 0.000 seconds May 22 01:00:08.355120 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.355295 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_localnet_port_has_learn_fdb {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.355419 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Ensure localnet ports have learn-fdb set per configuration. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.356409 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 22 01:00:08.359468 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_localnet_port_has_learn_fdb finished in 0.004 seconds May 22 01:00:08.360886 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.361131 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_network_broadcast_arps_to_all_routers {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.361301 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Sync broadcast-arps-to-all-routers on external networks. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.421188 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_network_broadcast_arps_to_all_routers finished in 0.060 seconds May 22 01:00:08.421564 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.421564 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_provider_distributed_ports {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.421663 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Align reside-on-redirect-chassis on VLAN/FLAT distributed ports. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.545765 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_provider_distributed_ports finished in 0.124 seconds May 22 01:00:08.545949 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.546144 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_redirect_type_router_gateway_ports {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.546266 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Align router gateway redirect-type for provider VLAN/FLAT networks. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.580988 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 22 01:00:08.581381 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-96d0311e-1d9e-48f0-8ef4-2b3a13b1f7ff None None] OVN-Southbound DB sync process completed @ 2026-05-22 01:00:08.581056 {{(pid=105606) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1488}} May 22 01:00:08.634241 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_redirect_type_router_gateway_ports finished in 0.088 seconds May 22 01:00:08.634395 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.634560 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.634618 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.636455 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.636620 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.637210 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:08.637877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.638473 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:08.639026 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:08.639724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: cleanup_old_hash_ring_nodes {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.640601 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Purge stale hash ring nodes older than five days. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.642632 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.db.ovn_hash_ring_db [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Cleaned up Hash Ring nodes older than 5 days May 22 01:00:08.642780 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task cleanup_old_hash_ring_nodes finished in 0.004 seconds May 22 01:00:08.642998 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: configure_nb_global {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.643089 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply ovn_nb_global settings to NB_Global options. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.643370 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:08.644319 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.644588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.645640 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:08.646658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.647364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task configure_nb_global failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1038, in configure_nb_global May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.647888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:08.648406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:08.648927 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1038, in configure_nb_global May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:08.649480 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} May 22 01:00:08.650488 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.migrate_lrp_gateway_chassis_to_ha_chassis_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.651231 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.651231 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.651231 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:08.651408 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.651612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.653003 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:08.653726 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.654488 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.654882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:08.655399 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:08.656012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.656596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_network_type_and_physnet {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.658390 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set network type and physnet external_ids on logical switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.664820 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_network_type_and_physnet finished in 0.009 seconds May 22 01:00:08.665022 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.665194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_ovn_owned_dns_option {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.665301 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply ovn_owned option on DNS records per configuration. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.665553 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_ovn_owned_dns_option finished in 0.000 seconds May 22 01:00:08.665700 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.665906 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.666018 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.666258 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:08.666626 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.666867 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.667374 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:08.668123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.668534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.668871 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:08.669171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:08.669552 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.669552 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:08.669552 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.669552 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.669674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:08.670304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:08.670982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.670982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:08.670982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.670982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:08.670982 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_lrouter_ports_ext_ids_name_prefix {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.670982 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: ('Check missing prefix router_name', 'in external_ids of LRPs.') {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.671150 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_lrouter_ports_ext_ids_name_prefix finished in 0.001 seconds May 22 01:00:08.671193 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.671308 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.671425 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.671559 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:08.672869 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.673110 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:08.673328 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.674384 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:08.675023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.675374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:08.675829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:08.676279 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_router_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.676807 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Sync router.distributed with distributed floating IP config. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.680434 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_router_distributed_flag finished in 0.004 seconds May 22 01:00:08.680671 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.680832 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_router_static_routes {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.680992 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Mark Neutron-owned static routes in OVN external_ids. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.682116 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_router_static_routes finished in 0.001 seconds May 22 01:00:08.682276 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.682483 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_security_group_with_address_group {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:08.682643 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Repair Address_Sets and ACLs for address group rules. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:08.694854 np0000176108 neutron-ovn-maintenance-worker[105606]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_security_group_with_address_group finished in 0.012 seconds May 22 01:00:08.695016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:08.696100 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_virtual_port_parent_hostname' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105606) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:881}} May 22 01:00:13.182249 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:13.182987 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:13.182987 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:13.184195 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:13.214909 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:13.215182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.215948 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.033 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:13.216672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.217343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:13.218011 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:13.218710 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.219587 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:13.219587 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:13.219587 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.219587 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:13.219587 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.219587 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:13.635236 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:13.635697 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:13.635894 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:13.636882 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.639092 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:13.639588 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.640255 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:13.641034 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:13.641747 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.642143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:13.642143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:13.642143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.642143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:13.642143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.642143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:13.650649 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:13.651543 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:13.651630 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:13.651815 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:13.652526 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:13.653004 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.653984 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:13.655234 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.656231 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.656748 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:13.657154 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:13.657613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.657613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:13.657613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.657613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:13.658293 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.658829 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.659372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:13.666119 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:13.666397 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:13.666468 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:13.666575 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:13.667167 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:13.667442 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.668037 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:13.668595 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.669044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.669292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:13.669605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:13.670010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.670010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:13.670010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.670010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.670349 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:13.670895 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:13.671507 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.671507 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:13.671507 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.671507 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:13.671507 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:13.671879 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:13.672069 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:13.672350 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:13.672760 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:13.673035 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:13.673117 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.674786 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:13.676244 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.676775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:13.677386 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.677386 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:13.677831 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:13.678474 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:13.679099 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:13.679099 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:13.679099 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:18.184173 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:18.184760 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:18.185053 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:18.186319 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:18.227626 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:18.228059 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.228949 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.044 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:18.229894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.230147 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:18.230425 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.230425 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:18.230949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:18.231306 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.231717 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:18.231717 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.231717 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:18.635840 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:18.636339 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:18.636537 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:18.637361 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:18.637674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.638550 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:18.640259 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.640843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:18.641442 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.641442 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:18.641937 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:18.642352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.642830 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:18.642830 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.642830 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:18.651764 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:18.652168 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:18.652346 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:18.652521 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:18.653069 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:18.653378 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.654188 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:18.655572 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.656413 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.657373 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:18.658020 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:18.658704 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.658704 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:18.658704 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.658704 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:18.659787 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.660249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.660755 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:18.666660 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:18.667069 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:18.667215 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:18.667424 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:18.668049 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:18.668449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.669369 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:18.670560 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.671396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.671990 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:18.672532 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:18.673202 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.673202 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:18.673202 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.673202 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.673803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:18.674642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:18.675656 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:18.676012 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:18.676012 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:18.676012 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.676316 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:18.677633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.678006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:18.678341 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.678341 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:18.679200 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:18.679694 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:18.680269 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:18.680269 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:18.680269 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:23.184973 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:23.185645 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:23.185645 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:23.186336 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:23.218361 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:23.218659 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.219357 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:23.220088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.220434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:23.220795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.220795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:23.220888 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:23.221353 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.221898 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:23.221898 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.221898 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:23.636279 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:23.636807 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:23.637091 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:23.638003 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:23.638372 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.639277 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:23.640923 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.641278 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:23.641596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.641596 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:23.643214 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:23.643646 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.644143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:23.644143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.644143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:23.653194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:23.653194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:23.653194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:23.653194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:23.653194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:23.654165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.654305 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:23.654965 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:23.655848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.656465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.657809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:23.658991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.659743 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.660288 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:23.667242 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:23.667624 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:23.667761 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:23.667971 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:23.668491 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:23.668896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.669680 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:23.670894 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.671350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.672324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:23.672642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:23.673056 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.673056 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:23.673056 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.673056 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.674082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:23.674549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:23.675106 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:23.675327 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:23.675665 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:23.676089 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:23.676275 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.677080 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:23.677924 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.678438 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:23.678843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.678843 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:23.678955 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:23.679389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:23.679929 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:23.679929 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:23.679929 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:28.185614 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:28.186482 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:28.186482 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:28.187682 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:28.224176 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:28.224598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.225462 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.039 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:28.226233 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.227115 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:28.228232 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:28.229304 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.230602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:28.230602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:28.230602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.230602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:28.230602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.230602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:28.637026 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:28.637461 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:28.637671 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:28.638712 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:28.639047 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.639876 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:28.641807 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.642502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:28.643065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.643065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:28.643656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:28.644453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.645307 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:28.645307 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.645307 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:28.652879 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:28.653424 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:28.653648 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:28.653877 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:28.654431 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:28.654741 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.655467 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:28.656832 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.657497 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.658446 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:28.658982 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:28.659583 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.659583 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:28.659583 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.659583 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:28.660299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.661052 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.661802 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:28.667831 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:28.668158 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:28.668272 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:28.668403 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:28.668758 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:28.669036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.669612 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:28.670818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.671840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.672223 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:28.672766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:28.673385 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.673385 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:28.673385 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.673385 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.673839 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:28.674931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:28.676016 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:28.676795 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:28.676795 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:28.676795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.677325 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:28.678650 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.679504 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:28.680371 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:28.681285 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:28.681764 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:28.681764 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:28.681764 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:28.681764 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:28.681764 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:28.681764 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:33.186280 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:33.186924 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:33.187043 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:33.187909 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:33.222647 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:33.222986 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.223700 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:33.224478 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.224877 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:33.225267 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.225267 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:33.225406 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:33.225836 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.226434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:33.226434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.226434 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:33.637536 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:33.638126 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:33.638310 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:33.639221 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:33.639600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.640518 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:33.641991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.642605 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:33.643299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.643299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:33.643643 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:33.644192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.644744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:33.644744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.644744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:33.653392 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:33.653699 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:33.653817 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:33.653981 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:33.657626 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:33.658035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.660365 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:33.661310 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.006 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.662089 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:33.663137 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.663137 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:33.664043 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.664638 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.665242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:33.668258 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:33.668673 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:33.668880 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:33.669094 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:33.669742 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:33.670073 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.670688 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:33.672008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.672737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.673636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:33.674410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:33.675006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.675006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:33.675006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.675006 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.676010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:33.676818 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:33.677846 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:33.678307 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:33.678373 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:33.678561 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.679263 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:33.680612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.681001 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:33.681375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.681375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:33.681680 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:33.682120 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:33.682603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:33.682603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:33.682603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:38.187139 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:38.187849 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:38.187849 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:38.188354 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:38.215451 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:38.215850 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.216826 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.029 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:38.217648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.218382 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:38.219016 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:38.219775 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.221459 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:38.221459 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:38.221459 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.221459 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:38.221459 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.221459 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:38.638282 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:38.641185 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:38.641319 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:38.642346 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:38.642526 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.643077 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:38.644249 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.644958 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:38.645608 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.645608 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:38.645882 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:38.646849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.647922 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:38.647922 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.647922 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:38.653716 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:38.654051 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:38.654151 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:38.654284 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:38.654680 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:38.654908 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.655418 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:38.656327 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.656821 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.657465 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:38.658125 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:38.658797 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.658797 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:38.658797 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.658797 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:38.659208 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.660019 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:38.668642 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:38.668922 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:38.669068 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:38.669255 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:38.669744 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:38.670212 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.670953 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:38.671884 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.672334 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.673143 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:38.673501 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:38.673987 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.673987 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:38.673987 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.673987 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.674600 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:38.675467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:38.676437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.676437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:38.676437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.676437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:38.677561 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:38.677561 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:38.677561 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:38.677561 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:38.677888 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:38.678242 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:38.678421 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.679192 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:38.680184 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.681205 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:38.682008 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:38.682847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:38.683824 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:38.683824 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:38.683824 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:38.683824 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:38.683824 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:38.683824 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:43.188037 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:43.188997 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:43.189559 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:43.191382 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:43.223635 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:43.224129 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.225190 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:43.226138 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.226964 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:43.227674 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:43.228265 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.228948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:43.228948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:43.228948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.228948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:43.228948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.228948 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:43.641406 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:43.642054 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:43.642265 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:43.643147 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:43.643386 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.644077 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:43.645695 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.646384 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:43.647155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.647155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:43.647597 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:43.648445 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.649424 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:43.649424 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.649424 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:43.654303 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:43.654674 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:43.654786 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:43.654951 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:43.655370 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:43.655612 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.656215 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:43.656962 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.657514 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.657835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:43.658228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:43.658658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.658658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:43.658658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.658658 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:43.658837 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.659374 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.659945 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:43.669215 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:43.669551 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:43.669662 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:43.669808 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:43.670374 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:43.670761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.671575 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:43.672344 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.673126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.673589 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:43.674191 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:43.674914 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:43.675744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.676736 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:43.677485 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:43.677655 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:43.677814 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:43.678025 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:43.678424 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:43.678767 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:43.679013 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.679759 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:43.680571 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.680968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:43.681370 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.681370 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:43.681568 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:43.682025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:43.682549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:43.682549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:43.682549 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:48.188674 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:48.189537 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:48.189537 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:48.192898 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:48.231684 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:48.232010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.232713 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.043 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:48.233594 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.234291 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:48.234996 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:48.235789 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.236668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:48.236668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:48.236668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.236668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:48.236668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.236668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:48.642408 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:48.642717 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:48.642967 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:48.643938 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:48.644169 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.644852 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:48.646458 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.647023 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:48.647396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.647396 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:48.647665 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:48.648194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.648700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:48.648700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.648700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:48.654950 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:48.654950 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:48.655088 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:48.655331 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:48.656030 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:48.656356 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.657252 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:48.658692 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.659165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.660579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:48.660973 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:48.661369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.661369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:48.661369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.661369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:48.662409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.662920 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.663466 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:48.669700 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:48.669974 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:48.670130 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:48.670344 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:48.671292 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:48.672065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.673017 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:48.674250 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.675287 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.675809 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:48.676713 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:48.677681 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.677681 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:48.677681 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.677681 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.679508 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:48.680199 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:48.680946 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.680946 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:48.680946 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.680946 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:48.680946 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:48.680946 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:48.681433 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:48.681491 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:48.682407 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:48.682800 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:48.683085 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.684097 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:48.685025 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.685448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:48.685835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.685835 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:48.686028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:48.686689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:48.687284 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:48.687284 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:48.687284 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:53.189555 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:53.190438 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:53.190438 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:53.190971 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:53.218333 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:53.218529 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.219065 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.029 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:53.219834 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.220426 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:53.221065 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:53.221795 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.222697 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:53.222697 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:53.222697 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.222697 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:53.222697 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.222697 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:53.643194 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:53.643441 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:53.643441 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:53.644328 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:53.644637 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.645402 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:53.646329 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.647035 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:53.647573 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:53.648260 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.649105 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:53.649105 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:53.649105 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.649105 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:53.649105 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.649105 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:53.655229 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:53.655524 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:53.655635 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:53.655760 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:53.656241 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:53.656527 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.657328 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:53.658602 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.659449 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.660078 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:53.660782 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:53.661627 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.662430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.663400 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:53.670169 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:53.670451 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:53.670567 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:53.670686 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:53.671157 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:53.671558 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.672584 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:53.673543 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.673991 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.674518 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:53.674847 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:53.675316 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.675316 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:53.675316 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.675316 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.675840 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:53.676931 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:53.678088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.678088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:53.678088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.678088 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:53.680466 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:53.680850 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:53.681044 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:53.681270 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:53.681727 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:53.682105 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:53.682323 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.683082 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:53.683979 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.684322 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:53.684652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.684652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:53.684975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:53.685505 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:53.686030 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:53.686030 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:53.686030 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:58.190471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:58.191329 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:58.191329 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:58.192368 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:58.194050 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG dbcounter [-] [105606] Writing DB stats neutron:SELECT=520,neutron:INSERT=1,neutron:UPDATE=2,neutron:DELETE=1 {{(pid=105606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} May 22 01:00:58.227256 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:58.227647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.228541 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.037 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:58.229765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.230534 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:58.231217 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.231217 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:58.231333 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:58.232097 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.233087 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:58.233087 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.233087 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:58.643853 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:58.644208 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:58.644361 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:58.645261 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:58.645580 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.646454 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:58.647499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.648299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:58.648822 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:58.649772 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.651395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:58.651395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:58.651395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.651395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:58.651395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.651395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:58.655598 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:58.655770 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:58.655916 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:58.656031 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:00:58.656649 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:58.656949 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.657652 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:58.658437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.658896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.659387 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:58.660091 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:58.661036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.661481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.662081 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:58.670584 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:58.670809 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:58.670937 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:58.671069 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:58.671525 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:58.671869 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.672544 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:00:58.673369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.673799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.674350 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:58.675174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:58.676419 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:58.677036 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.678086 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:00:58.681003 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:00:58.681280 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:00:58.681422 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:00:58.681553 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:00:58.682013 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:58.682327 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:00:58.682491 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.683153 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:00:58.684084 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.684448 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:00:58.684803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.684803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:00:58.685151 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:00:58.686116 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:00:58.687103 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:00:58.687103 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:00:58.687103 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:03.191175 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:03.191981 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:03.192240 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:03.194457 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:03.226638 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:03.227160 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.036 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:03.229647 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.230263 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:03.230777 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.230777 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:03.230896 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:03.231540 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.232339 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:03.232339 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.232339 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:03.644664 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:03.645892 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:03.646266 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:03.647393 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:03.647686 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.648451 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:03.650101 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.650678 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:03.651228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.651228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:03.651757 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:03.652509 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.653130 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:03.653130 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.653130 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:03.656060 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:03.656374 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:03.656521 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:03.656651 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:01:03.657149 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:03.657499 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.658341 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:03.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.659625 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.660300 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:03.660670 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:03.661123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.661123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:03.661123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.661123 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:03.661648 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.662167 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.662705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:03.671170 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:03.671569 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:03.671744 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:03.672012 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:03.672755 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:03.673292 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.674211 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:03.675369 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.676077 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.004 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.676940 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:03.677506 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:03.678217 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.678217 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:03.678217 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.678217 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.678652 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:03.679453 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:03.680282 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.680282 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:03.680282 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.680282 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:03.681446 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:03.681711 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:03.681829 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:03.682006 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:03.682442 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:03.682826 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:03.683051 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.683701 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:03.684633 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.685010 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:03.685437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.685437 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:03.685722 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:03.686242 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:03.686779 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:03.686779 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:03.686779 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:08.192018 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:08.192819 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:08.192819 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:08.193383 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:08.224707 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:08.225206 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.226156 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:08.226988 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.227744 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:08.228708 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:08.229345 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.230150 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:08.230150 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:08.230150 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.230150 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:08.230150 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.230150 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:08.645551 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:08.646176 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:08.646420 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:08.647633 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:08.648002 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.649118 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:08.650885 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.651700 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:08.653050 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.653050 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:08.653660 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:08.654430 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.655268 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:08.655268 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.655268 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:08.656559 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:08.657006 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:08.657239 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:08.657493 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:01:08.658011 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:08.658299 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.658994 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:08.659934 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.660673 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.661155 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:08.661699 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:08.662352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.662352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:08.662352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.662352 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:08.662672 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.663213 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.663766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:08.671595 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:08.671944 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:08.672111 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:08.672285 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:08.672798 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:08.673160 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.673804 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:08.674739 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.675389 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.676055 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:08.676343 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:08.676636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.676636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:08.676636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.676636 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.677375 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:08.677709 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:08.678095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.678095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:08.678095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.678095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:08.681839 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:08.682119 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:08.682238 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:08.682392 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:08.682811 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:08.683219 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:08.683402 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.684126 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:08.685044 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.685318 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:08.685579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.685579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:08.686706 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:08.687510 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:08.688444 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:08.688444 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:08.688444 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:13.192556 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:13.193836 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:13.193836 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:13.193836 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:13.227001 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:13.227335 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.227689 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.035 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:13.228483 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.229215 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:13.229796 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:13.230613 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.231642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:13.231642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:13.231642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.231642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:13.231642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.231642 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:13.646235 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:13.646730 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:13.646730 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:13.647770 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:13.648136 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.649039 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:13.650579 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.651753 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:13.653095 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:13.653737 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.654555 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:13.654555 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:13.654555 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.654555 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:13.654555 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.654555 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:13.657072 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:13.657419 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:13.657577 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:13.657743 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:01:13.658224 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:13.658503 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.659170 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:13.659983 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.660436 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.660803 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:13.661219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:13.661609 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.661609 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:13.661609 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.661609 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:13.662037 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.662502 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.663493 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:13.672075 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:13.672471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:13.672471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:13.672471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:13.673020 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:13.673395 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.674165 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:13.675401 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.676766 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.003 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.677603 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:13.678768 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:13.679364 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:13.679999 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.680780 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:13.682218 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:13.682452 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:13.682566 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:13.682724 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:13.683167 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:13.683486 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:13.683659 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.684362 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:13.685252 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.685523 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:13.685765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.685765 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:13.686346 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:13.686656 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:13.687021 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:13.687021 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:13.687021 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:18.193358 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:18.194253 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:18.194253 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:18.195471 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:18.230797 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:18.231229 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.232149 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.038 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:18.233219 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.233848 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:18.234799 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:18.236423 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.237735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:18.237735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:18.237735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.237735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:18.237735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.237735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:18.646891 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:18.647428 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_router_default_route_empty_dst_ip {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:18.647538 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Remove default routes with empty destination from routers. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:18.648580 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-c8b28dd9-efa7-4ec8-9fe9-e21ca09c29b2, routes=[], if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:18.648966 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.649724 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_router_default_route_empty_dst_ip failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:18.650761 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.651409 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:18.651968 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 984, in check_router_default_route_empty_dst_ip May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:18.652685 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.653324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:18.653324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:18.653324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.653324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:18.653324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.653324 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:18.657524 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:18.657810 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: set_fip_distributed_flag {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:18.657930 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Set distributed floating IP flag in NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:18.658082 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105606) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1208}} May 22 01:01:18.658495 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:18.658783 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.659481 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:18.660228 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.661028 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task set_fip_distributed_flag failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^ May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.661414 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:18.661975 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:18.662598 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1212, in set_fip_distributed_flag May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^ May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.663253 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.664131 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:18.672525 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:18.672817 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_ha_failover {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:18.672956 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply HA chassis failover BFD settings to NB_Global. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:18.673072 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:18.673550 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:18.673978 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.674668 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() May 22 01:01:18.675410 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.675849 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.command May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_ha_failover failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.676271 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:18.676611 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:18.677171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.677171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:18.677171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.677171 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.677498 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1273, in update_ha_failover May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:18.678467 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:18.679289 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.679289 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:18.679289 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.679289 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:18.682701 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:18.683003 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: update_mac_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:18.683077 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Update MAC binding aging and router MAC age limits. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:18.683252 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:18.683693 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:18.684120 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:18.684303 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.684984 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task update_mac_aging_settings failed after 0.002 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:18.685751 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.686145 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:18.686519 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.686519 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:18.686705 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 900, in update_mac_aging_settings May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:18.687194 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:18.687735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:18.687735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:18.687735 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics May 22 01:01:23.193985 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105606) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:784}} May 22 01:01:23.194830 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Starting OVN maintenance task: check_fdb_aging_settings {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}} May 22 01:01:23.194830 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task: Apply FDB aging limits to NB_Global and provider switches. {{(pid=105606) wrapper /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:101}} May 22 01:01:23.196458 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105606) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:951}} May 22 01:01:23.226127 np0000176108 neutron-ovn-maintenance-worker[105606]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105606) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} May 22 01:01:23.226798 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Traceback (most recent call last): May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: txn.results.put(txn.do_commit()) May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: ^^^^^^^^^^^^^^^ May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: raise RuntimeError(msg) May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:23.227785 np0000176108 neutron-ovn-maintenance-worker[105606]: May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] OVN maintenance task check_fdb_aging_settings failed after 0.034 seconds: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last): May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance result = f(*args, **kwargs) May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^^^^ May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with super().transaction(*args, **kwargs) as t: May 22 01:01:23.229903 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen) May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance with self.create_transaction( May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit() May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^ May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise result.ex May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance txn.results.put(txn.do_commit()) May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ^^^^^^^^^^^^^^^ May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:23.230663 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise RuntimeError(msg) May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics [None req-b94a2cff-38cb-4409-9cb7-0d6197fc4c34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics Traceback (most recent call last): May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 376, in run May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics work() May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 90, in __call__ May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 213, in decorator May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(*args, **kwargs) May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 81, in decorator May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics return f(self, *args, **kwargs) May 22 01:01:23.231376 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 107, in wrapper May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics result = f(*args, **kwargs) May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 884, in check_fdb_aging_settings May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 272, in transaction May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics next(self.gen) May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics with self.create_transaction( May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics self.result = self.commit() May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^ May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise result.ex May 22 01:01:23.232174 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run May 22 01:01:23.233182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics txn.results.put(txn.do_commit()) May 22 01:01:23.233182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ May 22 01:01:23.233182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit May 22 01:01:23.233182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics raise RuntimeError(msg) May 22 01:01:23.233182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it May 22 01:01:23.233182 np0000176108 neutron-ovn-maintenance-worker[105606]: ERROR futurist.periodics